Data-driven model for ternary-blend concrete compressive strength prediction using machine learning approach

https://doi.org/10.1016/j.conbuildmat.2021.124152Get rights and content

Highlights

  • LSSVM using CSA for optimization was proposed in estimating the concrete compressive strength.

  • The inclusion of all input variables provided a better representation of the developed model.

  • LSSVM using CSA to optimize the hyperparameters improved the performance of the model.

  • Sensitivity analysis revealed a substantial correlation between the input and target variables.

  • The LSSVM-CSA model showed superior robustness and performance when compared with other studies.

Abstract

Ternary-blend concrete is a complex composite material, and the nonlinearity in its compressive strength behavior is unquestionable. Entirely many models have been developed to accurately predict the ternary-blend concrete compressive strength, such as ANN, SVM, random forest, decision tree, to mention but a few. This study underscores the better predictive performance and successful application of the least square support vector machine (LSSVM), a machine learning model for predicting the compressive strength of ternary-blend concrete. Coupled simulated annealing (CSA) was applied to the LSSVM model as an optimization algorithm. In addition, the genetic programming (GP) model was used as a benchmark model to compare the performance of the LSSVM-CSA model. The predictive performance of the LSSVM-CSA was compared with that of some of the proposed models in well-known studies where the same datasets were used. The model proposed in this study outperformed other studies, yielding an R2 value of 0.954.

Introduction

Similar to every brittle material, the primary factor governing the compressive strength of concrete is the porosity. While there are other important characteristics of concrete, such as durability, impermeability, and volume stability, compressive strength has become universally accepted as the most important indication of concrete quality. Concrete compressive strength is affected by many factors, such as the quality of the raw materials (cement, supplementary cementitious materials, aggregates, water, etc.)., water-cement (w/c) ratio, coarse–fine aggregate ratio, age of concrete, proper vibration and compaction of concrete, relative humidity, and curing of concrete. The higher the w/c ratio, the greater the intergranular spacing between the cement particles and the greater the volume of voids left unfilled by hydration products after cement hydration. The coarse–fine aggregate (CA/FA) ratio is another influencing factor associated with the w/c ratio. The proportion of CA to FA influences the overall aggregate surface area, which affects the water demand of the concrete. With higher FA content relative to CA content, the water demand (w/c ratio) increases owing to the increased total aggregate surface area and vice versa if the FA content is lower. A higher or lower total aggregate surface area leads to a higher or lower w/c ratio, which in turn leads to a decrease or increase in the compressive strength, respectively. Since water is available for cement hydration, the compressive strength of concrete will continue, albeit at a continuously decreasing rate as it ages. Therefore, the age of concrete is synonymous with the degree of cement hydration provided that the concrete has not dried out or the surrounding temperature is not too low. In practical terms, a large portion of the concrete compressive strength would have developed after 28 d. To achieve a desirable compressive strength, curing is imperative for maximizing the concrete's potential for attainable compressive strength. Curing ensures the continuation of the hydration process in concrete, leading to continued strength gain. The hydration can continue due to the good preservation of moisture and temperature within the concrete for an adequate period of time.

Owing to the importance of the mechanical properties of concrete in reinforced concrete design codes and specifications, accurate prediction of these properties has become a concern. A significant concrete property is the compressive strength, which is usually measured after 28 days of standard curing [1]. Until recently, when computational intelligence, such as artificial neural networks (ANNs) [2], [3], [4], support vector regression (SVR) [5], [6], [7], [8], random forest (RF) [9], [10], [11], [12], etc., have been successfully applied in concrete research, estimating the mechanical properties of concrete has always been through linear and nonlinear regression methods [1], [13]. Other researchers have conducted studies to estimate the compressive strength using empirical methods where experimental data are calibrated, input ranges are limited, and constants required to describe the relationship between the inputs and the compressive strength are difficult to obtain [14], [15]. While some empirical models' effectiveness has been proven in some studies to save time and resources for future applications, multiple drawbacks remain in their development [16]. Several machine learning algorithms have been proposed as innovative predictive tools for predicting the compressive strength of concrete to overcome these weaknesses.

In concrete material studies, machine learning and data science have been used broadly in the optimization of concrete mixtures [17], [18], [19], fresh properties [20], [21], [22], [23], hardened properties [2], [5], [8], [10], [11], [12], [14], [24], [25], and durability properties [9], [26], [27], [28], [29] estimation of different types of concrete.

Using random forest, Silva et al. [30] presented a model to predict the compressive strength of concrete from 1030 experimental data with eight variables retrieved from Yeh's study [31]. The developed model outputs were compared with those from the support vector machine (SVM) and ANN. Comparing ANN and instance-based learning (IBL) or k-nearest neighbors (kNN), Dutta and Barai [32] explored the prediction efficiencies of these models in predicting the compressive strength of concrete using the mixture ingredients as features. Dao et al. [33] studied the sensitivity and robustness of Gaussian process regression (GPR) with five kernel functions and an ANN using a 500-run Monte Carlo simulation to estimate the compressive strength of high-performance concrete (HPC). The results revealed that the GPR with the Matern32 kernel function performed better than the ANN in predicting HPC compressive strength. Two models to forecast the compressive strength of HPC based on ANN ensembles (bagging and gradient boosting) with prediction accuracy enhancement through the coupling of discrete wavelength transform (DWT) with the ANN ensembles was proposed by Erdal et al. [34]. The DWT was concluded to be a useful tool for increasing the accuracy of the developed ANN ensembles.

Amid numerous other ML techniques, the least square support vector machine (LSSVM) has recently gained broader acceptance in concrete material science. [35], [36], [37], [38], [39]. With a careful review of available studies, it was found that there are few studies where LSSVM was adopted as the algorithm of choice for predicting the compressive strength of normal concrete. Xue [40] explored five different models and proposed a hybrid LSSVM model in one of these studies. Its hyperparameters were optimized to improve the model's estimation accuracy using improved particle swarm optimization (IMPSO) techniques. In another study, Aiyer et al. [41] explored the capability of the LSSVM and relevance vector machine (RVM) in the prediction of the compressive strength of SCC. While the RVM performed better, the margin of performance in comparison to LSSVM was minimal. Biswas et al. [35] also explored the excellent predictability of LSSVM in estimating concrete compressive strength in addition to other ML techniques. In another bid to estimate the concrete compressive strength accurately, Prayogo [42] developed a novel and advanced hybrid ML algorithm combining the robust prediction accuracy of LSSVM with a new metaheuristic, symbiotic organisms search (SOS).

The primary objective of our study is to develop a data-driven model with the ability to accurately predict the compressive strength of ternary blend (blast furnace slag, Portland cement, and fly ash) concrete using readily available experimental mixture parameters. This study proposes a least square support vector machine with coupled simulated annealing for parameter optimization (LSSVM-CSA) and genetic programming (GP) as predictive tools to solve the problem of estimating concrete compressive strength using experimentally acquired datasets. Our choice of LSSVM-CSA and GP as learning algorithms stems from their high prediction accuracy, successful deployment, and promising results recorded by many researchers [43], [44], [45], [46], [47], [48], [49], [50]. The parameters used in training the models include cement, water, coarse aggregate, fine aggregate, blast furnace slag, fly ash and superplasticizer, curing age as inputs, and compressive strength as output. In addition, the developed models were evaluated using statistical parameters such as the coefficient of determination (R2), root mean square error (RMSE), average relative deviation (ARD), and absolute average relative deviation (AARD) for the training and test datasets.

Section snippets

Genetic programming

Genetic programming (GP) is an example of Alan Turing's evolutionary algorithm in 1950 [51] and was developed by Koza [52], [53]. This method is closely related to the genetic algorithm developed based on the Darwinian natural selection principle [54], [55] and represents a symbolic regression model. GP and its other forms have been successfully applied to various research problems, including concrete formulation and design [43], [45], [46], [55], [56], [57], [58], [59]. The GP uses a heuristic

Data Description, data manipulation, and feature selection

The 1030 datasets for 17 studies used in constructing the data-driven model are the long-term compressive strength of ternary-blend concrete experimental data retrieved from the University of California dataset repository, Irvine [78], [79]. It is important to note that the compressive strength tests were conducted on cubic concrete specimens (150 mm) according to the laid-down requirements of ASTM C39 [80]. In the experimental study, the effects of a blend of cement, blast furnace slag, fly

Sensitivity analysis

The sensitivity of the LSSVM-CSA and GP models to all the independent variables used to develop the linear/nonlinear relationship between the input and output datasets was analyzed. The results are presented in Fig. 3. In other words, it may provide insight into the impact of input variables on the output variable [91]. A sensitivity analysis was performed to assess the effect of concrete mixture parameters (input variables) on the concrete compressive strength (target variable) using the

Conclusion

The objective of this study was to comparatively explore the predictive performance of LSSVM-CSA and GP in estimating the compressive strength of ternary-blend concrete using features from the datasets. The 1030 datasets used were retrieved from an experimental work kept in the UCI Machine Learning Repository (http://archive.ics.uci.edu/ml/). In this study, two data-driven machine learning models were developed and compared to optimize their prediction accuracy for concrete compressive strength

CRediT authorship contribution statement

Babatunde Abiodun Salami: Conceptualization, Methodology, Software, Investigation, Data Curation, Writing – original draft preparation, Writing – review & eiting, Visualization, Supervision, Project administration. Teslim Olayiwola: Methodology, Software, Validation, Resources, Writing – review & eiting, Validation. Tajudeen Adeyinka Oyehan: Resources, Project administration, Software, Writing – review & eiting. Ishaq A. Raji: Project administration, Writing – review & eiting.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgement

The authors gratefully acknowledge the support provided by the Center for Engineering Research, Research Institute, King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia, for the reported work.

References (98)

  • M.A. DeRousseau et al.

    Computational design optimization of concrete mixtures: A review

    Cem. Concr. Res.

    (2018)
  • J. Zhang et al.

    Multi-objective optimization of concrete mixture proportions using machine learning and metaheuristic algorithms

    Constr. Build. Mater.

    (2020)
  • M. Azimi-Pour et al.

    Linear and nonlinear SVM prediction for fresh properties and compressive strength of high volume fly ash self-compacting concrete

    Constr. Build. Mater.

    (2020)
  • E. Gomaa et al.

    Machine learning to predict properties of fresh and hardened alkali-activated concrete

    Cem. Concr. Compos.

    (2021)
  • T.-D. Nguyen et al.

    prediction of interface yield stress and plastic viscosity of fresh concrete using a hybrid machine learning approach

    Adv. Eng. Inf.

    (2020)
  • M. Sonebi et al.

    Modelling the fresh properties of self-compacting concrete using support vector machine approach

    Constr. Build. Mater.

    (2016)
  • Z.M. Yaseen et al.

    Predicting compressive strength of lightweight foamed concrete using extreme learning machine model

    Adv. Eng. Softw.

    (2018)
  • U.M. Angst

    Predicting the time to corrosion initiation in reinforced concrete structures exposed to chlorides

    Cem. Concr. Res.

    (2019)
  • O.A. Hodhod et al.

    Modeling the corrosion initiation time of slag concrete using the artificial neural network

    HBRC J.

    (2014)
  • G. Jiang et al.

    Predicting concrete corrosion of sewers using artificial neural network

    Water Res.

    (2016)
  • H.I. Erdal et al.

    High performance concrete compressive strength forecasting using ensemble models based on discrete wavelet transform

    Eng. Appl. Artif. Intell.

    (2013)
  • A. Rostami et al.

    Toward genetic programming (GP) approach for estimation of hydrocarbon/water interfacial tension

    J. Mol. Liq.

    (2017)
  • D. Abooali et al.

    A new empirical model for estimation of crude oil/brine interfacial tension using genetic programming approach

    J. Petrol. Sci. Eng.

    (2019)
  • H. Esmaeili et al.

    A simple correlation to predict surface tension of binary mixtures containing ionic liquids

    J. Mol. Liq.

    (2021)
  • S. Mahmoodpour et al.

    Prediction of Cementation Factor for Low-Permeability Iranian Carbonate Reservoirs Using Particle Swarm Optimization-Artificial Neural Network Model and Genetic Programming Algorithm

    J. Petrol. Sci. Eng.

    (2021)
  • S. Esmaeili et al.

    A data-driven model for predicting the effect of temperature on oil-water relative permeability

    Fuel

    (2019)
  • T. Olayiwola et al.

    Modeling the acentric factor of binary and ternary mixtures of ionic liquids using advanced intelligent systems

    Fluid Phase Equilib.

    (2020)
  • M. Seyyedattar et al.

    Determination of bubble point pressure and oil formation volume factor: Extra trees compared with LSSVM-CSA hybrid and ANFIS models

    Fuel

    (2020)
  • M. Izadmehr et al.

    New correlations for predicting pure and impure natural gas viscosity

    J. Nat. Gas Sci. Eng.

    (2016)
  • M. Sarıdemir

    Genetic programming approach for prediction of compressive strength of concretes containing rice husk ash

    Constr. Build. Mater.

    (2010)
  • F. Yusuf et al.

    Application of Artificial Intelligence-based predictive methods in Ionic liquid studies: A review

    Fluid Phase Equilib.

    (2021)
  • S.M. Mirabdolazimi et al.

    Rutting depth prediction of hot mix asphalts modified with forta fiber using artificial neural networks and genetic programming technique

    Constr. Build. Mater.

    (2017)
  • M. Velay-Lizancos et al.

    Analytical and genetic programming model of compressive strength of eco concretes by NDT according to curing temperature

    Constr. Build. Mater.

    (2017)
  • A.F. Ashour et al.

    Empirical modelling of shear strength of RC deep beams by genetic programming

    Comput. Struct.

    (2003)
  • J. Cervantes et al.

    A comprehensive survey on support vector machine classification: Applications, challenges and trends

    Neurocomputing

    (2020)
  • A. Al-Anazi et al.

    A support vector machine algorithm to classify lithofacies and model permeability in heterogeneous reservoirs

    Eng. Geol.

    (2010)
  • J.A.K. Suykens et al.

    Weighted least squares support vector machines: robustness and sparse approximation

    Neurocomputing

    (2002)
  • M.-Y. Cheng et al.

    High-performance concrete compressive strength prediction using time-weighted evolutionary fuzzy support vector machines inference model

    Autom. Constr.

    (2012)
  • M.R. Kaloop et al.

    Compressive strength prediction of high-performance concrete using gradient tree boosting machine

    Constr. Build. Mater.

    (2020)
  • N. Nabipour et al.

    Evolving LSSVM and ELM models to predict solubility of non-hydrocarbon gases in aqueous electrolyte systems

    Measurement

    (2020)
  • M.H. Ahmadi et al.

    Connectionist intelligent model estimates output power and torque of stirling engine

    Renew. Sustain. Energy Rev.

    (2015)
  • C.-M. Vong et al.

    prediction of automotive engine power and torque using least squares support vector machines and Bayesian inference

    Eng. Appl. Artif. Intell.

    (2006)
  • P. Samui et al.

    Utilization of a least square support vector machine (LSSVM) for slope stability analysis

    Sci. Iran.

    (2011)
  • X. Ding et al.

    Dataset of long-term compressive strength of concrete with manufactured sand

    Data Brief.

    (2016)
  • X. Ding et al.

    Experimental study on long-term compressive strength of concrete with manufactured sand

    Constr. Build. Mater.

    (2016)
  • M. Sumer

    Compressive strength and sulfate resistance properties of concretes containing Class F and Class C fly ashes

    Constr. Build. Mater.

    (2012)
  • R. Siddique

    Performance characteristics of high-volume Class F fly ash concrete

    Cem. Concr. Res.

    (2004)
  • A.R. Boğa et al.

    Influence of fly ash on corrosion resistance and chloride ion permeability of concrete

    Constr. Build. Mater.

    (2012)
  • B.A. Salami et al.

    Impact of added water and superplasticizer on early compressive strength of selected mixtures of palm oil fuel ash-based engineered geopolymer composites

    Constr. Build. Mater.

    (2016)
  • Cited by (45)

    View all citing articles on Scopus
    View full text