Abstract
Genetic programming (GP) solves optimization problems by simulating the evolution procedure in nature. It has a serious problem termed as bloat, which can cost memory, hamper effective breeding and slow down the evolution process. However, there are only a limited number of works to quantify bloat directly, and existing techniques use the solution size/complexity as an indirect indicator for bloat control. Therefore, a new bloat quantification measure is designed in this work, based on which three bloat-aware GP methods are proposed. Specifically, the bloat quantification measure is incorporated with two parsimony pressure techniques and a multi-objective technique respectively, termed as GPLTSb (GP Lexicographic Tournament Selection bloat), GPPTSb (GP Proportional Tournament Selection bloat), and MOGPb (Multi-objective GP bloat). Unlike the existing bloat control methods, the bloat-aware methods apply the bloat values directly for bloat control. The proposed methods are tested on benchmark symbolic regression tasks, and are compared with GP, existing bloat control methods and four widely-used regression methods. Results show that MOGPb is effective for bloat control with the solution size reduced obviously; while GPLTSb and GPPTSb can also reduce bloat in GP with the solution size reduced slightly. In addition, compared with GP and existing bloat control methods, the proposed methods evolve solutions with similar/better regression performance. Moreover, the evolved solutions of proposed methods can outperform most reference regression methods for the given tasks consistently.
Similar content being viewed by others
References
Ababsa T, Djedl N, Duthen Y (2018) Genetic programming-based self-reconfiguration planning for metamorphic robot. Int J Autom Comput 15(4):1–12
Asim KM, Idris A, Iqbal T, Martínez-Álvarez F. (2018) Seismic indicators based earthquake predictor system using genetic programming and adaboost classification. Soil Dyn Earthq Eng 111:1–7
Bi Y, Zhang M, Xue B (2018) Genetic programming for automatic global and local feature extraction to image classification. In: 2018 IEEE congress on evolutionary computation (CEC)
Bleuler S, Bader J, Zitzler E (2008) Reducing bloat in GP with multiple objectives. In: Multiobjective problem solving from nature
Gayanov R, Mironov K, Mironov K, Kurennov D (2018) Estimating the trajectory of a thrown object from video signal with use of genetic programming. In: IEEE international symposium on signal processing & information technology
Izadi Rad H, Feng J, Iba H (2018) GP-RVM: Genetic programing-based symbolic regression using relevance vector machine. Available at https://arxiv.org/pdf/1806.02502.pdf
Jong EDD, Pollack JB (2003) Multi-objective methods for tree size control. Genet Program Evolvable Mach 4(3):211–233
Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection, vol. 1. MIT press, Cambridge
Koza JR (1999) Genetic programming III: Darwinian invention and problem solving, vol. 3. Morgan Kaufmann, San Mateo
Koza JR, Keane MA, Streeter MJ, Mydlowec W, Yu J, Lanza G (2006) Genetic programming IV: Routine human-competitive machine intelligence, vol. 5. Springer Science & Business Media, New York
Ktzing T, Lagodzinski JAG, Lengler J, Melnichenko A (2019) Destructiveness of lexicographic parsimony pressure and alleviation by a concatenation crossover in genetic programming. Theor Comput Ence 2018:1–28
Langdon WB, Petke J, Lorenz R (2018) Evolving better rnafold structure prediction. EuroGP 2018:220–236
Liang J, Liu Y, Xue Y (2020) Preference-driven pareto front exploitation for bloat control in genetic programming. Appl Soft Comput 92:1–18
Liang Y, Zhang M, Browne WN (2016) Figure-ground image segmentation using genetic programming and feature selection. In: Evolutionary computation
Liang Y, Zhang M, Browne WN (2017) Figure-ground image segmentation using feature-based multi-objective genetic programming techniques. Neural Comput Applic 31(12):1–20
Liang Y, Zhang M, Browne WN (2017) Genetic programming for evolving figure-ground segmentors from multiple features. Appl Soft Comput 51:83–95
Liang Y, Zhang M, Browne WN (2017) Image feature selection using genetic programming for figure-ground segmentation. Eng Appl Artif Intel 62:96–108
Liang Y, Zhang M, Browne WN (2017) Learning figure-ground image segmentors by genetic programming. In: Genetic & evolutionary computation conference companion, pp 239–240
Luke S, Panait L (2002) Fighting bloat with nonparametric parsimony pressure. In: International conference on parallel problem solving from nature
Luke S, Panait L (2002) Lexicographic parsimony pressure. In: Genetic & evolutionary computation conference
Mcdermott J, White DR, Luke S, Manzoni L, Castelli M, Vanneschi L, Jaśkowski W., Krawiec K, Harper R, Jong KD (2012) Genetic programming needs better benchmarks. In: Fourteenth international conference on genetic & evolutionary computation conference
de Melo VV (2014) Kaizen programming. In: GECCO ’14: Proceedings of the 2014 conference on Genetic and evolutionary computation, pp 895–902
Midkiff S (2011) Encyclopedia of parallel computing. Springer US, Boston, MA, pp 502–508
Morikawa K, Takahashi K, Nagasawa K (2018) Consultation sequencing of a hospital with multiple service points using genetic programming. Eng Optim 50(2):1–15
Poli R, Langdon WB, McPhee NF, Koza JR (2008) A field guide to genetic programming. Available at http://lulu.com and freely available at http://www.gp-field-guide.org.uk
Poli R, Mcphee NF (2014) Parsimony pressure made easy: Solving the problem of bloat in GP. In: Theory and principled methods for the design of metaheuristics, pp 1–24
Sean L The ECJ owner’s manual, a user manual for the ECJ evolutionary computation library. Available at http://cs.gmu.edu/eclab/projects/ecj/
Soule T, Foster JA (1998) Effects of code growth and parsimony pressure on populations in genetic programming. Evol Comput 6(4):293–309
Soule T, Heckendorn RB (2002) An analysis of the causes of code growth in genetic programming. Genet Program Evolvable Mach 3(3):283–309
Turner A, Miller J, Nicolau M, Krawiec K, Heywood MI, Castelli M (2014) Cartesian genetic programming: Why no bloat?. In: Genetic programming. Springer
Vanneschi L, Castelli M, Silva S (2010) Measuring bloat, overfitting and functional complexity in genetic programming. In: Proceedings of the 12th annual conference on genetic and evolutionary computation. ACM, pp 877–884
Veiga RV, Barbosa HJC, Bernardino HS, Freitas JM, Feitosa CA, Matos SMA, Alcântaraneves N. M., Barreto ML (2018) Multiobjective grammar-based genetic programming applied to the study of asthma and allergy epidemiology. BMC Bioinformatics 19(1):245
Wagner M, Neumann F (2014) Single- and multi-objective genetic programming: New runtime results for sorting. In: Evolutionary computation
Witten IH, Frank E, Hall MA, Pal CJ (2016) Data mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Mateo
Zhang C Genetic programming for symbolic regression. Available at https://pdfs.semanticscholar.org/e5ee/ddd04b8344fd4f39a5836be686886c80df13.pdfhttps://pdfs.semanticscholar.org/e5ee/ddd04b8344fd4f39a5836be686886c80df13.pdf
Funding
This study was funded by National Natural Science Foundation of China (grant number 61902281 and 61876089), and by Tianjin Science and Technology Program (grant number 19PTZWHZ00020).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This article does not contain any studies with human participants or animals performed by any of the authors.
Conflict of Interests
Author Jiayu Liang declares that she has no conflict of interest. Author Yu Xue declares that he has no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Liang, J., Xue, Y. Bloat-aware GP-based methods with bloat quantification. Appl Intell 52, 4211–4225 (2022). https://doi.org/10.1007/s10489-021-02245-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-021-02245-1