Edgar Galván
Marc Schoenauer
ABSTRACT
The study of semantics in Genetic Programming (GP) has increased dramatically over the last years due to the fact that researchers tend to report a performance increase in GP when semantic diversity is promoted. However, the adoption of semantics in Evolutionary Multi-objective Optimisation (EMO), at large, and in Multi-objective GP (MOGP), in particular, has been very limited and this paper intends to fill this challenging research area. We propose a mechanism wherein a semantic-based distance is used instead of the widely known crowding distance and is also used as an objective to be optimised. To this end, we use two well-known EMO algorithms: NSGA-II and SPEA2. Results on highly unbalanced binary classification tasks indicate that the proposed approach produces more and better results than the rest of the three other approaches used in this work, including the canonical aforementioned EMO algorithms.
- D.J. Newman A. Asuncion. 2007. UCI Machine Learning Repository. (2007). http://www.ics.uci.edu/$\simmlearn/Google Scholar
- L. Beadle and C.G. Johnson. 2008. Semantically driven crossover in genetic programming. In Evolutionary Computation, 2008. CEC 2008. (IEEE World Congress on Computational Intelligence). 111 --116. Google ScholarDigital Library
- U. Bhowan, M. Johnston, M. Zhang, and X. Yao. 2013. Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data. IEEE Transactions on Evolutionary Computation 17, 3 (June 2013), 368--386. Google ScholarDigital Library
- S. Bleuler, M. Brack, L. Thiele, and E. Zitzler. 2001. Multiobjective genetic programming: reducing bloat using SPEA2. In Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546), Vol. 1. 536--543 vol. 1.Google Scholar
- Carlos A. Coello Coello, Gary B. Lamont, and David A. Van Veldhuizen. 2006. Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation). Springer-Verlag New York, Inc., Secaucus, NJ, USA. Google ScholarDigital Library
- Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and T. Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6 (2002), 182--197. Google ScholarDigital Library
- Tiantian Dou and Peter Rockett. 2018. Comparison of semantic-based local search methods for multiobjective genetic programming. Genetic Programming and Evolvable Machines 19, 4 (01 Dec 2018), 535--563. Google ScholarDigital Library
- Stefan Forstenlechner, David Fagan, Miguel Nicolau, and Michael O'Neill. 2018. Towards Effective Semantic Operators for Program Synthesis in Genetic Programming. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '18). ACM, New York, NY, USA, 1119--1126. Google ScholarDigital Library
- E. Galván-López, B. Cody-Kenny, L. Trujillo, and A. Kattan. 2013. Using semantics in the selection mechanism in Genetic Programming: A simple method for promoting semantic diversity. In 2013 IEEE Congress on Evolutionary Computation. 2972--2979.Google Scholar
- Edgar Galván-López, Efrén Mezura-Montes, Ouassim Ait ElHara, and Marc Schoenauer. 2016. On the Use of Semantics in Multi-objective Genetic Programming. In Parallel Problem Solving from Nature - PPSN XIV: 14th International Conference, Edinburgh, UK, September 17--21, 2016, Proceedings, Julia Handl et al. (Eds.). Springer, 353--363.Google Scholar
- Edgar Galván-López, Lucia Vázquez-Mendoza, and Leonardo Trujillo. 2016. Stochastic Semantic-Based Multi-Objective Genetic Programming Optimisation for Classification of Imbalanced Data. In Advances in Soft Computing, Obdulia Pichardo-Lagunas and Sabino Miranda-Jiménez (Eds.). Springer, Chapter 22, 261--272.Google Scholar
- John R. Koza. 1992. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA. Google ScholarDigital Library
- Nicholas Freitag McPhee, Brian Ohs, and Tyler Hutchison. 2008. Semantic building blocks in genetic programming. In Proceedings of the 11th European conference on Genetic programming (EuroGP'08). Springer-Verlag, Berlin, Heidelberg, 134--145. http://dl.acm.org/citation.cfm?id=1792694.1792707 Google ScholarDigital Library
- Alberto Moraglio, Krzysztof Krawiec, and Colin G. Johnson. 2012. Geometric Semantic Genetic Programming. In PPSN (1) (LNCS), Carlos A. Coello Coello, Vincenzo Cutello, Kalyanmoy Deb, Stephanie Forrest, Giuseppe Nicosia, and Mario Pavone (Eds.), Vol. 7491. Springer, 21--31. Google ScholarDigital Library
- Quang Uy Nguyen, Xuan Hoai Nguyen, and Michael O'Neill. 2009. Semantic Aware Crossover for Genetic Programming: The Case for Real-Valued Function Regression. In Proceedings of the 12th European Conference on Genetic Programming (EuroGP '09). Springer-Verlag, Berlin, Heidelberg, 292--302. Google ScholarDigital Library
- T. P. Pawlak, B. Wieloch, and K. Krawiec. 2015. Semantic Backpropagation for Designing Search Operators in Genetic Programming. IEEE Transactions on Evolutionary Computation 19, 3 (June 2015), 326--340.Google ScholarCross Ref
- Riccardo Poli and Edgar Galván-López. 2007. On the Effects of Bit-Wise Neutrality on Fitness Distance Correlation, Phenotypic Mutation Rates and Problem Hardness. In Foundations of Genetic Algorithms, Christopher R. Stephens, Marc Toussaint, Darrell Whitley, and Peter F. Stadler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 138--164. Google ScholarDigital Library
- L. Shao, L. Liu, and X. Li. 2014. Feature Learning for Image Classification Via Multiobjective Genetic Programming. IEEE Transactions on Neural Networks and Learning Systems 25, 7 (July 2014), 1359--1371.Google ScholarCross Ref
- Nguyen Quang Uy, Nguyen Xuan Hoai, Michael O'Neill, R. I. McKay, and Edgar Galván-López. 2011. Semantically-based crossover in genetic programming: application to real-valued symbolic regression. Genetic Programming and Evolvable Machines 12, 2 (2011), 91--119. Google ScholarDigital Library
- Nguyen Quang Uy, Michael O'Neill, Nguyen Xuan Hoai, Bob Mckay, and Edgar Galván-López. 2010. Semantic Similarity Based Crossover in GP: The Case for Real-Valued Function Regression. Springer Berlin Heidelberg, Berlin, Heidelberg, 170--181. Google ScholarDigital Library
- Leonardo Vanneschi, Mauro Castelli, Luca Manzoni, and Sara Silva. 2013. A New Implementation of Geometric Semantic GP and Its Application to Problems in Pharmacokinetics. Springer Berlin Heidelberg, Berlin, Heidelberg, 205--216. Google ScholarDigital Library
- Leonardo Vanneschi, Mauro Castelli, and Sara Silva. 2014. A Survey of Semantic Methods in Genetic Programming. Genetic Programming and Evolvable Machines 15, 2 (June 2014), 195--214. Google ScholarDigital Library
- Huimin Zhao. 2007. A multi-objective genetic programming approach to developing Pareto optimal decision trees. Decision Support Systems 43, 3 (2007), 809 -- 826. Integrated Decision Support. Google ScholarDigital Library
- Eckart Zitzler, Dimo Brockhoff, and Lothar Thiele. 2007. The Hypervolume Indicator Revisited: On the Design of Pareto-compliant Indicators Via Weighted Integration. Springer Berlin Heidelberg, Berlin, Heidelberg, 862--876. Google ScholarDigital Library
- Eckart Zitzler, Marco Laumanns, and Lothar Thiele. 2001. SPEA2: Improving the Strength Pareto Evolutionary Algorithm. Technical Report.Google Scholar
Index Terms
- Promoting semantic diversity in multi-objective genetic programming
Recommendations
Semantics in Multi-objective Genetic Programming
AbstractSemantics has become a key topic of research in Genetic Programming (GP). Semantics refers to the outputs (behaviour) of a GP individual when this is run on a dataset. The majority of works that focus on semantic diversity in single-...
Highlights- Developed a new semantic-distance based approach for Multi-objective GP named SDO.
Highlights of semantics in multi-objective genetic programming
GECCO '22: Proceedings of the Genetic and Evolutionary Computation Conference CompanionSemantics is a growing area of research in Genetic programming (GP) and refers to the behavioural output of a Genetic Programming individual when executed. This research expands upon the current understanding of semantics by proposing a new approach: ...
A Semantic Genetic Programming Approach to Evolving Heuristics for Multi-objective Dynamic Scheduling
AI 2023: Advances in Artificial IntelligenceAbstractMulti-objective dynamic flexible job shop scheduling (MO-DFJSS) is a challenging problem that requires finding high-quality schedules for jobs in a dynamic and flexible manufacturing environment, considering multiple potentially conflicting ...
Comments