Abstract
We describe a design principle for adaptive systems under which adaptation is driven by particular challenges that the environment poses, as opposed to average or otherwise aggregated measures of performance over many challenges. We trace the development of this “particularity” approach from the use of lexicase selection in genetic programming to “particularist” approaches to other forms of machine learning and to the design of adaptive systems more generally.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
This lexicographic processing of fitness cases is the reason that lexicase selection is so named.
References
Aenugu, S., Spector, L.: Lexicase selection in learning classifier systems. In: GECCO ’19: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 356–364. ACM, Prague, Czech Republic (2019)
Boldi, R., Bao, A., Briesch, M., Helmuth, T., Sobania, D., Spector, L., Lalejini, A.: Analyzing the interaction between down-sampling and selection (2023). arXiv:2304.07089
Boldi, R., Briesch, M., Sobania, D., Lalejini, A., Helmuth, T., Rothlauf, F., Ofria, C., Spector, L.: Informed down-sampled lexicase selection: Identifying productive training cases for efficient problem solving (2023). https://doi.org/10.48550/arxiv.2301.01488, arXiv:2301.01488
Boldi, R., Helmuth, T., Spector, L.: The environmental discontinuity hypothesis for down-sampled lexicase selection. In: 2022 Conference on Artificial Life—Why it Didn’t Work-Shop (2022)
Boldi, R., Lalejini, A., Helmuth, T., Spector, L.: A static analysis of informed down-samples. In: Genetic and Evolutionary Computation Conference Companion (GECCO ‘23 Companion), July 15–19, 2023, Lisbon, Portugal (2023)
Boldi, R., Lokhandwala, A., Annatone, E., Schechter, Y., Lavrenenko, A., Sigrist, C.: Improving recommendation system serendipity through lexicase selection (2023). arxiv:2305.11044
Boldi, R., Spector, L.: Can the problem-solving benefits of quality diversity be obtained without explicit diversity maintenance?. In: Genetic and Evolutionary Computation Conference Companion (GECCO ‘23 Companion), Lisbon, Portugal (2023)
Ding, L., Boldi, R., Helmuth, T., Spector, L.: Going faster and hence further with lexicase selection. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 538–541 (2022)
Ding, L., Boldi, R., Helmuth, T., Spector, L.: Lexicase selection at scale. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 2054–2062 (2022)
Ding, L., Pantridge, E., Spector, L.: Probabilistic lexicase selection. In: GECCO ’23: Proceedings of the Genetic and Evolutionary Computation Conference. ACM (2023). arxiv:2305.11681
Ding, L., Spector, L.: Optimizing neural networks with gradient lexicase selection. In: International Conference on Learning Representations (2022)
Dolson, E.: Calculating lexicase selection probabilities is NP-Hard (2023). https://doi.org/10.48550/arXiv.2301.06724, arXiv:2301.06724
Fraebel, D.T., Gowda, K., Mani, M., Kuehn, S.: Evolution of generalists by phenotypic plasticity. Isc.23(11), 101678 (2020). https://doi.org/10.1016/j.isci.2020.101678
Helmuth, T., Kelly, P.: PSB2: The second program synthesis benchmark suite. In: Proceedings of the 2021 Genetic and Evolutionary Computation Conference. GECCO ’21, Association for Computing Machinery, Internet (July 10–14 2021), Nominated for Best Paper, pp. 785–794
Helmuth T, Kelly P (2022) Applying genetic programming to PSB2: the next generation program synthesis benchmark suite. Genet. Program. Evolvable Mach. 23(3):375–404
Helmuth, T., McPhee, N.F., Spector, L.: Lexicase selection for program synthesis: a diversity analysis. In: Riolo, R., Worzel, W.P., Kotanchek, M., Kordon, A. (eds.) Genetic Programming Theory and Practice XIII. Genetic and Evolutionary Computation, pp. 151–167. Springer, Ann Arbor, USA (2015)
Helmuth, T., McPhee, N.F., Spector, L.: Effects of lexicase and tournament selection on diversity recovery and maintenance. In: GECCO ’16 Companion: Proceedings of the Companion Publication of the 2016 Annual Conference on Genetic and Evolutionary Computation, pp. 983–990. ACM, Denver, Colorado, USA (2016)
Helmuth, T., Pantridge, E., Spector, L.: On the importance of specialists for lexicase selection. Genet. Program. Evolvable Mach. 21(3), 349–373 (2020). Special Issue: Highlights of Genetic Programming 2019 Events
Helmuth, T., Spector, L.: Evolving a digital multiplier with the PushGP genetic programming system. In: GECCO ’13 Companion: Proceeding of the Fifteenth Annual Conference Companion on Genetic and Evolutionary Computation Conference Companion, pp. 1627–1634. ACM, Amsterdam, The Netherlands (2013)
Helmuth, T., Spector, L.: General program synthesis benchmark suite. In: GECCO ’15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation. pp. 1039–1046. ACM, Madrid, Spain (2015)
Helmuth, T., Spector, L.: General program synthesis benchmark suite. In: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation. pp. 1039–1046 (2015)
Helmuth T, Spector L (2022) Problem-solving benefits of down-sampled lexicase selection. Artif. Life 27(3–4):183–203 Mar
Helmuth T, Spector L, Matheson J (2015) Solving uncompromising problems with lexicase selection. IEEE Trans. Evol. Comput. 19(5):630–643 Oct
Helmuth, T.M.: General program synthesis from examples using genetic programming with parent selection based on random lexicographic orderings of test cases. Ph.D. thesis, College of Information and Computer Sciences, University of Massachusetts Amherst, USA (2015)
Hernandez, J.G., Lalejini, A., Dolson, E., Ofria, C.: Random subsampling improves performance in lexicase selection. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 2028–2031. ACM, Prague Czech Republic (2019)
Kassen R (2002) The experimental evolution of specialists, generalists, and the maintenance of diversity. J. Evol. Biol. 15(2):173–190
Koza JR (1992) Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA
Krawiec, K., Lichocki, P.: Using co-solvability to model and exploit synergetic effects in evolution. In: Schaefer, R., Cotta, C., Kolodziej, J., Rudolph, G. (eds.) PPSN 2010 11th International Conference on Parallel Problem Solving From Nature. Lecture Notes in Computer Science, vol. 6239, pp. 492–501. Springer, Krakow, Poland (2010)
La Cava, W., Helmuth, T., Spector, L., Moore, J.H.: A probabilistic and multi-objective analysis of lexicase selection and epsilon-lexicase selection. Evol. Comput. 27(3), 377–402 (Fall 2019)
La Cava, W., Spector, L., Danai, K.: Epsilon-lexicase selection for regression. In: Friedrich, T. (ed.) GECCO ’16: Proceedings of the 2016 Annual Conference on Genetic and Evolutionary Computation, pp. 741–748. ACM, Denver, USA (2016)
McKay, R.I.B.: Fitness sharing in genetic programming. In: Whitley, D., Goldberg, D., Cantu-Paz, E., Spector, L., Parmee, I., Beyer, H.G. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2000), pp. 435–442. Morgan Kaufmann, Las Vegas, Nevada, USA (2000)
Metevier, B., Saini, A.K., Spector, L.: Lexicase selection beyond genetic programming. In: Banzhaf, W., Spector, L., Sheneman, L. (eds.) Genetic Programming Theory and Practice XVI, pp. 123–136. Springer, Ann Arbor, USA (2018)
Mouret, J.B., Clune, J.: Illuminating search spaces by mapping elites (2015). arXiv:1504.04909 [cs, q-bio]
Orzechowski, P., La Cava, W., Moore, J.H.: Where are we now? a large benchmark study of recent symbolic regression methods. CoRR (2018). arxiv:1804.09331
Pugh, J.K., Soros, L.B., Stanley, K.O.: Quality Diversity: A new frontier for evolutionary computation. Front. Robot. AI 3 (2016). https://doi.org/10.3389/frobt.2016.00040, http://journal.frontiersin.org/Article/10.3389/frobt.2016.00040/abstract
Sachdeva V, Husain K, Sheng J, Murugan A (2020) Tuning environmental timescales to evolve and maintain generalists. PNAS 117(23):12693–12699. https://doi.org/10.1073/pnas.1914586117
Spector, L.: Assessment of problem modality by differential performance of lexicase selection in genetic programming: a preliminary report. In: McClymont, K., Keedwell, E. (eds.) 1st workshop on Understanding Problems (GECCO-UP), pp. 401–408. ACM (2012)
Spector, L., La Cava, W., Shanabrook, S., Helmuth, T., Pantridge, E.: Relaxations of lexicase parent selection. In: Banzhaf, W., Olson, R.S., Tozier, W., Riolo, R. (eds.) Genetic Programming Theory and Practice XV. Genetic and Evolutionary Computation, pp. 105–120. Springer, University of Michigan in Ann Arbor, USA (2017)
Tetteh, M., Dias, D.M., Ryan, C.: Evolution of complex combinational logic circuits using grammatical evolution with SystemVerilog. In: Hu, T., Lourenco, N., Medvet, E. (eds.) EuroGP 2021: Proceedings of the 24th European Conference on Genetic Programming, LNCS, vol. 12691, pp. 146–161. Springer Verlag, Virtual Event (2021)
Troise, S.A., Helmuth, T.: Lexicase selection with weighted shuffle. In: Genetic Programming Theory and Practice XV, pp. 89–104. Springer (2018)
Acknowledgements
We thank Bill Tozier, Anil Saini, Eddie Pantridge, Andrew Ni, Nic McPheee, Tom Helmuth, Ramita Dhamrongsirivadh, and other members of the Amherst College PUSH lab for stimulating conversations that helped us to develop the ideas described in this paper. We also thank participants in the 2023 Genetic Programming Theory and Practice workshop, and particularly Alex Lalejini, Erik Hemberg, and Joel Lehman, who commented on a draft. This material is based upon work supported by the National Science Foundation under Grant No. 2117377. Any opinions, findings, and conclusions or recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the National Science Foundation. This work was also performed in part using high-performance computing equipment obtained under a grant from the Collaborative R &D Fund managed by the Massachusetts Technology Collaborative.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Spector, L., Ding, L., Boldi, R. (2024). Particularity. In: Winkler, S., Trujillo, L., Ofria, C., Hu, T. (eds) Genetic Programming Theory and Practice XX. Genetic and Evolutionary Computation. Springer, Singapore. https://doi.org/10.1007/978-981-99-8413-8_9
Download citation
DOI: https://doi.org/10.1007/978-981-99-8413-8_9
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8412-1
Online ISBN: 978-981-99-8413-8
eBook Packages: Computer ScienceComputer Science (R0)