Skip to main content

Particularity

  • Chapter
  • First Online:
Genetic Programming Theory and Practice XX

Part of the book series: Genetic and Evolutionary Computation ((GEVO))

Abstract

We describe a design principle for adaptive systems under which adaptation is driven by particular challenges that the environment poses, as opposed to average or otherwise aggregated measures of performance over many challenges. We trace the development of this “particularity” approach from the use of lexicase selection in genetic programming to “particularist” approaches to other forms of machine learning and to the design of adaptive systems more generally.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    This lexicographic processing of fitness cases is the reason that lexicase selection is so named.

References

  1. Aenugu, S., Spector, L.: Lexicase selection in learning classifier systems. In: GECCO ’19: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 356–364. ACM, Prague, Czech Republic (2019)

    Google Scholar 

  2. Boldi, R., Bao, A., Briesch, M., Helmuth, T., Sobania, D., Spector, L., Lalejini, A.: Analyzing the interaction between down-sampling and selection (2023). arXiv:2304.07089

  3. Boldi, R., Briesch, M., Sobania, D., Lalejini, A., Helmuth, T., Rothlauf, F., Ofria, C., Spector, L.: Informed down-sampled lexicase selection: Identifying productive training cases for efficient problem solving (2023). https://doi.org/10.48550/arxiv.2301.01488, arXiv:2301.01488

  4. Boldi, R., Helmuth, T., Spector, L.: The environmental discontinuity hypothesis for down-sampled lexicase selection. In: 2022 Conference on Artificial Life—Why it Didn’t Work-Shop (2022)

    Google Scholar 

  5. Boldi, R., Lalejini, A., Helmuth, T., Spector, L.: A static analysis of informed down-samples. In: Genetic and Evolutionary Computation Conference Companion (GECCO ‘23 Companion), July 15–19, 2023, Lisbon, Portugal (2023)

    Google Scholar 

  6. Boldi, R., Lokhandwala, A., Annatone, E., Schechter, Y., Lavrenenko, A., Sigrist, C.: Improving recommendation system serendipity through lexicase selection (2023). arxiv:2305.11044

  7. Boldi, R., Spector, L.: Can the problem-solving benefits of quality diversity be obtained without explicit diversity maintenance?. In: Genetic and Evolutionary Computation Conference Companion (GECCO ‘23 Companion), Lisbon, Portugal (2023)

    Google Scholar 

  8. Ding, L., Boldi, R., Helmuth, T., Spector, L.: Going faster and hence further with lexicase selection. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 538–541 (2022)

    Google Scholar 

  9. Ding, L., Boldi, R., Helmuth, T., Spector, L.: Lexicase selection at scale. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 2054–2062 (2022)

    Google Scholar 

  10. Ding, L., Pantridge, E., Spector, L.: Probabilistic lexicase selection. In: GECCO ’23: Proceedings of the Genetic and Evolutionary Computation Conference. ACM (2023). arxiv:2305.11681

  11. Ding, L., Spector, L.: Optimizing neural networks with gradient lexicase selection. In: International Conference on Learning Representations (2022)

    Google Scholar 

  12. Dolson, E.: Calculating lexicase selection probabilities is NP-Hard (2023). https://doi.org/10.48550/arXiv.2301.06724, arXiv:2301.06724

  13. Fraebel, D.T., Gowda, K., Mani, M., Kuehn, S.: Evolution of generalists by phenotypic plasticity. Isc.23(11), 101678 (2020). https://doi.org/10.1016/j.isci.2020.101678

  14. Helmuth, T., Kelly, P.: PSB2: The second program synthesis benchmark suite. In: Proceedings of the 2021 Genetic and Evolutionary Computation Conference. GECCO ’21, Association for Computing Machinery, Internet (July 10–14 2021), Nominated for Best Paper, pp. 785–794

    Google Scholar 

  15. Helmuth T, Kelly P (2022) Applying genetic programming to PSB2: the next generation program synthesis benchmark suite. Genet. Program. Evolvable Mach. 23(3):375–404

    Article  Google Scholar 

  16. Helmuth, T., McPhee, N.F., Spector, L.: Lexicase selection for program synthesis: a diversity analysis. In: Riolo, R., Worzel, W.P., Kotanchek, M., Kordon, A. (eds.) Genetic Programming Theory and Practice XIII. Genetic and Evolutionary Computation, pp. 151–167. Springer, Ann Arbor, USA (2015)

    Google Scholar 

  17. Helmuth, T., McPhee, N.F., Spector, L.: Effects of lexicase and tournament selection on diversity recovery and maintenance. In: GECCO ’16 Companion: Proceedings of the Companion Publication of the 2016 Annual Conference on Genetic and Evolutionary Computation, pp. 983–990. ACM, Denver, Colorado, USA (2016)

    Google Scholar 

  18. Helmuth, T., Pantridge, E., Spector, L.: On the importance of specialists for lexicase selection. Genet. Program. Evolvable Mach. 21(3), 349–373 (2020). Special Issue: Highlights of Genetic Programming 2019 Events

    Google Scholar 

  19. Helmuth, T., Spector, L.: Evolving a digital multiplier with the PushGP genetic programming system. In: GECCO ’13 Companion: Proceeding of the Fifteenth Annual Conference Companion on Genetic and Evolutionary Computation Conference Companion, pp. 1627–1634. ACM, Amsterdam, The Netherlands (2013)

    Google Scholar 

  20. Helmuth, T., Spector, L.: General program synthesis benchmark suite. In: GECCO ’15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation. pp. 1039–1046. ACM, Madrid, Spain (2015)

    Google Scholar 

  21. Helmuth, T., Spector, L.: General program synthesis benchmark suite. In: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation. pp. 1039–1046 (2015)

    Google Scholar 

  22. Helmuth T, Spector L (2022) Problem-solving benefits of down-sampled lexicase selection. Artif. Life 27(3–4):183–203 Mar

    Article  Google Scholar 

  23. Helmuth T, Spector L, Matheson J (2015) Solving uncompromising problems with lexicase selection. IEEE Trans. Evol. Comput. 19(5):630–643 Oct

    Article  Google Scholar 

  24. Helmuth, T.M.: General program synthesis from examples using genetic programming with parent selection based on random lexicographic orderings of test cases. Ph.D. thesis, College of Information and Computer Sciences, University of Massachusetts Amherst, USA (2015)

    Google Scholar 

  25. Hernandez, J.G., Lalejini, A., Dolson, E., Ofria, C.: Random subsampling improves performance in lexicase selection. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 2028–2031. ACM, Prague Czech Republic (2019)

    Google Scholar 

  26. Kassen R (2002) The experimental evolution of specialists, generalists, and the maintenance of diversity. J. Evol. Biol. 15(2):173–190

    Article  Google Scholar 

  27. Koza JR (1992) Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA

    Google Scholar 

  28. Krawiec, K., Lichocki, P.: Using co-solvability to model and exploit synergetic effects in evolution. In: Schaefer, R., Cotta, C., Kolodziej, J., Rudolph, G. (eds.) PPSN 2010 11th International Conference on Parallel Problem Solving From Nature. Lecture Notes in Computer Science, vol. 6239, pp. 492–501. Springer, Krakow, Poland (2010)

    Google Scholar 

  29. La Cava, W., Helmuth, T., Spector, L., Moore, J.H.: A probabilistic and multi-objective analysis of lexicase selection and epsilon-lexicase selection. Evol. Comput. 27(3), 377–402 (Fall 2019)

    Google Scholar 

  30. La Cava, W., Spector, L., Danai, K.: Epsilon-lexicase selection for regression. In: Friedrich, T. (ed.) GECCO ’16: Proceedings of the 2016 Annual Conference on Genetic and Evolutionary Computation, pp. 741–748. ACM, Denver, USA (2016)

    Google Scholar 

  31. McKay, R.I.B.: Fitness sharing in genetic programming. In: Whitley, D., Goldberg, D., Cantu-Paz, E., Spector, L., Parmee, I., Beyer, H.G. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2000), pp. 435–442. Morgan Kaufmann, Las Vegas, Nevada, USA (2000)

    Google Scholar 

  32. Metevier, B., Saini, A.K., Spector, L.: Lexicase selection beyond genetic programming. In: Banzhaf, W., Spector, L., Sheneman, L. (eds.) Genetic Programming Theory and Practice XVI, pp. 123–136. Springer, Ann Arbor, USA (2018)

    Google Scholar 

  33. Mouret, J.B., Clune, J.: Illuminating search spaces by mapping elites (2015). arXiv:1504.04909 [cs, q-bio]

  34. Orzechowski, P., La Cava, W., Moore, J.H.: Where are we now? a large benchmark study of recent symbolic regression methods. CoRR (2018). arxiv:1804.09331

  35. Pugh, J.K., Soros, L.B., Stanley, K.O.: Quality Diversity: A new frontier for evolutionary computation. Front. Robot. AI 3 (2016). https://doi.org/10.3389/frobt.2016.00040, http://journal.frontiersin.org/Article/10.3389/frobt.2016.00040/abstract

  36. Sachdeva V, Husain K, Sheng J, Murugan A (2020) Tuning environmental timescales to evolve and maintain generalists. PNAS 117(23):12693–12699. https://doi.org/10.1073/pnas.1914586117

    Article  Google Scholar 

  37. Spector, L.: Assessment of problem modality by differential performance of lexicase selection in genetic programming: a preliminary report. In: McClymont, K., Keedwell, E. (eds.) 1st workshop on Understanding Problems (GECCO-UP), pp. 401–408. ACM (2012)

    Google Scholar 

  38. Spector, L., La Cava, W., Shanabrook, S., Helmuth, T., Pantridge, E.: Relaxations of lexicase parent selection. In: Banzhaf, W., Olson, R.S., Tozier, W., Riolo, R. (eds.) Genetic Programming Theory and Practice XV. Genetic and Evolutionary Computation, pp. 105–120. Springer, University of Michigan in Ann Arbor, USA (2017)

    Google Scholar 

  39. Tetteh, M., Dias, D.M., Ryan, C.: Evolution of complex combinational logic circuits using grammatical evolution with SystemVerilog. In: Hu, T., Lourenco, N., Medvet, E. (eds.) EuroGP 2021: Proceedings of the 24th European Conference on Genetic Programming, LNCS, vol. 12691, pp. 146–161. Springer Verlag, Virtual Event (2021)

    Google Scholar 

  40. Troise, S.A., Helmuth, T.: Lexicase selection with weighted shuffle. In: Genetic Programming Theory and Practice XV, pp. 89–104. Springer (2018)

    Google Scholar 

Download references

Acknowledgements

We thank Bill Tozier, Anil Saini, Eddie Pantridge, Andrew Ni, Nic McPheee, Tom Helmuth, Ramita Dhamrongsirivadh, and other members of the Amherst College PUSH lab for stimulating conversations that helped us to develop the ideas described in this paper. We also thank participants in the 2023 Genetic Programming Theory and Practice workshop, and particularly Alex Lalejini, Erik Hemberg, and Joel Lehman, who commented on a draft. This material is based upon work supported by the National Science Foundation under Grant No. 2117377. Any opinions, findings, and conclusions or recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the National Science Foundation. This work was also performed in part using high-performance computing equipment obtained under a grant from the Collaborative R &D Fund managed by the Massachusetts Technology Collaborative.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lee Spector .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Spector, L., Ding, L., Boldi, R. (2024). Particularity. In: Winkler, S., Trujillo, L., Ofria, C., Hu, T. (eds) Genetic Programming Theory and Practice XX. Genetic and Evolutionary Computation. Springer, Singapore. https://doi.org/10.1007/978-981-99-8413-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8413-8_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8412-1

  • Online ISBN: 978-981-99-8413-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics