Skip to main content

On the Effects of Collaborators Selection and Aggregation in Cooperative Coevolution: An Experimental Analysis

  • Conference paper
  • First Online:
Genetic Programming (EuroGP 2023)

Abstract

Cooperative Coevolution is a way to solve complex optimization problems by dividing them in smaller, simpler sub-problems. Those sub-problems are then tackled concurrently by evolving one population of solutions—actually, components of a larger solution—for each of them. However, components cannot be evaluated in isolation: in the common case of two concurrently evolving populations, each solution of one population must be coupled with another solution of the other population (the collaborator) in order to compute the fitness of the pair. Previous studies have already shown that the way collaborators are chosen and, if more than one is chosen, the way the resulting fitness measures are aggregated, play a key role in determining the success of coevolution. In this paper we perform an experimental analysis aimed at shedding new light on the effects of collaborators selection and aggregation. We first propose a general scheme for cooperative coevolution of two populations that allows to (a) use different EAs and solution representations on the two sub-problems and to (b) set different collaborators selection and aggregation strategies. Second, we instantiate this general scheme in a few variants and apply it to four optimization problems with different degrees of separability: two toy problems and two real prediction problems tackled with different kinds of model (symbolic regression and neural networks). We analyze the outcomes in terms of (a) effectiveness and efficiency of the optimization and (b) complexity and generalization power of the solutions. We find that the degree to which selection and aggregation schemes differ strongly depends on the interaction between the components of the solution.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Our CCEA does not constrain the fitness to be minimized, nor to be a single number; similarly the inner EAs may return many solutions, not just one; we pose here these limitations just for clarity.

References

  1. Gaier, A., Ha, D.: Weight agnostic neural networks. In: Advances in Neural Information Processing Systems, vol. 32 (2019)

    Google Scholar 

  2. La Cava, W., et al.: Contemporary symbolic regression methods and their relative performance. arXiv preprint arXiv:2107.14351 (2021)

  3. Luke, S., Sullivan, K., Abidi, F.: Large scale empirical analysis of cooperative coevolution. In: Proceedings of the 13th Annual Conference Companion on Genetic and Evolutionary Computation, pp. 151–152 (2011)

    Google Scholar 

  4. Ma, X., et al.: A survey on cooperative co-evolutionary algorithms. IEEE Trans. Evol. Comput. 23(3), 421–441 (2018)

    Article  Google Scholar 

  5. Maniadakis, M., Trahanias, P.: Assessing hierarchical cooperative coevolution. In: 19th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2007), vol. 1, pp. 391–398. IEEE (2007)

    Google Scholar 

  6. Medvet, E., Nadizar, G., Manzoni, L.: JGEA: a modular Java framework for experimenting with evolutionary computation. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 2009–2018 (2022)

    Google Scholar 

  7. Moriarty, D.E., Miikkulainen, R.: Forming neural networks through efficient and adaptive coevolution. Evol. Comput. 5(4), 373–399 (1997)

    Article  Google Scholar 

  8. Nadizar, G., Medvet, E., Pellegrino, F.A., Zullich, M., Nichele, S.: On the effects of pruning on evolved neural controllers for soft robots. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1744–1752 (2021)

    Google Scholar 

  9. Nadizar, G., Medvet, E., Ramstad, H.H., Nichele, S., Pellegrino, F.A., Zullich, M.: Merging pruning and neuroevolution: towards robust and efficient controllers for modular soft robots. Knowl. Eng. Rev. 37 (2022)

    Google Scholar 

  10. de Oliveira, F.B., Enayatifar, R., Sadaei, H.J., Guimarães, F.G., Potvin, J.Y.: A cooperative coevolutionary algorithm for the multi-depot vehicle routing problem. Expert Syst. Appl. 43, 117–130 (2016)

    Article  Google Scholar 

  11. Omidvar, M.N., Li, X., Mei, Y., Yao, X.: Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans. Evol. Comput. 18(3), 378–393 (2013)

    Article  Google Scholar 

  12. Panait, L., Luke, S.: A comparative study of two competitive fitness functions. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002), pp. 503–511. Citeseer (2002)

    Google Scholar 

  13. Panait, L., Luke, S., Harrison, J.F.: Archive-based cooperative coevolutionary algorithms. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, pp. 345–352 (2006)

    Google Scholar 

  14. Peng, X., Liu, K., Jin, Y.: A dynamic optimization approach to the design of cooperative co-evolutionary algorithms. Knowl.-Based Syst. 109, 174–186 (2016)

    Article  Google Scholar 

  15. Popovici, E., De Jong, K.A., et al.: A dynamical systems analysis of collaboration methods in cooperative co-evolution. In: AAAI Fall Symposium: Coevolutionary and Coadaptive Systems, pp. 26–34 (2005)

    Google Scholar 

  16. Potter, M.A., De Jong, K.A.: A cooperative coevolutionary approach to function optimization. In: Davidor, Y., Schwefel, H.-P., Männer, R. (eds.) PPSN 1994. LNCS, vol. 866, pp. 249–257. Springer, Heidelberg (1994). https://doi.org/10.1007/3-540-58484-6_269

    Chapter  Google Scholar 

  17. Potter, M.A., Jong, K.A.D.: Cooperative coevolution: an architecture for evolving coadapted subcomponents. Evol. Comput. 8(1), 1–29 (2000)

    Article  Google Scholar 

  18. Tan, K.C., Yang, Y., Goh, C.K.: A distributed cooperative coevolutionary algorithm for multiobjective optimization. IEEE Trans. Evol. Comput. 10(5), 527–549 (2006)

    Article  Google Scholar 

  19. Vanneschi, L., Mauri, G., Valsecchi, A., Cagnoni, S.: Heterogeneous cooperative coevolution: strategies of integration between GP and GA. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, pp. 361–368 (2006)

    Google Scholar 

  20. Virgolin, M., Alderliesten, T., Bosman, P.A.: Linear scaling with and within semantic backpropagation-based genetic programming for symbolic regression. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 1084–1092 (2019)

    Google Scholar 

  21. Wiegand, R.P., Liles, W.C., De Jong, K.A., et al.: An empirical analysis of collaboration methods in cooperative coevolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO), vol. 2611, pp. 1235–1245. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  22. Zullich, M., Medvet, E., Pellegrino, F.A., Ansuini, A.: Speeding-up pruning for artificial neural networks: introducing accelerated iterative magnitude pruning. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 3868–3875. IEEE (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eric Medvet .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nadizar, G., Medvet, E. (2023). On the Effects of Collaborators Selection and Aggregation in Cooperative Coevolution: An Experimental Analysis. In: Pappa, G., Giacobini, M., Vasicek, Z. (eds) Genetic Programming. EuroGP 2023. Lecture Notes in Computer Science, vol 13986. Springer, Cham. https://doi.org/10.1007/978-3-031-29573-7_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-29573-7_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-29572-0

  • Online ISBN: 978-3-031-29573-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics