Research has shown that evolutionary algorithms are a promising approach for training agents in heterogeneous multi-agent systems. However, research in evolving teams (or ensembles) has proven that common evolutionary approaches have subtle, but significant, weaknesses when it comes to balancing member performance and member cooperation. In addition, there are potentially significant scaling problems in applying evolutionary techniques to very large multi-agent systems. It is impractical to train each member of a large system individually, but purely homogeneous teams are inadequate. Previously we proposed Orthogonal Evolution of Teams (OET) as a novel approach to evolving teams that overcomes the weaknesses with balancing member performance and member cooperation. In this paper we test two basic evolutionary techniques and OET on the problem of evolving multi-agent systems, specifically a landscape exploration problem with heterogeneous agents, and examine the ability of the algorithms to evolve teams that are scalable in the number of team members. Our results confirm that the more traditional evolutionary approaches suffer the same weakness with multi-agent systems as they do with teams and that OET does compensate for these weaknesses. In addition, the three algorithms show distinctly different scaling behavior, with OET scaling significantly better than the two more traditional approaches.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cantu-Paz, Erick and Kamath, Chandrika (2003). Inducing oblique decision trees with evolutionary algorithms. IEEE Transactions on Evolutionary Computation, 7(1):54-68.
Haynes, Thomas, Sen, Sandip, Schoenefeld, Dale, and Wainwright, Roger (1995). Evolving a team. In Siegel, Eric V. and Koza, John, editors, Working Notes of the AAAI-95 Fall Symposium on GP, pages 23-30. AAAI Press.
Iba, Hitoshi (1997). Multiple-agent learning for a robot navigation task by genetic programming. In Koza, John R., Deb, Kalyanmoy, Dorigo, Marco, Fogel, David B., Garzon, Max, Iba, Hitoshi, and Riolo, Rick R., editors, Genetic Programming 1997: Proceedings of the Second Annual Conference, pages 195-200. San Francisco, CA: Morgan Kaufmann.
Liu, Yong, Yao, Xin, and Higuchi, Tetsuya (2000). Evolutionary ensembles with negative correlation learning. IEEE Transactions on Evolutionary Computation, 4(4):380-387.
Luke, Sean and Spector, Lee (1996). Evolving teamwork and coordination with genetic programming. In Koza, John R., Goldberg, David E., Fogel, David B., and Riolo, Rick R., editors, Genetic Programming 1996: Proceedings of the First Annual Conference on Genetic Programming, pages 150-156. Cambridge, MA: MIT Press.
Obitz, D. W., Basak, S. C., and Gute, B. D. (1999). Hazard assessment modeling: An evolutionary ensemble approach. In Proceedings of the Genetic and Evolutionary Computation Conference: GECCO-1999, pages 1543-1650. Morgan Kaufmann.
Panait, Liviu and Luke, Sean (2005). Cooperative multi-agent learning: The state of the art. Autonomous Agents and Multi-Agent Systems, 11(3):387-434.
Platel, Michael Defoin, Chami, Malik, Clergue, Manuel, and Collard, Philippe (2005). Teams of genetic predictors for inverse problem solving. In Proceeding of the 8th European Conference on Genetic Programming - EuroGP 2005.
Raik, Simon and Durnota, Bohdan (1994). The evolution of sporting strategies. In Stonier, Russel J. and Yu, Xing Huo, editors, Complex Systems: Mechanisms of Adaption, pages 85-92. IOS Press.
Soule, Terence (1999). Voting teams: A cooperative approach to non-typical problems. In Banzhaf, Wolfgang, Daida, Jason, Eiben, Agoston E., Garzon, Max H., Honavar, Vasant, Jakiela, Mark, and Smith, Robert E., editors, Proceedings of the Genetic and Evolutionary Computation Conference, pages 916-922, Orlando, Florida, USA. Morgan Kaufmann.
Soule, Terence (2003). Cooperative evolution on the intertwined spirals problem. In Genetic Programming: Proceedings of the 6th European Conference on Genetic Programming, EuroGP 2003, pages 434-442. Springer-Verlag.
Soule, Terence and Heckendorn, Robert B. (2007). Evolutionary optimization of cooperative heterogeneous teams. In Evolutionary and Bio-inspired Computation: Theory and Applications, Proceedings of SPIE, volume 6563. International Society for Optical Engineering.
Soule, Terence and Komireddy, Pavankumarreddy (2006). Orthogonal Evolution of Teams: A Class of Algorithms for Evolving Teams with Inversely Correlated Errors. Springer.
Thomason, Russell and Soule, Terence (2007). Novel ways of improving cooperation and performance in ensemble classifiers. In Proceedings of Genetic and Evolutionary Computation Conference (GECCO 2007). Morgan Kaufmann.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Soule, T., Heckendorn, R.B. (2008). Improving Performance and Cooperation in Multi-Agent Systems. In: Riolo, R., Soule, T., Worzel, B. (eds) Genetic Programming Theory and Practice V. Genetic and Evolutionary Computation Series. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-76308-8_13
Download citation
DOI: https://doi.org/10.1007/978-0-387-76308-8_13
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-76307-1
Online ISBN: 978-0-387-76308-8
eBook Packages: Computer ScienceComputer Science (R0)