Skip to main content

FlexGP.py: Prototyping Flexibly-Scaled, Flexibly-Factored Genetic Programming for the Cloud

  • Chapter
  • First Online:
Genetic Programming Theory and Practice X

Abstract

Running genetic programming on the cloud presents researchers with great opportunities and challenges. We argue that standard island algorithms do not have the properties of elasticity and robustness required to run well on the cloud. We present a prototyped design for a decentralized, heterogeneous, robust, self-scaling, self-factoring, self-aggregating genetic programming algorithm. We investigate its properties using a software “sandbox”.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Arenas M, Collet P, Eiben A, Jelasity M, Merelo J, Paechter B, Preuß M, Schoenauer M (2002) A framework for distributed evolutionary algorithms. In: Parallel Problem Solving from Nature VII, Springer, pp 665–675

    Google Scholar 

  • Bollobás B (2001) Random Graphs, 2nd edn. Cambridge University Press

    Google Scholar 

  • Cantú-Paz E (1998) A survey of parallel genetic algorithms. Calculateurs Paralleles 10(2)

    Google Scholar 

  • Crainic TG, Toulouse M (2010) Parallel meta-heuristics. In: Handbook of Metaheuristics, Springer, pp 497–541

    Google Scholar 

  • Fazenda P, McDermott J, O’Reilly UM (2012) A library to run evolutionary algorithms in the cloud using MapReduce. In: Di Chio C, Agapitos A, Cagnoni S, Cotta C, Fernandez de Vega F, Di Caro GA, Drechsler R, Ekart A, Esparcia-Alcazar AI, Farooq M, Langdon WB, Merelo JJ, Preuss M, Richter H, Silva S, Simoes A, Squillero G, Tarantino E, Tettamanzi AGB, Togelius J, Urquhart N, Uyar AS, Yannakakis GN (eds) Applications of Evolutionary Computing, EvoApplications2012: EvoCOMNET, EvoCOMPLEX, EvoFIN, EvoGAMES, EvoHOT, EvoIASP, EvoNUM, EvoPAR, EvoRISK, EvoSTIM, EvoSTOC, Springer Verlag, Malaga, Spain, LNCS, vol 7248, pp 416–425, DOI doi:10.1007/978-3-642-29178-4-42

  • Gustafson S, Burke EK (2006) The speciating island model: An alternative parallel evolutionary algorithm. Journal of Parallel and Distributed Computing 66(8):1025–1036, DOI doi:10.1016/j.jpdc.2006.04.017, parallel Bioinspired Algorithms

    Google Scholar 

  • Harper R (2010) Spatial co-evolution in age layered planes (SCALP). In: CEC, IEEE

    Google Scholar 

  • Jelasity M, Preuß M, Van Steen M, Paechter B (2002) Maintaining connectivity in a scalable and robust distributed environment. In: 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, IEEE, pp 389–394

    Google Scholar 

  • Jiménez Laredo J, Lombraña González D, Fernández de Vega F, García Arenas M, Merelo Guervós J (2011) A peer-to-peer approach to genetic programming. In: EuroGP, Springer, pp 108–117

    Google Scholar 

  • Laredo J, Castillo P, Paechter B, Mora A, Alfaro-Cid E, Esparcia-Alcázar A, Merelo J (2007) Empirical validation of a gossiping communication mechanism for parallel EAs. In: Applications of Evolutionary Computing, Springer, pp 129–136

    Google Scholar 

  • Laredo J, Eiben A, van Steen M, Merelo J (2010) EvAg: a scalable peer-to-peer evolutionary algorithm. Genetic Programming and Evolvable Machines 11(2):227–246

    Article  Google Scholar 

  • Lichodzijewski P, Heywood M (2008) Coevolutionary bid-based genetic programming for problem decomposition in classification. Genetic Programming and Evolvable Machines 9(4):331–365

    Article  Google Scholar 

  • Pagie L, Hogeweg P (1997) Evolutionary Consequences of Coevolving Targets. Evolutionary Computation 5:401–418

    Article  Google Scholar 

  • Sherry D, Veeramachaneni K, McDermott J, O’Reilly UM (2011) Flex-GP: Genetic programming on the cloud. In: Di Chio C, Agapitos A, Cagnoni S, Cotta C, Fernandez de Vega F, Di Caro GA, Drechsler R, Ekart A, Esparcia-Alcazar AI, Farooq M, Langdon WB, Merelo JJ, Preuss M, Richter H, Silva S, Simoes A, Squillero G, Tarantino E, Tettamanzi AGB, Togelius J, Urquhart N, Uyar AS, Yannakakis GN (eds) Applications of Evolutionary Computing, EvoApplications 2012: EvoCOMNET, EvoCOMPLEX, EvoFIN, EvoGAMES, EvoHOT, EvoIASP, EvoNUM, EvoPAR, EvoRISK, EvoSTIM, EvoSTOC, Springer Verlag, Malaga, Spain, LNCS, vol 7248, pp 477–486, DOI doi:10.1007/ 978-3-642-29178-4-48

    Google Scholar 

  • Tomassini M (2005) Spatially structured evolutionary algorithms. Springer

    Google Scholar 

Download references

Acknowledgements

We would like to thank GE Global Research for the generous funding of this work. Dr. McDermott acknowledges the support of the Irish Research Council for Science, Engineering and Technology co-funded by Marie Curie.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to James McDermott .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

McDermott, J., Veeramachaneni, K., O’Reilly, UM. (2013). FlexGP.py: Prototyping Flexibly-Scaled, Flexibly-Factored Genetic Programming for the Cloud. In: Riolo, R., Vladislavleva, E., Ritchie, M., Moore, J. (eds) Genetic Programming Theory and Practice X. Genetic and Evolutionary Computation. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6846-2_14

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-6846-2_14

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-6845-5

  • Online ISBN: 978-1-4614-6846-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics