Skip to main content

A Practical Platform for On-Line Genetic Programming for Robotics

  • Chapter
  • First Online:

Part of the book series: Genetic and Evolutionary Computation ((GEVO))

Abstract

There is growing interest in on-line evolution forautonomous robots. On-line learningis critical to achieve high levels of autonomy in the face of dynamic environments, tasks, and other variable elements encountered in real world environments. Although a number of successes have been achieved with on-line evolution, these successes are largely limited to fairly simple learning paradigms, e.g. training small neural networks of relatively few weights and in simulated environments. The shortage of more complex learning paradigms is largely due to the limitations of affordable robotic platforms, which tend to be woefully underpowered for such applications.

In this paper we introduce a simple robotics platform based on Commodity Off The Shelf (COTS) designprinciples that makes on-line genetic programming for robotics practical and affordable. We compare the relative strengths and weaknesses of a number of different build options. As a proof-of-concept we compare three variations of evolutionary learning models for a color-following problem on a robot based on one of the designs: a simple neural network learning framework of the type typically seen in current research, a more extensive learning model that could not be supported by traditional low-cost research robots, and a simple evolutionary algorithm, but using standard tree-based genetic programming representation, which is also beyond the scope of traditional low-cost research robots. Our results show that the more powerful evolutionary models enabled by more powerful robots significantly improves the on-line evolutionary performance and thus that there are practical benefits to the COTS based

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    We refer to this as a sleep phase because it does have certain parallels to human sleep. It has been conclusively shown that sleep is an important part of learning and memory. In much the same way the sleep phase described here gives the robot additional time to learn from its training data.

References

  • Bergbreiter S, Pister K (2003) Cotsbots: An off-the-shelf platform for distributed robotics. In: Intelligent Robots and Systems, 2003.(IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, IEEE, vol 2, pp 1632–1637

    Google Scholar 

  • Capi G, Toda H (2010) Evolution of neural controllers for robot navigation in human environments. Journal of Computer Science 6(8):837–843

    Article  Google Scholar 

  • Clune J, Beckmann B, Ofria C, Pennock R (2009) Evolving coordinated quadruped gaits with the hyperneat generative encoding. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 2764–2771

    Google Scholar 

  • Council NI (2008) Disruptive civil technologies: Six technologies with potential impacts on u.s. interests out to 2025

    Google Scholar 

  • Drchal J, Koutník J, Snorek M (2009) Hyperneat controlled robots learn how to drive on roads in simulated environment. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 1087–1092

    Google Scholar 

  • Floreano D, Nolfi S (1997) God save the red queen! competition in co-evolutionary robotics. Genetic programming 1997

    Google Scholar 

  • Haasdijk E, Atta-ul Qayyum A, Eiben A (2011) Racing to improve on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 187–194

    Google Scholar 

  • Hinchey M, Sterritt R, Rouff C (2007) Swarms and swarm intelligence. Computer 40(4):111–113

    Article  Google Scholar 

  • Kakalis N, Ventikos Y (2008) Robotic swarm concept for efficient oil spill confrontation. Journal of hazardous materials 154(1–3):880–887

    Article  Google Scholar 

  • Karafotias G, Haasdijk E, Eiben A, Haasdijk E, Eiben A, Winfield A, Haasdijk E, Rusu A, Eiben A, Eiben A, et al (2011) An algorithm for distributed on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 171–178

    Google Scholar 

  • Mondada F, Floreano D, Guignard A, Deneubourg J, Gambardella L, Nolfi S, Dorigo M (2002) Search for rescue: an application for the swarm-bot self-assembling robot concept. Tech. rep., Citeseer

    Google Scholar 

  • Mondada F, Bonani M, Raemy X, Pugh J, Cianci C, Klaptocz A, Magnenat S, Zufferey J, Floreano D, Martinoli A (2009) The e-puck, a robot designed for education in engineering. In: Proceedings of the 9th conference on autonomous robot systems and competitions, vol 1, pp 59–65

    Google Scholar 

  • Mullen R, Barman S, Remagnino P, Monekosso D (2011) Towards autonomous robot swarms for multi-target localisation and monitoring with applications to counter ied operations. International Journal of Intelligent Defence Support Systems 4(1):87–107

    Article  Google Scholar 

  • Nolfi S (2012) Co-evolving predator and prey robots. Adaptive Behavior 20(1):10–15

    Article  Google Scholar 

  • Russell S, Norvig P (2010) Artificial intelligence: a modern approach. Prentice hall

    Google Scholar 

  • Sathyanath S, Sahin F (2002) Application of artificial immune system based intelligent multi agent model to a mine detection problem. In: Systems, Man and Cybernetics, 2002 IEEE International Conference on, IEEE, vol 3, pp 6–pp

    Google Scholar 

  • Schlachter F, Schwarzer C, Kernbach S, Michiels N, Levi P (2010) Incremental online evolution and adaptation of neural networks for robot control in dynamic environments. In: ADAPTIVE 2010, The Second International Conference on Adaptive and Self-Adaptive Systems and Applications, pp 111–116

    Google Scholar 

  • Soule T, Heckendorn R (2011) Cotsbots: computationally powerful, low-cost robots for computer science curriculums. Journal of Computing Sciences in Colleges 27(1):180–187

    Google Scholar 

  • Talaga P, Oh J.C (2009) Combining aima and lego mindstorms in an artificial intelligence course to build real world robots. Journal of Computing Sciences in Colleges 24(3):56–64

    Google Scholar 

  • Zarzhitsky D, Spears D, Spears W (2005) Swarms for chemical plume tracing. In: Swarm Intelligence Symposium, 2005. SIS 2005. Proceedings 2005 IEEE, IEEE, pp 249–256

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Terence Soule .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Soule, T., Heckendorn, R.B. (2013). A Practical Platform for On-Line Genetic Programming for Robotics. In: Riolo, R., Vladislavleva, E., Ritchie, M., Moore, J. (eds) Genetic Programming Theory and Practice X. Genetic and Evolutionary Computation. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6846-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-6846-2_2

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-6845-5

  • Online ISBN: 978-1-4614-6846-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics