Abstract
There is growing interest in on-line evolution forautonomous robots. On-line learningis critical to achieve high levels of autonomy in the face of dynamic environments, tasks, and other variable elements encountered in real world environments. Although a number of successes have been achieved with on-line evolution, these successes are largely limited to fairly simple learning paradigms, e.g. training small neural networks of relatively few weights and in simulated environments. The shortage of more complex learning paradigms is largely due to the limitations of affordable robotic platforms, which tend to be woefully underpowered for such applications.
In this paper we introduce a simple robotics platform based on Commodity Off The Shelf (COTS) designprinciples that makes on-line genetic programming for robotics practical and affordable. We compare the relative strengths and weaknesses of a number of different build options. As a proof-of-concept we compare three variations of evolutionary learning models for a color-following problem on a robot based on one of the designs: a simple neural network learning framework of the type typically seen in current research, a more extensive learning model that could not be supported by traditional low-cost research robots, and a simple evolutionary algorithm, but using standard tree-based genetic programming representation, which is also beyond the scope of traditional low-cost research robots. Our results show that the more powerful evolutionary models enabled by more powerful robots significantly improves the on-line evolutionary performance and thus that there are practical benefits to the COTS based
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
We refer to this as a sleep phase because it does have certain parallels to human sleep. It has been conclusively shown that sleep is an important part of learning and memory. In much the same way the sleep phase described here gives the robot additional time to learn from its training data.
References
Bergbreiter S, Pister K (2003) Cotsbots: An off-the-shelf platform for distributed robotics. In: Intelligent Robots and Systems, 2003.(IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, IEEE, vol 2, pp 1632–1637
Capi G, Toda H (2010) Evolution of neural controllers for robot navigation in human environments. Journal of Computer Science 6(8):837–843
Clune J, Beckmann B, Ofria C, Pennock R (2009) Evolving coordinated quadruped gaits with the hyperneat generative encoding. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 2764–2771
Council NI (2008) Disruptive civil technologies: Six technologies with potential impacts on u.s. interests out to 2025
Drchal J, Koutník J, Snorek M (2009) Hyperneat controlled robots learn how to drive on roads in simulated environment. In: Evolutionary Computation, 2009. CEC’09. IEEE Congress on, IEEE, pp 1087–1092
Floreano D, Nolfi S (1997) God save the red queen! competition in co-evolutionary robotics. Genetic programming 1997
Haasdijk E, Atta-ul Qayyum A, Eiben A (2011) Racing to improve on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 187–194
Hinchey M, Sterritt R, Rouff C (2007) Swarms and swarm intelligence. Computer 40(4):111–113
Kakalis N, Ventikos Y (2008) Robotic swarm concept for efficient oil spill confrontation. Journal of hazardous materials 154(1–3):880–887
Karafotias G, Haasdijk E, Eiben A, Haasdijk E, Eiben A, Winfield A, Haasdijk E, Rusu A, Eiben A, Eiben A, et al (2011) An algorithm for distributed on-line, on-board evolutionary robotics. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, pp 171–178
Mondada F, Floreano D, Guignard A, Deneubourg J, Gambardella L, Nolfi S, Dorigo M (2002) Search for rescue: an application for the swarm-bot self-assembling robot concept. Tech. rep., Citeseer
Mondada F, Bonani M, Raemy X, Pugh J, Cianci C, Klaptocz A, Magnenat S, Zufferey J, Floreano D, Martinoli A (2009) The e-puck, a robot designed for education in engineering. In: Proceedings of the 9th conference on autonomous robot systems and competitions, vol 1, pp 59–65
Mullen R, Barman S, Remagnino P, Monekosso D (2011) Towards autonomous robot swarms for multi-target localisation and monitoring with applications to counter ied operations. International Journal of Intelligent Defence Support Systems 4(1):87–107
Nolfi S (2012) Co-evolving predator and prey robots. Adaptive Behavior 20(1):10–15
Russell S, Norvig P (2010) Artificial intelligence: a modern approach. Prentice hall
Sathyanath S, Sahin F (2002) Application of artificial immune system based intelligent multi agent model to a mine detection problem. In: Systems, Man and Cybernetics, 2002 IEEE International Conference on, IEEE, vol 3, pp 6–pp
Schlachter F, Schwarzer C, Kernbach S, Michiels N, Levi P (2010) Incremental online evolution and adaptation of neural networks for robot control in dynamic environments. In: ADAPTIVE 2010, The Second International Conference on Adaptive and Self-Adaptive Systems and Applications, pp 111–116
Soule T, Heckendorn R (2011) Cotsbots: computationally powerful, low-cost robots for computer science curriculums. Journal of Computing Sciences in Colleges 27(1):180–187
Talaga P, Oh J.C (2009) Combining aima and lego mindstorms in an artificial intelligence course to build real world robots. Journal of Computing Sciences in Colleges 24(3):56–64
Zarzhitsky D, Spears D, Spears W (2005) Swarms for chemical plume tracing. In: Swarm Intelligence Symposium, 2005. SIS 2005. Proceedings 2005 IEEE, IEEE, pp 249–256
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this chapter
Cite this chapter
Soule, T., Heckendorn, R.B. (2013). A Practical Platform for On-Line Genetic Programming for Robotics. In: Riolo, R., Vladislavleva, E., Ritchie, M., Moore, J. (eds) Genetic Programming Theory and Practice X. Genetic and Evolutionary Computation. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6846-2_2
Download citation
DOI: https://doi.org/10.1007/978-1-4614-6846-2_2
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-6845-5
Online ISBN: 978-1-4614-6846-2
eBook Packages: Computer ScienceComputer Science (R0)