Abstract
In this paper we present a novel algorithm called GPAT (Genetic Programming of Augmenting Topologies) which evolves Genetic Programming (GP) trees in a similar way as a well-established neuro-evolutionary algorithm NEAT (NeuroEvolution of Augmenting Topologies) does. The evolution starts from a minimal form and gradually adds structure as needed. A niching evolutionary algorithm is used to protect individuals of a variable complexity in a single population. Although GPAT is a general approach we employ it mainly to evolve artificial neural networks by means of Hypercube-based indirect encoding which is an approach allowing for evolution of large-scale neural networks having theoretically unlimited size. We perform also experiments for directly encoded problems. The results show that GPAT outperforms both GP and NEAT taking the best of both.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Eggenberger-Hotz, P.: Creation of Neural Networks Based on Developmental and Evolutionary Principles. In: Gerstner, W., Hasler, M., Germond, A., Nicoud, J.-D. (eds.) ICANN 1997. LNCS, vol. 1327, pp. 337–342. Springer, Heidelberg (1997)
Gruau, F.: Neural Network Synthesis Using Cellular Encoding and the Genetic Algorithm. PhD thesis, Ecole Normale Supirieure de Lyon, France (1994)
Koutnik, J., Gomez, F., Schmidhuber, J.: Evolving Neural Networks in Compressed Weight Space. In: Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation - GECCO 2010, p. 619. ACM Press, New York (2010)
Gauci, J., Stanley, K.O.: Generating Large-Scale Neural Networks Through Discovering Geometric Regularities. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation - GECCO 2007, pp. 997–1004. ACM Press, New York (2007)
Buk, Z., Koutník, J., Šnorek, M.: NEAT in HyperNEAT Substituted with Genetic Programming. In: Kolehmainen, M., Toivanen, P., Beliczynski, B. (eds.) ICANNGA 2009. LNCS, vol. 5495, pp. 243–252. Springer, Heidelberg (2009)
Stanley, K.O.: Efficient Evolution of Neural Networks through Complexification. PhD thesis, The University of Texas at Austin (2004)
Mahfoud, S.W.: A Comparison of Parallel and Sequential Niching Methods. In: Proceedings of the Sixth International Conference on Genetic Algorithms, pp. 136–143. Morgan Kaufmann (1995)
Poli, R., Langdon, W.B., Mcphee, N.F.: A Field Guide to Genetic Programming (March 2008), Published via http://lulu.com
Yao, X., Yong, L., Guangming, L.: Evolutionary Programming Made Faster. IEEE Transactions on Evolutionary Computation 3, 82–102 (1999)
Ekárt, A., Németh, S.Z.: A Metric for Genetic Programs and Fitness Sharing. In: Poli, R., Banzhaf, W., Langdon, W.B., Miller, J., Nordin, P., Fogarty, T.C. (eds.) EuroGP 2000. LNCS, vol. 1802, pp. 259–270. Springer, Heidelberg (2000)
Clune, J., Stanley, K.O., Pennock, R.T., Ofria, C.: On the Performance of Indirect Encoding Across the Continuum of Regularity. IEEE Transaction on Evolutionary Computation 15(3), 346–367 (2011)
Drchal, J., Koutnik, J., Snorek, M.: HyperNEAT Controlled Robots Learn How to Drive on Roads in Simulated Environment. In: CEC 2009 Proceedings of the Eleventh Conference on Congress on Evolutionary Computation, Trondheim, pp. 1087–1092. IEEE Press (2009)
Igel, C., Chellapilla, K.: Investigating the Influence of Depth and Degree of Genotypic Change on Fitness in Genetic Programming. In: Proceedings of the Genetic and Evolutionary Computation Conference, Orlando, FL, USA, pp. 1061–1068. Morgan Kaufmann (1999)
Nguyen, T.H., Nguyen, X.H.: A Brief Overview of Population Diversity Measures in Genetic Programming. In: Proceedings of the Third Asian Pacific Workshop on Genetic Programming, pp. 128–139 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Drchal, J., Šnorek, M. (2013). Genetic Programming of Augmenting Topologies for Hypercube-Based Indirect Encoding of Artificial Neural Networks. In: Snášel, V., Abraham, A., Corchado, E. (eds) Soft Computing Models in Industrial and Environmental Applications. Advances in Intelligent Systems and Computing, vol 188. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32922-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-32922-7_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32921-0
Online ISBN: 978-3-642-32922-7
eBook Packages: EngineeringEngineering (R0)