Abstract
For empirical research on computer algorithms, it is essential to have a set of benchmark problems on which the relative performance of different methods and their applicability can be assessed. In the majority of computational research fields there are established sets of benchmark problems; however, the field of genetic programming lacks a similarly rigorously defined set of benchmarks. There is a strong interest within the genetic programming community to develop a suite of benchmarks. Following recent surveys [7], the desirable characteristics of a benchmark problem are now better defined. In this paper the Tartarus problem is proposed as a tunably difficult benchmark problem for use in Genetic Programming. The justification for this proposal is presented, together with guidance on its usage as a benchmark.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
http://www.eurathlon.eu. An outdoor robotics challenge for land, sea and air.
References
Korkmaz, E.E., Üçoluk, G.: Design and usage of a new benchmark problem for genetic programming. In: Yazıcı, A., Şener, C. (eds.) ISCIS 2003. LNCS, vol. 2869, pp. 561–567. Springer, Heidelberg (2003)
Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection (1992)
McDermott, J., White, D.R., Luke, S., Manzoni, L., Castelli, M., Vanneschi, L., Jaskowski, W., Krawiec, K., Harper, R., De Jong, K., O’Reilly, U.M.: Genetic programming needs better benchmarks. In: Soule, T., et al. (eds.) Proceedings of the 14th International Conference on Genetic and Evolutionary Computation, GECCO 2012, pp. 791–798 (2012)
Sendhoff, B., Roberts, M., Yao, X.: Evolutionary computation benchmarking repository. IEEE Comput. Intell. Mag. 1, 50–60 (2006)
Teller, A.: The evolution of mental models. In: Kinnear Jr. K.E. (ed.) Advances in Genetic Programming, pp. 199–217 (1994)
Vanneschi, L., Castelli, M., Manzoni, L.: The K landscapes: a tunably difficult benchmark for genetic programming. In: Krasnogor, N., et al. (eds.) Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, GECCO 2011, pp. 1467–1474 (2011)
White, D.R., McDermott, J., Castelli, M., Manzoni, L., Goldman, B.W., Kronberger, G., Jaśkowski, W., O’Reilly, U.M., Luke, S.: Better GP benchmarks: community survey results and proposals. Genet. Program Evolvable Mach. 14(1), 3–29 (2013)
Woodward, J., Martin, S., Swan, J.: Benchmarks that matter for genetic programming. In: Woodward, J., et al. (eds.) 4th Workshop on Evolutionary Computation for the Automated Design of Algorithms, GECCO 2014, pp. 1397–1404 (2014)
Jiju, A.: Design of Experiments for Engineers and Scientists. Elsevier, Amsterdam (2003)
Koza, J.R.: Scalable learning in genetic programming using automatic function definition. In: Kinnear Jr. K.E. (ed.) Advances in Genetic Programming, pp. 99–117 (1994)
Ashlock, D., Joenks, M.: ISAc lists: a different program induction method. In: Koza, J.R., et al. (eds.) Proceedings of the Second Annual Conference on Genetic Programming, pp. 18–26 (1998)
Ashlock, D., Freeman, J.: A pure finite state baseline for Tartarus. In: Proceedings of the 2000 Congress on Evolutionary Computation, pp. 1223–1230 (2000)
Dick, G.: An effective parse tree representation for Tartarus. In: Blum, C., et al. (eds.) Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, GECCO 2013, pp. 1397–1404 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Griffiths, T.D., Ekárt, A. (2017). Improving the Tartarus Problem as a Benchmark in Genetic Programming. In: McDermott, J., Castelli, M., Sekanina, L., Haasdijk, E., García-Sánchez, P. (eds) Genetic Programming. EuroGP 2017. Lecture Notes in Computer Science(), vol 10196. Springer, Cham. https://doi.org/10.1007/978-3-319-55696-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-55696-3_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-55695-6
Online ISBN: 978-3-319-55696-3
eBook Packages: Computer ScienceComputer Science (R0)