ABSTRACT
The set of primitive operations available to a generative hyper-heuristic can have a dramatic impact on the overall performance of the heuristic search in terms of efficiency and final solution quality. When constructing a primitive set, users are faced with a tradeoff between generality and time spent searching. A set consisting of low-level primitives provides the flexibility to find most or all potential solutions, but the resulting heuristic search space might be too large to find adequate solutions in a reasonable time frame. Conversely, a set of high-level primitives can enable faster discovery of mediocre solutions, but prevent the fine-tuning necessary to find the optimal heuristics. By varying the set of primitives throughout evolution, the heuristic search can utilize the advantages of both high-level and low-level primitive sets. This permits the heuristic search to either quickly traverse parts of the search space as needed or modify the minutiae of the search to find optimal solutions in reasonable amounts of time not feasible with implicit levels of primitive granularity. This paper demonstrates this potential by presenting empirical evidence of improvements to solvers for the Traveling Thief Problem, a combination of the Traveling Salesman Problem and the Knapsack Problem, a recent and difficult problem designed to more closely emulate real world complexity.
- Peter J Angeline and Jordan Pollack. 1993. Evolutionary Module Acquisition. In Proceedings of the second annual conference on evolutionary programming. Citeseer, 154--163.Google Scholar
- Zalilah Abd Aziz. 2015. Ant Colony Hyper-heuristics for Travelling Salesman Problem. Procedia Computer Science 76 (2015), 534--538.Google ScholarCross Ref
- Wolfgang Banzhaf, Dirk Banscherus, and Peter Dittrich. 1999. Hierarchical Genetic Programming Using Local Modules. Secretary of the SFB 531.Google Scholar
- Julian Blank, Kalyanmoy Deb, and Sanaz Mostaghim. 2017. Solving the Bi-objective Traveling Thief Problem with Multi-objective Evolutionary Algorithms. In International Conference on Evolutionary Multi-Criterion Optimization. Springer, 46--60. Google ScholarDigital Library
- Mohammad Reza Bonyadi, Zbigniew Michalewicz, and Luigi Barone. 2013. The Travelling Thief Problem: The First Step in the Transition from Theoretical Problems to Realistic Problems. In Evolutionary Computation (CEC), 2013 IEEE Congress on. IEEE, 1037--1044.Google ScholarCross Ref
- Edmund K. Burke, Michel Gendreau, Matthew Hyde, Graham Kendall, Gabriela Ochoa, Ender özcan, and Rong Qu. 2013. Hyper-heuristics: A survey of the state of the art. Journal of the Operational Research Society 64, 12 (2013), 1695--1724.Google ScholarCross Ref
- Edmund K Burke, Matthew R Hyde, Graham Kendall, and John Woodward. 2012. Automating the Packing Heuristic Design Process with Genetic Programming. Evolutionary computation 20, 1 (2012), 63--89. Google ScholarDigital Library
- John H Drake, Matthew Hyde, Khaled Ibrahim, and Ender Ozcan. 2014. A Genetic Programming Hyper-heuristic for the Multidimensional Knapsack Problem. Kybernetes 43, 9/10 (2014), 1500--1511.Google Scholar
- Mohamed El Yafrani and Belaïd Ahiod. 2016. Population-based vs. Single-solution Heuristics for the Travelling Thief Problem. In Proceedings of the Genetic and Evolutionary Computation Conference 2016. ACM, 317--324. Google ScholarDigital Library
- Mohamed El Yafrani, Marcella Martins, Markus Wagner, Belaïd Ahiod, Myriam Delgado, and Ricardo Lüders. 2018. A Hyperheuristic Approach Based on Low-level Heuristics for the Travelling Thief Problem. Genetic Programming and Evolvable Machines 19, 1-2 (2018), 121--150. Google ScholarDigital Library
- David B Fogel. 1993. Applying Evolutionary Programming to Selected Traveling Salesman Problems. Cybernetics and systems 24, 1 (1993), 27--36. Google ScholarDigital Library
- Brian W Goldman and Daniel R Tauritz. 2011. Meta-evolved Empirical Evidence of the Effectiveness of Dynamic Parameters. In Proceedings of the 13th annual conference companion on Genetic and evolutionary computation. ACM, 155--156. Google ScholarDigital Library
- Thomas Helmuth and Lee Spector. 2015. Detailed Problem Descriptions for General Program Synthesis Benchmark Suite. Technical Report. Technical Report UM-CS-2015-006, School of Computer Science, University of Massachusetts Amherst.Google Scholar
- Patricia D. Hough and Pamela J. Williams. 2006. Modern Machine Learning for Automatic Optimization Algorithm Selection. In Proceedings of the INFORMS Artificial Intelligence and Data Mining Workshop. 1--6.Google Scholar
- Stephen Kelly and Malcolm I Heywood. 2017. Emergent Tangled Graph Representations for Atari Game Playing Agents. In European Conference on Genetic Programming. Springer, 64--79.Google Scholar
- Graham Kendall and Jiawei Li. 2013. Competitive Travelling Salesmen Problem: A Hyper-heuristic Approach. Journal of the Operational Research Society 64, 2 (2013), 208--216.Google ScholarCross Ref
- John R. Koza. 1992. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA. Google ScholarDigital Library
- Rajeev Kumar, Ashwin H Joshi, Krishna K Banka, and Peter I Rockett. 2008. Evolution of Hyperheuristics for the Biobjective 0/1 Knapsack Problem by Multi-objective Genetic Programming. In Proceedings of the 10th annual conference on Genetic and evolutionary computation. ACM, 1227--1234. Google ScholarDigital Library
- Shen Lin and Brian W Kernighan. 1973. An Effective Heuristic Algorithm for the Traveling-salesman Problem. Operations research 21, 2 (1973), 498--516. Google ScholarDigital Library
- Matthew A Martin and Daniel R Tauritz. 2015. Hyper-heuristics: A Study on Increasing Primitive-space. In Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary Computation. ACM, 1051--1058. Google ScholarDigital Library
- Yi Mei, Xiaodong Li, Flora Salim, and Xin Yao. 2015. Heuristic Evolution with Genetic Programming for Traveling Thief Problem. In Evolutionary Computation (CEC), 2015 IEEE Congress on. IEEE, 2753--2760.Google ScholarCross Ref
- Lucas Parada, Carlos Herrera, Mauricio Sepúlveda, and Victor Parada. 2016. Evolution of New Algorithms for the Binary Knapsack Problem. Natural Computing 15, 1 (2016), 181--193. Google ScholarDigital Library
- Sergey Polyakovskiy, Mohammad Reza Bonyadi, Markus Wagner, Zbigniew Michalewicz, and Frank Neumann. 2014. A Comprehensive Benchmark Set and Heuristics for the Traveling Thief Problem. In Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation. ACM, 477--484. Google ScholarDigital Library
- Aaron S. Pope, Daniel R. Tauritz, and Alexander D. Kent. 2016. Evolving Random Graph Generators: A Case for Increased Algorithmic Primitive Granularity. In 2016 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 1--8.Google Scholar
- Justinian P Rosca and Dana H Ballard. 1994. Hierarchical Self-organization in Genetic Programming. In Machine Learning Proceedings 1994. Elsevier, 251--258. Google ScholarDigital Library
- Patricia Ryser-Welch, Julian F Miller, and Shahriar Asta. 2015. Generating Human-readable Algorithms for the Travelling Salesman Problem using Hyper-heuristics. In Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary Computation. ACM, 1067--1074. Google ScholarDigital Library
- Junhua Wu, Sergey Polyakovskiy, Markus Wagner, and Frank Neumann. 2018. Evolutionary Computation plus Dynamic Programming for the Bi-Objective Travelling Thief Problem. arXiv preprint arXiv:1802.02434 (2018).Google Scholar
Index Terms
- Empirical evidence of the effectiveness of primitive granularity control for hyper-heuristics
Recommendations
Batched Mode Hyper-heuristics
LION 7: Revised Selected Papers of the 7th International Conference on Learning and Intelligent Optimization - Volume 7997A primary role for hyper-heuristics is to control search processes based on moves generated by neighbourhood operators. Studies have shown that such hyper-heuristics can be effectively used, without modification, for solving unseen problem instances not ...
A comparative study of hyper-heuristics for solving the school timetabling problem
SAICSIT '13: Proceedings of the South African Institute for Computer Scientists and Information Technologists ConferenceHyper-heuristics have proven to be an effective means of obtaining generalized solutions to optimization problems. One such domain in which they have been a success is educational timetabling. However, all the research in this area has focused on ...
Hyper-heuristics and cross-domain optimization
GECCO '12: Proceedings of the 14th annual conference companion on Genetic and evolutionary computationHyper-heuristics comprise a set of approaches which are motivated (at least in part) by the goal of automating the design of heuristic methods to solve hard computational search problems. An underlying strategic research challenge is to develop more ...
Comments