Rahul Kapoor
ABSTRACT
In this paper we present an iterative structure-based genetic programming algorithm for neural architecture search. Canonical genetic programming uses a fitness function to determine where to move the search to in the program space. This research investigates using the structure of the syntax trees, representing different areas of the program space, in addition to the fitness function to direct the search. The structure is used to avoid areas of the search that previously led to local optima both globally (exploration) and locally (exploitation). The proposed approach is evaluated for image classification and video shorts creation. The iterative structure-based approach was found to produce better results then canonical genetic programming for both problem domains, with a slight reduction in computational cost. The approach also produced better results than genetic algorithms which are traditionally used for neural architecture search.
- Thomas Elsken, Jan Hendrik Metzen, and Frank Hutter. 2019. Neural Architecture Search: A Survey. Journal of Machine Learning Research 20, 55 (2019), 1--21.Google Scholar
- John R. Koza. 1992. Genetic Programming On the Programming of Computers by Means of Natural Selection. MIT.Google Scholar
Index Terms
- Iterative Structure-Based Genetic Programming for Neural Architecture Search
Recommendations
Neural network crossover in genetic algorithms using genetic programming
AbstractThe use of genetic algorithms (GAs) to evolve neural network (NN) weights has risen in popularity in recent years, particularly when used together with gradient descent as a mutation operator. However, crossover operators are often omitted from ...
A Training-free Genetic Neural Architecture Search
ACM ICEA '21: Proceedings of the 2021 ACM International Conference on Intelligent Computing and its Emerging ApplicationsThe so-called neural architecture search (NAS) provides an alternative way to construct a "good neural architecture," which would normally outperform hand-made architectures, for solving complex problems without domain knowledge. However, a critical ...
A genetic programming approach to the automated design of CNN models for image classification and video shorts creation
AbstractNeural architecture search (NAS) is a rapidly growing field which focuses on the automated design of neural network architectures. Genetic algorithms (GAs) have been predominantly used for evolving neural network architectures. Genetic programming ...
Comments