Evolution of Deep Convolutional Neural Networks Using Cartesian Genetic Programming
Created by W.Langdon from
gp-bibliography.bib Revision:1.8051
- @Article{Suganuma:2019:EC,
-
author = "Masanori Suganuma and Masayuki Kobayashi and
Shinichi Shirakawa and Tomoharu Nagao",
-
title = "Evolution of Deep Convolutional Neural Networks Using
Cartesian Genetic Programming",
-
journal = "Evolutionary Computation",
-
year = "2020",
-
volume = "28",
-
number = "1",
-
pages = "141--163",
-
month = "Spring",
-
keywords = "genetic algorithms, genetic programming, Cartesian
Genetic Programming, ANN, convolutional neural network,
deep learning",
-
ISSN = "1063-6560",
-
URL = "https://www.mitpressjournals.org/doi/abs/10.1162/evco_a_00253",
-
DOI = "doi:10.1162/evco_a_00253",
-
size = "23 pages",
-
abstract = "The convolutional neural network (CNN), one of the
deep learning models, has demonstrated outstanding
performance in a variety of computer vision tasks.
However, as the network architectures become deeper and
more complex, designing CNN architectures requires more
expert knowledge and trial and error. In this paper, we
attempt to automatically construct high-performing CNN
architectures for a given task. Our method uses
Cartesian genetic programming (CGP) to encode the CNN
architectures, adopting highly functional modules such
as a convolutional block and tensor concatenation, as
the node functions in CGP. The CNN structure and
connectivity, represented by the CGP, are optimized to
maximize accuracy using the evolutionary algorithm. We
also introduce simple techniques to accelerate the
architecture search: rich initialization and early
network training termination. We evaluated our method
on the CIFAR-10 and CIFAR-100 datasets, achieving
competitive performance with state-of-the-art models.
Remarkably, our method can find competitive
architectures with a reasonable computational cost
compared to other automatic design methods that require
considerably more computational time and machine
resources.",
- }
Genetic Programming entries for
Masanori Suganuma
Masayuki Kobayashi
Shinichi Shirakawa
Tomoharu Nagao
Citations