Soft target and functional complexity reduction: A hybrid regularization method for genetic programming
Created by W.Langdon from
gp-bibliography.bib Revision:1.8051
- @Article{VANNESCHI:2021:ESA,
-
author = "Leonardo Vanneschi and Mauro Castelli",
-
title = "Soft target and functional complexity reduction: A
hybrid regularization method for genetic programming",
-
journal = "Expert Systems with Applications",
-
volume = "177",
-
pages = "114929",
-
year = "2021",
-
ISSN = "0957-4174",
-
DOI = "doi:10.1016/j.eswa.2021.114929",
-
URL = "https://www.sciencedirect.com/science/article/pii/S0957417421003705",
-
keywords = "genetic algorithms, genetic programming,
Regularisation, Soft target, Functional complexity,
Hybrid system",
-
abstract = "Regularization is frequently used in supervised
machine learning to prevent models from overfitting.
This paper tackles the problem of regularization in
genetic programming. We apply, for the first time, soft
target regularization, a method recently defined for
artificial neural networks, to genetic programming.
Also, we introduce a novel measure of functional
complexity of the genetic programming individuals,
aimed at quantifying their degree of curvature. We
experimentally demonstrate that both the use of soft
target regularization, and the minimization of the
complexity during learning, are often able to reduce
overfitting, but they are never able to eliminate it.
On the other hand, we demonstrate that the integration
of these two strategies into a novel hybrid genetic
programming system can completely eliminate
overfitting, for all the studied test cases. Last but
not least, consistently with what found in the
literature, we offer experimental evidence of the fact
that the size of the genetic programming models has no
correlation with their generalization ability",
- }
Genetic Programming entries for
Leonardo Vanneschi
Mauro Castelli
Citations