Characterising Genetic Programming Error Through Extended Bias and Variance Decomposition
Created by W.Langdon from
gp-bibliography.bib Revision:1.8129
- @Article{Owen:ieeeTEC,
-
author = "Caitlin A. Owen and Grant Dick and Peter A. Whigham",
-
title = "Characterising Genetic Programming Error Through
Extended Bias and Variance Decomposition",
-
journal = "IEEE Transactions on Evolutionary Computation",
-
year = "2020",
-
volume = "24",
-
number = "6",
-
pages = "1164--1176",
-
month = dec,
-
keywords = "genetic algorithms, genetic programming, Bias-variance
decomposition, bias-variance trade-off, prediction
error, EML, evolutionary machine learning, symbolic
regression",
-
ISSN = "1089-778X",
-
DOI = "doi:10.1109/TEVC.2020.2990626",
-
size = "13 pages",
-
abstract = "An error function can be used to select between
candidate models but it does not provide a thorough
understanding of the behaviour of a model. A greater
understanding of an algorithm can be obtained by
performing a bias-variance decomposition. Splitting the
error into bias and variance is effective for
understanding a deterministic algorithm such as
k-Nearest Neighbour, which provides the same
predictions when performed multiple times using the
same data. However, simply splitting the error into
bias and variance is not sufficient for
non-deterministic algorithms, such as genetic
programming (GP), which potentially produces a
different model each time it is run, even when using
the same data. This paper presents an extended
bias-variance decomposition that decomposes error into
bias, external variance (error attributable to limited
sampling of the problem) and internal variance (error
due to random actions performed in the algorithm
itself). This decomposition is applied to GP to expose
the three components of error, providing a unique
insight into the role of maximum tree depth, number of
generations, size/complexity of function set and data
standardisation in influencing predictive performance.
The proposed tool can be used to inform targeted
improvements for reducing specific components of model
error.",
-
notes = "also known as \cite{9080104}",
- }
Genetic Programming entries for
Caitlin A Owen
Grant Dick
Peter Alexander Whigham
Citations