abstract = "In this paper we present and evaluate a novel
algorithm for ensemble creation. The main idea of the
algorithm is to first independently train a fixed
number of neural networks (here ten) and then use
genetic programming to combine these networks into an
ensemble. The use of genetic programming makes it
possible to not only consider ensembles of different
sizes, but also to use ensembles as intermediate
building blocks. The final result is therefore more
correctly described as an ensemble of neural network
ensembles. The experiments show that the proposed
method, when evaluated on 22 publicly available data
sets, obtains very high accuracy, clearly outperforming
the other methods evaluated. In this study several
micro techniques are used, and we believe that they all
contribute to the increased performance. One such micro
technique, aimed at reducing overtraining, is the
training method, called tombola training, used during
genetic evolution. When using tombola training,
training data is regularly resampled into new parts,
called training groups. Each ensemble is then evaluated
on every training group and the actual fitness is
determined solely from the result on the hardest
part.",
notes = "WCCI 2006 - A joint meeting of the IEEE, the EPS, and
the IEE.