Abstract
We formalize and describe the mapping process of integer input (genotype) to an output sentence (phenotype) in Grammatical Evolution (GE). The aim is to study the grammatical and search bias which is produced by the mapping. We investigate changes in input and the effect on output and analyze the neighboring solutions as well as the effect of changes and bias in representation. Different types of changes are defined to allow classification of the effects that input changes (operators) have. The changes are a part of identifying what the neighborhood for GE search looks like. We call this disruption in GE. Furthermore, a schema theorem is introduced for investigating preservation of material during application of variation operators, an attempt to identify the population effects.
Keywords
- Grammatical Evolution (GE)
- Schema Theorem
- Derivation Tree
- Product Choice
- Probabilistic Context-free Grammars
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Canonical GE has a binary chromosome that will be transcribed to integers, \(f:\mathbb {Z}_2 \rightarrow \mathbb {Z}_{2^m},\ f(C_2)=C\) where m is the codon size and C 2 the binary representation of the chromosome. Here we simplify and skip the transcription step, binary-to-integer, and use a sequence of integers instead.
- 2.
\(\mathbb {N}\) refers to the natural numbers, \(\mathbb {Z}\) denotes integers, and \(\mathbb {Z}_n\) integers modulo n.
- 3.
In canonical GE the maximum number of production choices is \(r_{max} = max_{r_{i*} \in R}(|r_{i*}|)\). If r max uses unique identifiers the analysis can be facilitated. The context and analysis should make it obvious when the integer inputs are unique or ambiguous.
- 4.
GE can be seen as a PCFG (Definition 4 on page 4), where all the probabilities are uniform, i.e. the probabilities are determined by the number of production choices for each non-terminal, p ij = 1∕|r i∗|. A bias towards productions r ij can be achieved by multiple identical production choices in the solution grammar rules.
- 5.
It is possible to create crossover operators that only return a single individual.
References
L. Altenberg, The evolution of evolvability in genetic programming. Adv. Genet. Program. 3, 47–74, (1994)
L. Altenberg, The schema theorem and Price’s theorem. Found. Genet. Algorithms 3, 23–49 (1995)
T.L. Booth, Sequential Machines and Automata Theory (Wiley, New York, 1967)
T. Castle, C.G. Johnson, Positional effect of crossover and mutation in grammatical evolution, in European Conference on Genetic Programming. LNCS (Springer, Berlin, 2010)
J.A. Draghi, T.L. Parsons, G.P. Wagner, J.B. Plotkin, Mutational robustness can facilitate adaptation. Nature, 463(7279), 353–355 (2010)
D.E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning (Addison-Wesley, Boston, 1989)
R. Harper, A. Blair, A structure preserving crossover in grammatical evolution, in The 2005 IEEE Congress on Evolutionary Computation, vol. 3, 2005.
M.A. Harrison, Introduction to Formal Language Theory (Addison-Wesley Longman, Boston, 1978)
E.A.P. Hemberg, An exploration of grammars in grammatical evolution. PhD thesis, University College Dublin, 2010
M. Keijzer, M. O’Neill, C. Ryan, M. Cattolico, Grammatical evolution rules: the mod and the bucket rule, in EuroGP, vol. 2278 (Springer, Berlin, 2002), pp. 123–130
M. Nicolau, Automatic grammar complexity reduction in grammatical evolution, in GECCO 2004 Workshop Proceedings, Seattle, Washington, 26–30 June 2004, ed. by R. Poli et al. (2004)
M. O’Neill, C. Ryan, M. Nicolau, Grammar defined introns: an investigation into grammars, introns, and bias in grammatical evolution, in Proceedings of the 3rd Annual Conference on Genetic and Evolutionary Computation (Morgan Kaufmann, San Francisco, 2001), pp. 97–103
M. O’Neill, C. Ryan, M. Keijzer, M. Cattolico, Crossover in grammatical evolution. Genet. Program. Evolvable Mach. 4(1), 67–93 (2003)
R. Poli, C.R. Stephens, The building block basis for genetic programming and variable-length genetic algorithms. Int. J. Comput. Intell. Res. 1(1–2), 183–197 (2005)
F. Rothlauf, Representations for Genetic and Evolutionary Algorithms (Springer, Berlin, 2006)
F. Rothlauf, M. Oetzel, On the locality of grammatical evolution, in European Conference on Genetic Programming (Springer, Berlin, 2006), pp. 320–330
F. Rothlauf, M. Oetzel, On the locality of grammatical evolution, in EuroGP, ed. by P. Collet, M. Tomassini, M. Ebner, S. Gustafson, A. Ekrt. Lecture Notes in Computer Science, vol. 3905 (Springer, Berlin, 2006), pp. 320–330
M. Toussaint, The evolution of genetic representations and modular neural adaptation. PhD thesis, Ruhr-Universität Bochum, 2003
M. Toussaint, The evolution of genetic representations and modular adaptation. PhD thesis, 2003
G.P. Wagner, L. Altenberg, Complex adaptations and the evolution of evolvability. Evolution 50(3), 967–976 (1996)
C.S. Wetherell, Probabilistic languages: a review and some open questions. ACM Comput. Surv. 12(4), 361–379 (1980)
P.A. Whigham, Grammatically-based genetic programming, in Proceedings of the Workshop on Genetic Programming: From Theory to Real-World Applications, Tahoe City, 9 July 1995, ed. by J.P. Rosca (1995), pp. 33–41
P.A. Whigham, A schema theorem for context-free grammars, in 1995 IEEE Conference on Evolutionary Computation (IEEE Press, Piscataway, 1995), pp. 178–181
P.A. Whigham, Grammatical bias for evolutionary learning. PhD thesis, School of Computer Science, University College, University of New South Wales, Australian Defence Force Academy, Canberra, 14 October 1996
D. Wilson, D. Kaur, Search, neutral evolution, and mapping in evolutionary computing: a case study of grammatical evolution. IEEE Trans. Evol. Comput. 13(3), 566–590 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Hemberg, E. (2018). Theory of Disruption in GE. In: Ryan, C., O'Neill, M., Collins, J. (eds) Handbook of Grammatical Evolution. Springer, Cham. https://doi.org/10.1007/978-3-319-78717-6_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-78717-6_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-78716-9
Online ISBN: 978-3-319-78717-6
eBook Packages: Computer ScienceComputer Science (R0)