Abstract
Classical methods for Inductive Concept Learning (ICL) rely mostly on using specific search strategies, such as hill climbing and inverse resolution. These strategies have a great exploitation power, but run the risk of being incapable of escaping from local optima. An alternative approach to ICL is represented by Evolutionary Algorithms (EAs). EAs have a great exploration power, thus they have the capability of escaping from local optima, but their exploitation power is rather poor. These observations suggest that the two approaches are applicable to partly complementary classes of learning problems. More important, they indicate that a system incorporating features from both approaches could benefit from the complementary qualities of the approaches. In this paper we experimentally validate this statement. To this end, we incorporate different search strategies in a framework based on EAs for ICL. Results of experiments show that incorporating standard search strategies helps the EA in achieving better results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Mitchell, T.: Generalization as search. Artificial Intelligence 18, 203–226 (1982)
Kubat, M., Bratko, I., Michalski, R.: A review of Machine Learning Methods. In: Michalski, R., Bratko, I., Kubat, M. (eds.) Machine Learning and Data Mining, John Wiley and Sons Ltd., Chichester (1998)
Quinlan, J.: Learning logical definition from relations. Machine Learning 5, 239–266 (1990)
Muggleton, S.: Inverse entailment and Progol. New Generation Computing, Special issue on Inductive Logic Progra mming 13, 245–286 (1995)
Muggleton, S., Buntine, W.: Machine invention of first order predicates by inverting resolution. In: Proceedings of the Fifth International Machine Learning Conference, pp. 339–351. Morgan Kaufmann, San Francisco (1988)
Giordana, A., Neri, F.: Search-intensive concept induction. Evolutionary Computation 3, 375–416 (1996)
Anglano, C., Giordana, A., Bello, G.L., Saitta, L.: An experimental evaluation of coevolutive concept learning. In: Proc. 15th International Conf. on Machine Learning, pp. 19–27. Morgan Kaufmann, San Francisco (1998)
Hekanaho, J.: Background knowledge in GA-based concept learning. In: International Conference on Machine Learning, pp. 234–242 (1996)
Augier, S., Venturini, G., Kodratoff, Y.: Learning first order logic rules with a genetic algorithm. In: Fayyad, U.M., Uthurusamy, R. (eds.) The First International Conference on Knowledge Discovery and Data Mining, pp. 21–26. AAAI Press, Montreal (1995)
Wong, M.L., Leung, K.S.: Inducing logic programs with genetic algorithms: The genetic logic programming system. IEEE Expert 10(5), 68–76 (1995)
Divina, F.: Hybrid Genetic Relational Search for Inductive Learning. PhD thesis, Department of Computer Science, Vrije Universiteit, Amsterdam, the Netherlands (2004)
Divina, F., Marchiori, E.: Handling continuous attributes in an evolutionary inductive learner. IEEE Transactions on Evolutionary Computation (2004) (to appear)
Divina, F., Keijzer, M., Marchiori, E.: Non-universal suffrage selection operators favor population diversity in genetic algorithms. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2724, pp. 1571–1573. Springer, Heidelberg (2003)
Divina, F., Marchiori, E.: Knowledge–based evolutionary search for inductive concept learning. In: Knowledge Incorporation in Evolutionary Computation, pp. 237–254. Springer, Heidelberg (2004)
Blake, C., Merz, C.: UCI repository of machine learning databases (1998)
Džeroski, S., Jacobs, N., Molina, M., Moure, C.: ILP experiments in detecting traffic problems. In: European Conference on Machine Learning, pp. 61–66 (1998)
Džeroski, S., Jacobs, N., Molina, M., Moure, C., Muggleton, S., Laer, W.V.: Detecting traffic problems with ILP. In: International Workshop on Inductive Logic Programming, pp. 281–290 (1998)
Debnath, A., de Compadre, R.L., Debnath, G., Schusterman, A., Hansch, C.: Structure-Activity Relationship of Mutagenic Aromatic and Heteroaromatic Nitro Compounds. Correlation with molecular orbital energies and hydrophobicity. Journal of Medical Chemistry 34(2), 786–797 (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Divina, F. (2005). Assessing the Effectiveness of Incorporating Knowledge in an Evolutionary Concept Learner. In: Keijzer, M., Tettamanzi, A., Collet, P., van Hemert, J., Tomassini, M. (eds) Genetic Programming. EuroGP 2005. Lecture Notes in Computer Science, vol 3447. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-31989-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-31989-4_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25436-2
Online ISBN: 978-3-540-31989-4
eBook Packages: Computer ScienceComputer Science (R0)