Abstract
A common problem in datamining is to find accurate classifiers for a dataset. For this purpose, genetic programming (GP) is applied to a set of benchmark classification problems. Using GP we are able to induce decision trees with a linear combination of variables in each function node. A new representation of decision trees using strong typing in GP is introduced. With this representation it is possible to let the GP classify into any number of classes. Results indicate that GP can be applied successfully to classification problems. Comparisons with current state-of-the-art algorithms in machine learning are presented and areas of future research are identified.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aguilar, J., Riquelme, J., Toro, M.: Three geometric approaches for representing decision rules in a supervised system. In: Late Breaking Papers at the 1999 Genetic and Evolution Computation Conference, pp. 8–15 (1999)
Blickle, T., Thiele, L.: Genetic programming and redundancy. In: Hopf, J. (ed.) Genetic Algorithms within the Framework of Evolutionary Computation (Workshop at KI 1994), Saarbrücken, Im Stadtwald, Building 44. D-66123 Saarbrücken, Germany, pp. 33–38. Max-Planck-Institut fur Informatik (MPI-1-94-241) (1994)
Frank, E., Wang, Y., Inglis, S., Holmes, G., Witten, I.H.: Using model trees for classification. Machine Learning 32, 63–76 (1998)
Gathercole, C.: An Investigation of Supervised Learning in Genetic Programming. PhD thesis, University of Edinburgh (1998)
Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge (1992)
Langdon, W.B., Soule, T., Poli, R., Foster, J.A.: The evolution of size and shape. In: Spector, L., Langdon, W.B., O’Reilly, U., Angeline, P.J. (eds.) Advances in Genetic Programming, vol. 3, ch. 8, pp. 163–90. MIT Press, Cambridge (1999) (forthcoming)
McPhee, N.F., Miller, J.D.: Accurate replication in genetic programming. In: Eshelman, L. (ed.) Genetic Algorithms: Proceedings of the Sixth International Conference (ICGA 1995), Pittsburgh, PA, USA, July 15-19, pp. 303–309. Morgan Kaufmann, San Francisco (1995)
Mitchell, T.: Machine Learning. WCB/McGraw-Hill (1997)
Montana, D.J.: Strongly typed genetic programming. Evolutionary Computation 3(2), 199–230 (1995)
Murthy, S., Kasif, S., Salzberg, S., Beigel, R.: Ocl: Randomized induction of oblique decision trees. In: Proceedings of the Eleventh National Conference on Artificial Intelligence, pp. 322–327. AAAI, MIT Press (1993)
Murthy, S.K.: Automatic construction of decision trees from data: a multi-disciplinary survey. Data Mining and Knowledge Discovery (2), 345–389 (1998)
Nikolaev, N.I., Slavov, V.: Inductive genetic programming with decision trees. In: 9th European Conference on Machine Learning, Prague, Czech Republic, April 3-26 (1997)
Nordin, P., Banzhaf, W.: Complexity compression and evolution. In: Eshelman, L. (ed.) Genetic Algorithms: Proceedings of the Sixth International Conference (ICGA 1995), Pittsburgh, PA, USA, July 15-19, pp. 310–317. Morgan Kaufmann, San Francisco (1995)
Quinlan, J.R.: C4. 5 Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)
Soule, T.: Code Growth in Genetic Programming. PhD thesis, University of Idaho, Moscow, Idaho, USA, May 15 (1998)
Soule, T., Foster, J.A., Dickinson, J.: Code growth in genetic programming. In: Koza, J.R., Goldberg, D.E., Fogel, D.B., Riolo, R.L. (eds.) Genetic Programming 1996: Proceedings of the First Annual Conference, Stanford University, CA, USA, July 28-31 , pp. 215–223. MIT Press, Cambridge (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bot, M.C.J., Langdon, W.B. (2000). Application of Genetic Programming to Induction of Linear Classification Trees. In: Poli, R., Banzhaf, W., Langdon, W.B., Miller, J., Nordin, P., Fogarty, T.C. (eds) Genetic Programming. EuroGP 2000. Lecture Notes in Computer Science, vol 1802. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-46239-2_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-46239-2_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67339-2
Online ISBN: 978-3-540-46239-2
eBook Packages: Springer Book Archive