Skip to main content

Application of Genetic Programming to Induction of Linear Classification Trees

  • Conference paper
Genetic Programming (EuroGP 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1802))

Included in the following conference series:

Abstract

A common problem in datamining is to find accurate classifiers for a dataset. For this purpose, genetic programming (GP) is applied to a set of benchmark classification problems. Using GP we are able to induce decision trees with a linear combination of variables in each function node. A new representation of decision trees using strong typing in GP is introduced. With this representation it is possible to let the GP classify into any number of classes. Results indicate that GP can be applied successfully to classification problems. Comparisons with current state-of-the-art algorithms in machine learning are presented and areas of future research are identified.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aguilar, J., Riquelme, J., Toro, M.: Three geometric approaches for representing decision rules in a supervised system. In: Late Breaking Papers at the 1999 Genetic and Evolution Computation Conference, pp. 8–15 (1999)

    Google Scholar 

  2. Blickle, T., Thiele, L.: Genetic programming and redundancy. In: Hopf, J. (ed.) Genetic Algorithms within the Framework of Evolutionary Computation (Workshop at KI 1994), Saarbrücken, Im Stadtwald, Building 44. D-66123 Saarbrücken, Germany, pp. 33–38. Max-Planck-Institut fur Informatik (MPI-1-94-241) (1994)

    Google Scholar 

  3. Frank, E., Wang, Y., Inglis, S., Holmes, G., Witten, I.H.: Using model trees for classification. Machine Learning 32, 63–76 (1998)

    Google Scholar 

  4. Gathercole, C.: An Investigation of Supervised Learning in Genetic Programming. PhD thesis, University of Edinburgh (1998)

    Google Scholar 

  5. Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge (1992)

    MATH  Google Scholar 

  6. Langdon, W.B., Soule, T., Poli, R., Foster, J.A.: The evolution of size and shape. In: Spector, L., Langdon, W.B., O’Reilly, U., Angeline, P.J. (eds.) Advances in Genetic Programming, vol. 3, ch. 8, pp. 163–90. MIT Press, Cambridge (1999) (forthcoming)

    Google Scholar 

  7. McPhee, N.F., Miller, J.D.: Accurate replication in genetic programming. In: Eshelman, L. (ed.) Genetic Algorithms: Proceedings of the Sixth International Conference (ICGA 1995), Pittsburgh, PA, USA, July 15-19, pp. 303–309. Morgan Kaufmann, San Francisco (1995)

    Google Scholar 

  8. Mitchell, T.: Machine Learning. WCB/McGraw-Hill (1997)

    Google Scholar 

  9. Montana, D.J.: Strongly typed genetic programming. Evolutionary Computation 3(2), 199–230 (1995)

    Google Scholar 

  10. Murthy, S., Kasif, S., Salzberg, S., Beigel, R.: Ocl: Randomized induction of oblique decision trees. In: Proceedings of the Eleventh National Conference on Artificial Intelligence, pp. 322–327. AAAI, MIT Press (1993)

    Google Scholar 

  11. Murthy, S.K.: Automatic construction of decision trees from data: a multi-disciplinary survey. Data Mining and Knowledge Discovery (2), 345–389 (1998)

    Google Scholar 

  12. Nikolaev, N.I., Slavov, V.: Inductive genetic programming with decision trees. In: 9th European Conference on Machine Learning, Prague, Czech Republic, April 3-26 (1997)

    Google Scholar 

  13. Nordin, P., Banzhaf, W.: Complexity compression and evolution. In: Eshelman, L. (ed.) Genetic Algorithms: Proceedings of the Sixth International Conference (ICGA 1995), Pittsburgh, PA, USA, July 15-19, pp. 310–317. Morgan Kaufmann, San Francisco (1995)

    Google Scholar 

  14. Quinlan, J.R.: C4. 5 Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)

    Google Scholar 

  15. Soule, T.: Code Growth in Genetic Programming. PhD thesis, University of Idaho, Moscow, Idaho, USA, May 15 (1998)

    Google Scholar 

  16. Soule, T., Foster, J.A., Dickinson, J.: Code growth in genetic programming. In: Koza, J.R., Goldberg, D.E., Fogel, D.B., Riolo, R.L. (eds.) Genetic Programming 1996: Proceedings of the First Annual Conference, Stanford University, CA, USA, July 28-31 , pp. 215–223. MIT Press, Cambridge (1996)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bot, M.C.J., Langdon, W.B. (2000). Application of Genetic Programming to Induction of Linear Classification Trees. In: Poli, R., Banzhaf, W., Langdon, W.B., Miller, J., Nordin, P., Fogarty, T.C. (eds) Genetic Programming. EuroGP 2000. Lecture Notes in Computer Science, vol 1802. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-46239-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-46239-2_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-67339-2

  • Online ISBN: 978-3-540-46239-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics