Skip to main content

A Grammar-Guided Genetic Programming Algorithm for Multi-Label Classification

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7831))

Abstract

Multi-label classification is a challenging problem which demands new knowledge discovery methods. This paper presents a Grammar-Guided Genetic Programming algorithm for solving multi-label classification problems using IF-THEN classification rules. This algorithm, called G3P-ML, is evaluated and compared to other multi-label classification techniques in different application domains. Computational experiments show that G3P-ML often obtains better results than other algorithms while achieving a lower number of rules than the other methods.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alcalá-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., García, S., Sánchez, L., Herrera, F.: KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework. Journal of Multiple-Valued Logic and Soft Computing 17, 255–287 (2011)

    Google Scholar 

  2. Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recognition 37(9), 1757–1771 (2004)

    Article  Google Scholar 

  3. Chen, B., Ma, L., Hu, J.: An improved multi-label classification method based on svm with delicate decision boundary. International Journal of Innovative Computing, Information and Control 6(4), 1605–1614 (2010)

    Google Scholar 

  4. Cohen, W.W.: Fast Effective Rule Induction. In: 12th International Conference on Machine Learning, pp. 1–10 (1995)

    Google Scholar 

  5. Demšar, J.: Statistical Comparisons of Classifiers over Multiple Data Sets. Machine Learning Research 7, 1–30 (2006)

    MathSciNet  MATH  Google Scholar 

  6. Diplaris, S., Tsoumakas, G., Mitkas, P.A., Vlahavas, I.P.: Protein Classification with Multiple Algorithms. In: Bozanis, P., Houstis, E.N. (eds.) PCI 2005. LNCS, vol. 3746, pp. 448–456. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  7. Dunn, O.J.: Multiple Comparisons Among Means. Journal of the American Statistical Association 56(293), 52–64 (1961)

    Article  MathSciNet  MATH  Google Scholar 

  8. Espejo, P.G., Ventura, S., Herrera, F.: A survey on the application of genetic programming to classification. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 40(2), 121–144 (2010)

    Article  Google Scholar 

  9. Frank, E., Witten, I.H.: Generating Accurate Rule Sets Without Global Optimization. In: 15th International Conference on Machine Learning, pp. 144–151 (1998)

    Google Scholar 

  10. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemannr, P., Witten, I.H.: The WEKA Data Mining Software: An Update. SIGKDD 11, 10–18 (2009)

    Article  Google Scholar 

  11. Koza, J.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press (1992)

    Google Scholar 

  12. Ngan, P.S., Wong, M.L., Lam, W., Leung, K.S., Cheng, J.C.: Medical data mining using evolutionary computation. Artificial Intelligence in Medicine 16(1), 73–96 (1999)

    Article  Google Scholar 

  13. Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Francisco (1993)

    Google Scholar 

  14. Schapire, R.E., Singer, Y.: BoosTexter: A Boosting-based System for Text Categorization. Machine Learning 39, 135–168 (2000)

    Article  MATH  Google Scholar 

  15. Trohidis, K., Tsoumakas, G., Kalliris, G., Vlahavas, I.: Multilabel classification of music into emotions. In: 9th Int. Conf. on Music Information Retrieval (2008)

    Google Scholar 

  16. Tsoumakas, G., Katakis, I.: Multi-label classification: An overview. International Journal of Data Warehousing and Mining 3(3), 1–13 (2007)

    Article  Google Scholar 

  17. Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining Multi-label Data. In: Data Mining and Knowledge Discovery Handbook, pp. 667–685 (2010)

    Google Scholar 

  18. Ventura, S., Romero, C., Zafra, A., Delgado, J.A., Hervás, C.: JCLEC: A Java Framework for Evolutionary Computation. Soft Computing 12, 381–392 (2007)

    Article  Google Scholar 

  19. Whigham, P.A.: Schema theorem for context-free grammars. In: 2nd IEEE Conference on Evolutionary Computation, vol. 1, pp. 178–181 (1995)

    Google Scholar 

  20. Wong, M.L., Leung, K.S.: Data Mining Using Grammar Based Genetic Programming and Applications. Kluwer Academic Publisher (2000)

    Google Scholar 

  21. Yu, X., Gen, M.: Introduction to Evolutionary Algorithms. Springer (2010)

    Google Scholar 

  22. Zhang, M.L., Zhou, Z.H.: Multilabel neural networks with applications to functional genomics and text categorization. IEEE Transactions on Knowledge and Data Engineering 18, 1338–1351 (2006)

    Article  Google Scholar 

  23. Zhang, M.L., Zhou, Z.H.: Ml-knn: A lazy learning approach to multi-label learning. Pattern Recognition 40, 2038–2048 (2007)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cano, A., Zafra, A., Gibaja, E.L., Ventura, S. (2013). A Grammar-Guided Genetic Programming Algorithm for Multi-Label Classification. In: Krawiec, K., Moraglio, A., Hu, T., Etaner-Uyar, A.Ş., Hu, B. (eds) Genetic Programming. EuroGP 2013. Lecture Notes in Computer Science, vol 7831. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37207-0_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37207-0_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37206-3

  • Online ISBN: 978-3-642-37207-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics