Abstract
Data classification is a real-world problem that is encountered daily in various problem domains. Genetic programming (GP) has proved to be one of the most versatile algorithms leading to its popularity as a classification algorithm. However, due to its large number of parameters, the manual design process of GP is considered to be a time consuming tedious task. As a result, there have been initiatives by the machine learning community to automate the design of GP classification algorithms. In this paper, we propose the transfer of the design knowledge gained from the automated design of GP classification algorithms from a specific source domain and apply it to design GP classification algorithms for a target domain. The results of the experiments demonstrate that the proposed approach is capable of evolving classifiers that achieve results that are competitive when compared to automated designed classifiers and better than manually tuned parameter classifiers. To the best of our knowledge, this is the first study that examines transfer learning in automated design. The proposed approach is shown to achieve positive transfer.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Espejo, P.G., Romero, C., Ventura, S., Hervás, C.: Induction of classification rules with grammar-based genetic programming. In: Conference on Machine Intelligence, pp. 596–601 (2005)
Goldberg, D.E., Holland, J.H.: Genetic algorithms and machine learning. Mach. Learn. 3, 95–99 (1988)
Hutter, F., Hoos, H.H., Leyton-Brown, K., Stützle, T.: ParamILS: an automatic algorithm configuration framework. J. Artif. Intell. Res. 36, 267–306 (2009)
Koza, J.R.: Concept formation and decision tree induction using the genetic programming paradigm. In: Schwefel, H.-P., Männer, R. (eds.) PPSN 1990. LNCS, vol. 496, pp. 124–128. Springer, Heidelberg (1991). https://doi.org/10.1007/BFb0029742
Montero, E., Riff, M.-C.: Towards a method for automatic algorithm configuration: a design evaluation using tuners. In: Bartz-Beielstein, T., Branke, J., Filipič, B., Smith, J. (eds.) PPSN 2014. LNCS, vol. 8672, pp. 90–99. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10762-2_9
Nyathi, T.: Automated design of genetic programming of classification algorithms. Ph.D. thesis (2018)
Nyathi, T., Pillay, N.: Comparison of a genetic algorithm to grammatical evolution for automated design of genetic programming classification algorithms. Expert Syst. Appl. 104, 213–234 (2018)
O’Neill, M., Ryan, C.: Grammatical evolution. IEEE Trans. Evol. Comput. 5(4), 349–358 (2001)
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009)
Pillay, N., Qu, R., Srinivasan, D., Hammer, B., Sorensen, K.: Automated design of machine learning and search algorithms [guest editorial]. IEEE Comput. Intell. Mag. 13(2), 16–17 (2018)
Tavallaee, M., Bagheri, E., Lu, W., Ghorbani, A.A.: A detailed analysis of the KDD cup 99 data set. In: 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications, pp. 1–6. IEEE (2009)
Torrey, L., Shavlik, J.: Transfer learning. In: Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, pp. 242–264. IGI Global (2010)
Vanneschi, L., Castelli, M., Silva, S.: A survey of semantic methods in genetic programming. Genet. Program Evolvable Mach. 15(2), 195–214 (2014)
Woolson, R.: Wilcoxon signed-rank test. In: Wiley Encyclopedia of Clinical Trials, pp. 1–3 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Nyathi, T., Pillay, N. (2021). On the Transfer Learning of Genetic Programming Classification Algorithms. In: Aranha, C., Martín-Vide, C., Vega-Rodríguez, M.A. (eds) Theory and Practice of Natural Computing. TPNC 2021. Lecture Notes in Computer Science(), vol 13082. Springer, Cham. https://doi.org/10.1007/978-3-030-90425-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-90425-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-90424-1
Online ISBN: 978-3-030-90425-8
eBook Packages: Computer ScienceComputer Science (R0)