Skip to main content
SpringerLink
Log in

Genetic programming with transfer learning for texture image classification

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Genetic programming (GP) represents a well-known and widely used evolutionary computation technique that has shown promising results in optimisation, classification, and symbolic regression problems. However, similar to many other techniques, the performance of GP deteriorates for solving highly complex tasks. Transfer learning can improve the learning ability of GP, which can be seen from previous research on including, but not limited to, symbolic regression and Boolean problems. However, utilising transfer learning to tackle image-related, specifically, image classification, problems in GP is limited. This paper aims at proposing a new method for employing transfer learning in GP to extract and transfer knowledge in order to tackle complex texture image classification problems. To assess the improvement gained from using the extracted knowledge, the proposed method is examined and compared against the baseline GP method and a state-of-the-art method on three publicly available and commonly used texture image classification datasets. The obtained results indicate that the reuse of the extracted knowledge from an image dataset has significant impact on improving the performance in learning different rotated versions of the same dataset, as well as other related image datasets. Further, it is found that the proposed approach in the very first generation of the evolutionary process produces better classification accuracy than the final classification accuracy obtained by the baseline method after 50 generations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Available at: http://www.cb.uu.se/~gustaf/texture/.

  2. Available at: http://multibandtexture.recherche.usherbrooke.ca/.

  3. Available at: http://www.outex.oulu.fi/index.php?page=classification.

References

  • Al-Sahaf H, Song A, Neshatian K, Zhang M (2012) Two-tier genetic programming: towards raw pixel-based image classification. Expert Syst Appl 39(16):12291–12301

    Article  Google Scholar 

  • Al-Sahaf H, Zhang M, Johnston M, Verma B (2015)Image descriptor: a genetic programming approach to multiclass texture classification. In: Proceedings of 2015 IEEE congress on evolutionary computation. IEEE, pp 2460–2467

  • Al-Sahaf H, Al-Sahaf A, Xue B, Johnston M, Zhang M (2017) Automatically evolving rotation-invariant texture image descriptors by genetic programming. IEEE Trans Evol Comput 21(1):83–101

    Google Scholar 

  • Blanchard G, Lee G, Scott C (2011) Generalizing from several related classification tasks to a new unlabeled sample. In: Proceedings of 2011 advances in neural information processing systems. Curran Associates, pp 2178–2186

  • Blitzer J, McDonald R, Pereira F (2006) Domain adaptation with structural correspondence learning. In: Proceedings of the 2006 conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 120–128

  • Brodatz P (1999) Textures: a photographic album for artists and designers. Dover Publications, New York

    Google Scholar 

  • Cha SH (2007) Comprehensive survey on distance/similarity measures between probability density functions. Int J Math Models Methods Appl Sci 1(4):300–307

    MathSciNet  Google Scholar 

  • Chang BM, Tsai HH, Yen CY (2016) SVM-PSO based rotation-invariant image texture classification in SVD and DWT domains. Eng Appl Artif Intell 52:96–107

    Article  Google Scholar 

  • Chen Q, Xue B, Zhang M (2015) Generalisation and domain adaptation in GP with gradient descent for symbolic regression. In: Proceedings of 2015 IEEE Congress on Evolutionary Computation. IEEE, pp 1137–1144

  • Christodoulidis S, Anthimopoulos M, Ebner L, Christe A, Mougiakakou S (2017) Multisource transfer learning with convolutional neural networks for lung pattern analysis. IEEE J Biomed Health Inform 21(1):76–84

    Article  Google Scholar 

  • Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) DeCAF: a deep convolutional activation feature for generic visual recognition. In: Proceedings of the 31st international conference in machine learning, international conference on machine learning, vol 32. PMLR, pp 647–655

  • Eiben AE, Smith J (2015) From evolutionary computation to the evolution of things. Nature 521(7553):476–482

    Article  Google Scholar 

  • Espejo PG, Ventura S, Herrera F (2010) A survey on the application of genetic programming to classification. IEEE Trans Syst Man Cybern C Appl Rev 40(2):121–144

    Article  Google Scholar 

  • Fogel DB (2007) Introduction to evolutionary computation, chap 1. Wiley, New York, pp 1–23

    Google Scholar 

  • Fu W, Johnston M, Zhang M (2014) Low-level feature extraction for edge detection using genetic programming. IEEE Trans Cybern 44(8):1459–1472

    Article  Google Scholar 

  • Galitsky BA (2013) Transfer learning of syntactic structures for building taxonomies for search engines. Eng Appl Artif Intell 26:2504–2515

    Article  Google Scholar 

  • Ghifary M, Kleijn WB, Zhang M (2014) Domain adaptive neural networks for object recognition. In: Proceedings of the 13th Pacific Rim international conference on artificial intelligence. Springer, pp 898–904

  • Ghifary M, Kleijn WB, Zhang M, Balduzzi D (2015) Domain generalization for object recognition with multi-task autoencoders. In: Proceedings of 2015 IEEE international conference on computer vision. IEEE, pp 2551–2559

  • Hafemann LG, Oliveira LS, Cavalin PR, Sabourin R (2015) Transfer learning between texture classification tasks using convolutional neural networks. In: Proceedings of the 2015 international joint conference on neural networks. IEEE, pp 1–7

  • Hien NT, Hoai NX, McKay B (2011) A study on genetic programming with layered learning and incremental sampling. In: Proceedings of 2011 IEEE congress on evolutionary computation. IEEE, pp 1179–1185

  • Hoang TH, McKay RIB, Essam D, Hoai NX (2011) On synergistic interactions between evolution, development and layered learning. IEEE Trans Evol Comput 15(3):287–312

    Article  Google Scholar 

  • Hosseinzadeh H, Razzazi F (2016) LMDT: a weakly-supervised large-margin-domain-transfer for handwritten digit recognition. Eng Appl Artif Intell 52:119–125

    Article  Google Scholar 

  • Iqbal M, Browne WN, Zhang M (2014) Reusing building blocks of extracted knowledge to solve complex, large-scale boolean problems. IEEE Trans Evol Comput 18(4):465–480

    Article  Google Scholar 

  • Iqbal M, Xue B, Zhang M (2016a) Reusing extracted knowledge in genetic programming to solve complex texture image classification problems. In: Proceedings of the 20th Pacific Asia knowledge discovery and data mining conference, Part II. Springer, pp 117–129

  • Iqbal M, Zhang M, Xue B (2016b) Improving classification on images by extracting and transferring knowledge in genetic programming. In: Proceedings of 2016 IEEE congress on evolutionary computation. IEEE, pp 3582–3589

  • Iqbal M, Xue B, Al-Sahaf H, Zhang M (2017) Cross-domain reuse of extracted knowledge in genetic programming for image classification. IEEE Trans Evol Comput 21(4):569–587

    Article  Google Scholar 

  • Jackson D, Gibbons AP (2007) Layered learning in boolean GP problems. In: Proceedings of the European conference on genetic programming, lecture notes in computer science, vol 4445. Springer, pp 148–159

  • Jaśkowski W, Krawiec K, Wieloch B (2014) Cross-task code reuse in genetic programming applied to visual learning. Int J Appl Math Comput Sci 24(1):183–197

    Article  Google Scholar 

  • Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge

    MATH  Google Scholar 

  • Kylberg G (2011) The Kylberg texture dataset v. 1.0. External report (Blue series) 35, centre for image analysis, Swedish University of Agricultural Sciences and Uppsala University, Uppsala, Sweden

  • Lensen A, Al-Sahaf H, Zhang M, Xue B (2015) A hybrid genetic programming approach to feature detection and image classification. In: Proceedings of the 30th international conference on image and vision computing New Zealand. IEEE, pp 1–6

  • Lensen A, Al-Sahaf H, Zhang M, Xue B (2016) Genetic programming for region detection, feature extraction, feature construction and classification in image data. In Proceedings of the 19th European conference on genetic programming, lecture notes in computer science, vol 9594. Springer, pp 49–64

  • Li Y, Ma J, Zhao Q (2008) Two improvements in genetic programming for image classification. In: Proceedings of the IEEE congress on evolutionary computation, pp 2492–2497

  • Lu J, Behbood V, Hao P, Zuo H, Xue S, Zhang G (2015) Transfer learning using computational intelligence: a survey. Knowledge-Based Syst 80(C):14–23

    Article  Google Scholar 

  • Luke S (2013) Essentials of metaheuristics, 2nd edn. Lulu. https://cs.gmu.edu/~sean/book/metaheuristics/

  • Muandet K, Balduzzi D, Schölkopf B (2013) Domain generalization via invariant feature representation. In: Proceedings of the international conference on machine learning, pp 10–18. JMLR.org

  • Muhammad G (2015) Date fruits classification using texture descriptors and shape-size features. Eng Appl Artif Intell 37:361–367

    Article  Google Scholar 

  • Ojala T, Mäenpää T, Pietikäinen M, Viertola J, Kyllonen J, Huovinen S (2002) Outex—new framework for empirical evaluation of texture analysis algorithms. In: Proceedings of the 16th international conference on pattern recognition, vol 1. IEEE, pp 701–706

  • Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  • Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210

    Article  Google Scholar 

  • Patel VM, Gopalan R, Li R, Chellapa R (2015) Visual domain adaptation: a survey of recent advances. IEEE Signal Process Mag 32(3):53–69

    Article  Google Scholar 

  • Perez CB, Olague G (2009) Evolutionary learning of local descriptor operators for object recognition. In: Proceedings of the 11th annual conference on genetic and evolutionary computation. ACM, pp 1051–1058

  • Poli R, Langdon WB, McPhee NF (2008) A field guide to genetic programming (with contributions by Koza JR). http://www.gp-field-guide.org.uk/

  • Sharif M, Jaffar MA, Mahmood MT (2014) Optimal composite morphological supervised filter for image denoising using genetic programming: application to magnetic resonance images. Eng Appl Artif Intell 31:78–89

    Article  Google Scholar 

  • Xue B, Zhang M, Browne W, Yao X (2016) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626

    Article  Google Scholar 

  • Zhang Y, Zhang E, Chen W (2016) Deep neural network for halftone image classification based on sparse auto-encoder. Eng Appl Artif Intell 50:245–255

    Article  Google Scholar 

  • Zuniga A, Mora M, Oyarce M, Fredes C (2014) Grape maturity estimation based on seed images and neural networks. Eng Appl Artif Intell 35:95–104

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported in part by the Marsden Fund (Contract Numbers VUW1509, VUW1615) of New Zealand, and the University research grant of Victoria University of Wellington (Grant Numbers 213150 and 216137). Bing Xue received research grants from Marsden Fund (VUW1615) of New Zealand and from Victoria University of Wellington (213150). Mengjie Zhang received the research grants from Marsden Fund of New Zealand (VUW1509) and Victoria University of Wellington (216137).

Author information

Authors and Affiliations

  1. School of Engineering and Computer Science, Victoria University of Wellington, PO Box 600, Wellington, 6140, New Zealand

    Muhammad Iqbal, Harith Al-Sahaf, Bing Xue & Mengjie Zhang

Authors
  1. Muhammad Iqbal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Harith Al-Sahaf
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bing Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mengjie Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Harith Al-Sahaf.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Iqbal, M., Al-Sahaf, H., Xue, B. et al. Genetic programming with transfer learning for texture image classification. Soft Comput 23, 12859–12871 (2019). https://doi.org/10.1007/s00500-019-03843-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-019-03843-5

Keywords

Search

Navigation