Skip to main content

A Deep Genetic Programming Based Methodology for Art Media Classification Robust to Adversarial Perturbations

  • Conference paper
  • First Online:
Advances in Visual Computing (ISVC 2020)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12509))

Included in the following conference series:

Abstract

Art Media Classification problem is a current research area that has attracted attention due to the complex extraction and analysis of features of high-value art pieces. The perception of the attributes can not be subjective, as humans sometimes follow a biased interpretation of artworks while ensuring automated observation’s trustworthiness. Machine Learning has outperformed many areas through its learning process of artificial feature extraction from images instead of designing handcrafted feature detectors. However, a major concern related to its reliability has brought attention because, with small perturbations made intentionally in the input image (adversarial attack), its prediction can be completely changed. In this manner, we foresee two ways of approaching the situation: (1) solve the problem of adversarial attacks in current neural networks methodologies, or (2) propose a different approach that can challenge deep learning without the effects of adversarial attacks. The first one has not been solved yet, and adversarial attacks have become even more complex to defend. Therefore, this work presents a Deep Genetic Programming method, called Brain Programming, that competes with deep learning and studies the transferability of adversarial attacks using two artworks databases made by art experts. The results show that the Brain Programming method preserves its performance in comparison with AlexNet, making it robust to these perturbations and competing to the performance of Deep Learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Akhtar, N., Mian, A.: Threat of adversarial attacks on deep learning in computer vision: a survey. IEEE Access 6, 14410–14430 (2018)

    Article  Google Scholar 

  2. Arora, R.S., Elgammal, A.: Towards automated classification of fine-art painting style: a comparative study. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3541–3544. IEEE (2012)

    Google Scholar 

  3. Bar, Y., Levy, N., Wolf, L.: Classification of artistic styles using binarized features derived from a deep neural network. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8925, pp. 71–84. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16178-5_5

    Chapter  Google Scholar 

  4. Chan-Ley, M., Olague, G.: Categorization of digitized artworks by media with brain programming. Appl. Opt. 59(14), 4437–4447 (2020)

    Article  Google Scholar 

  5. Goodfellow, I.J., Shlens, J., Szegedy, C.: Explaining and harnessing adversarial examples. In: 3rd International Conference on Learning Representations, ICLR 2015, Conference Track Proceedings p. 11 (2015)

    Google Scholar 

  6. Hernández, D.E., Clemente, E., Olague, G., Briseño, J.L.: Evolutionary multi-objective visual cortex for object classification in natural images. J. Comput. Sci. 17, 216–233 (2016). https://doi.org/10.1016/j.jocs.2015.10.011

    Article  Google Scholar 

  7. Johnson, C.R., et al.: Image processing for artist identification. IEEE Signal Process. Mag. 25(4), 37–48 (2008)

    Article  Google Scholar 

  8. Keren, D.: Painter identification using local features and naive bayes. In: Object Recognition Supported by User Interaction for Service Robots, vol. 2, pp. 474–477. IEEE (2002)

    Google Scholar 

  9. Kowaliw, T., McCormack, J., Dorin, A.: Evolutionary automated recognition and characterization of an individual’s artistic style. In: IEEE Congress on Evolutionary Computation, pp. 1–8. IEEE (2010)

    Google Scholar 

  10. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 25, pp. 1097–1105. Curran Associates, Inc. (2012). http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf

  11. Kurakin, A., Goodfellow, I.J., Bengio, S.: Adversarial machine learning at scale. In: ICLR 2017 Conference Track Proceedings 5th International Conference on Learning Representations, p. 17 (2017)

    Google Scholar 

  12. LeCun, Y., et al.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)

    Article  Google Scholar 

  13. Li, J., Wang, J.Z.: Studying digital imagery of ancient paintings by mixtures of stochastic models. IEEE Trans. Image Process. 13(3), 340–353 (2004)

    Article  Google Scholar 

  14. Olague, G., Clemente, E., Hernández, D.E., Barrera, A., Chan-Ley, M., Bakshi, S.: Artificial visual cortex and random search for object categorization. IEEE Access 7, 54054–54072 (2019)

    Article  Google Scholar 

  15. Olague, G., Chan-Ley, M.: Hands-on artificial evolution through brain programming. In: Banzhaf, W., Goodman, E., Sheneman, L., Trujillo, L., Worzel, B. (eds.) Genetic Programming Theory and Practice XVII. GEC, pp. 227–253. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39958-0_12

    Chapter  Google Scholar 

  16. Olague, G., Hernández, D.E., Llamas, P., Clemente, E., Briseño, J.L.: Brain programming as a new strategy to create visual routines for object tracking. Multimed. Tools Appl. 78(5), 5881–5918 (2018). https://doi.org/10.1007/s11042-018-6634-9

    Article  Google Scholar 

  17. Yang, H., Min, K.: Classification of basic artistic media based on a deep convolutional approach. Visual Comput. 36(3), 559–578 (2019). https://doi.org/10.1007/s00371-019-01641-6

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Olague, G., Ibarra-Vázquez, G., Chan-Ley, M., Puente, C., Soubervielle-Montalvo, C., Martinez, A. (2020). A Deep Genetic Programming Based Methodology for Art Media Classification Robust to Adversarial Perturbations. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2020. Lecture Notes in Computer Science(), vol 12509. Springer, Cham. https://doi.org/10.1007/978-3-030-64556-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-64556-4_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-64555-7

  • Online ISBN: 978-3-030-64556-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics