Skip to main content

Grammar Guided Genetic Programming for Flexible Neural Trees Optimization

  • Conference paper
Book cover Advances in Knowledge Discovery and Data Mining (PAKDD 2007)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4426))

Included in the following conference series:

Abstract

In our previous studies, Genetic Programming (GP), Probabilistic Incremental Program Evolution (PIPE) and Ant Programming (AP) have been used to optimal design of Flexible Neural Tree (FNT). In this paper Grammar Guided Genetic Programming (GGGP) was employed to optimize the architecture of FNT model. Based on the pre-defined instruction sets, a flexible neural tree model can be created and evolved. This framework allows input variables selection, over-layer connections and different activation functions for the various nodes involved. The free parameters embedded in the neural tree are optimized by particle swarm optimization algorithm. Empirical results on stock index prediction problems indicate that the proposed method is better than the neural network and genetic programming forecasting models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zhang, B.T., et al.: Evolutionary induction of sparse neural trees. Evolutionary Computation 5, 213–236 (1997)

    Article  MATH  Google Scholar 

  2. Koza, J.R.: Genetic Programming. On the Programming of Computers by Natural Selection. MIT Press, Cambridge (1992)

    MATH  Google Scholar 

  3. Nguyen, X.H.: A Flexible Representation for Genetic Programming: Lessons from Natural Language Processing. PhD Thesis, University of New South Wales, Australia, pp. 7–29 (2004)

    Google Scholar 

  4. Shan, Y., et al.: Grammar model based program evolution. In: Proceedings of The Congress on Evolutionary Computation, Portland, USA, IEEE Computer Society Press, Los Alamitos (2004)

    Google Scholar 

  5. Wong, M.L., Leung, K.S.: An Adaptive Inductive Logic Programming System using Genetic Programming. In: Proceedings of the Fourth Annual Conference on Evolutionary Programming, pp. 737–752. MIT Press, Cambridge (1995)

    Google Scholar 

  6. Ross, B.J.: The Evolution of Stochastic Regular Motifs for Protein Sequences. New Generation Computing 20(2), 187–213 (2002)

    Article  MATH  Google Scholar 

  7. Mizoguchi, J., et al.: Production Genetic Algorithms for Automated Hardware Design through Evolutionary Process. In: Proceedings of the First IEEE Conference on Evolutionary Computation, pp. 85–90. IEEE Computer Society Press, Los Alamitos (1994)

    Google Scholar 

  8. Whigham, P.A.: Grammatically-Based Genetic Programming. In: Proceedings of the Workshop on Genetic Programming. From Theory to Real-World Applications, pp. 33–41. Morgan Kaufmann, San Francisco (1995)

    Google Scholar 

  9. Whigham, P.A.: Inductive bias and genetic programming. In: Proc. of First International Conference on Genetic Algorithms in Engineering Systems: Innovations and Applications, UK, September 1995, pp. 461–466. IEE (1995)

    Google Scholar 

  10. Wong, M.L., Leung, K.S.: An Adaptive Inductive Logic Programming System using Genetic Programming. In: Proceedings of the Fourth Annual Conference on Evolutionary Programming, pp. 737–752. MIT Press, Cambridge (1995)

    Google Scholar 

  11. Chen, Y., Yang, Y., Dong, J.: Nonlinear System Modeling via Optimal Design of Neural Trees. Int. J. of Neural Systems 14(2), 125–137 (2004)

    Article  Google Scholar 

  12. Chen, Y., et al.: Hybrid Methods for Stock Index Modeling. In: Wang, L., Jin, Y. (eds.) FSKD 2005. LNCS (LNAI), vol. 3614, pp. 1067–1070. Springer, Heidelberg (2005)

    Google Scholar 

  13. Chen, Y., et al.: Time-Series Forecasting using Flexible Neural Tree Model. Information Science 174(3-4), 219–235 (2005)

    Article  MathSciNet  Google Scholar 

  14. Chen, Y., Yang, B., Dong, J.: Evolving Flexible Neural Networks using Ant Programming and PSO algorithm. In: Yin, F.-L., Wang, J., Guo, C. (eds.) ISNN 2004. LNCS, vol. 3173, pp. 211–216. Springer, Heidelberg (2004)

    Google Scholar 

  15. Antonisse, H.J.: A Grammar-Based Genetic Algorithm. In: Rawlins, G.J.E. (ed.) Foundations of Genetic Algorithms, Morgan Kaufmann, San Francisco (1991)

    Google Scholar 

  16. Stefanski, P.A.: Genetic Programming Using Abstract Syntax Trees. Notes from the Genetic Programming Workshop (ICGA 93) (1993)

    Google Scholar 

  17. Abraham, A., Nath, B., Mahanti, P.K.: Hybrid Intelligent Systems for Stock Market Analysis. In: Alexandrov, V.N., et al. (eds.) ICCS-ComputSci 2001. LNCS, vol. 2074, pp. 337–345. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  18. Nasdaq Stock MarketSM: http://www.nasdaq.com

  19. National Stock Exchange of India Limited: http://www.nse-india.com

  20. Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proc. IEEE int’l conf. on neural networks vol. IV, pp. 1942–1948. IEEE Computer Society Press, Los Alamitos (1995)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Zhi-Hua Zhou Hang Li Qiang Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer Berlin Heidelberg

About this paper

Cite this paper

Wu, P., Chen, Y. (2007). Grammar Guided Genetic Programming for Flexible Neural Trees Optimization. In: Zhou, ZH., Li, H., Yang, Q. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2007. Lecture Notes in Computer Science(), vol 4426. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71701-0_108

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-71701-0_108

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-71700-3

  • Online ISBN: 978-3-540-71701-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics