Skip to main content

Genetic Programming: Biologically Inspired Computation That Creatively Solves Non-trivial Problems

  • Conference paper

Part of the book series: Natural Computing Series ((NCS))

Abstract

This paper describes a biologically inspired domain-independent technique, called genetic programming, that automatically creates computer programs to solve problems. Starting with a primordial ooze of thousands of randomly created computer programs, genetic programming progressively breeds a population of computer programs over a series of generations using the Darwinian principle of natural selection, recombination (crossover), mutation, gene duplication, gene deletion, and certain mechanisms of developmental biology. The technique is illustrated by its application to a non-trivial problem involving the automatic synthesis (design) of a lowpass filter circuit. The evolved results are competitive with human-produced solutions to the problem. In fact, four of the automatically created circuits exhibit human-level creativity and inventiveness, as evidenced by the fact that they correspond to four inventions that were patented between 1917 and 1936.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aaserud, O. and Nielsen, I. Ring. 1995. Trends in current analog design: a panel debate. Analog Integrated Circuits and Signal Processing. 7(1), 5–9.

    Article  Google Scholar 

  2. Andre, David and Koza, John R. 1996. Parallel genetic programming: a scalable implementation using the transputer architecture. In Angeline, Peter J. and Kinnear, Kenneth E. Jr. (editors). 1996. Advances in Genetic Programming 2. Cambridge, MA: MIT Press.

    Google Scholar 

  3. Angeline, Peter J. and Kinnear, Kenneth E. Jr. (editors). 1996. Advances in Genetic Programming 2. Cambridge, MA: MIT Press.

    Google Scholar 

  4. Bäck, Thomas (editor). 1997. Genetic Algorithms: Proceedings of the Seventh International Conference. San Francisco, CA: Morgan Kaufmann.

    Google Scholar 

  5. Banzhaf, Wolfgang; Nordin, Peter; Keller, Robert E.; and Francone, Frank D. 1998a. Genetic Programming — An Introduction. San Francisco, CA: Morgan Kaufmann.

    MATH  Google Scholar 

  6. Banzhaf, Wolfgang; Poli, Riccardo; Schoenauer, Marc; and Fogarty, Terence C. 1998b. Genetic Programming: First European Workshop. EuroGP′98. Paris, France, April 1998 Proceedings. Lecture Notes in Computer Science. Volume 1391. Heidelberg: Springer-Verlag.

    Google Scholar 

  7. Black, Harold S. 1977. Inventing the negative feedback amplifier. IEEE Spectrum. December, pp. 55–60.

    Google Scholar 

  8. Campbell, George A. 1917. Electric Wave Filter. U.S. Patent 1,227,113. Filed July 15, 1915. Issued May 22, 1917.

    Google Scholar 

  9. Cauer, Wilhelm. 1934. Artificial Network. U.S. Patent 1,958,742. Filed June 8, 1928 in Germany. Filed December 1, 1930 in United States. Issued May 15, 1934.

    Google Scholar 

  10. Cauer, Wilhelm. 1935. Electric Wave Filter. U.S. Patent 1,989,545. Filed June 8, 1928 in Germany. Filed December 6, 1930 in United States. Issued January 29, 1935.

    Google Scholar 

  11. Cauer, Wilhelm. 1936. Unsymmetrical Electric Wave Filter. Filed November 10, 1932 in Germany. Filed November 23, 1933 in United States. Issued July 21, 1936.

    Google Scholar 

  12. Gen, Mitsuo and Cheng, Runwei. 1997. Genetic Algorithms and Engineering Design. New York, NY: John Wiley and Sons.

    Google Scholar 

  13. Goldberg, David E. 1989a. Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley.

    MATH  Google Scholar 

  14. Holland, John H. 1975. Adaptation in Natural and Artificial Systems. Ann Arbor, MI: University of Michigan Press.

    Google Scholar 

  15. Johnson, Kenneth S. 1926. Electric-Wave Transmission. U.S. Patent 1,611,916. Filed March 9, 1923. Issued December 28, 1926.

    Google Scholar 

  16. Johnson, Walter C. 1950. Transmission Lines and Networks. New York, NY: McGraw-Hill.

    Google Scholar 

  17. Kinnear, Kenneth E. Jr. (editor). 1994. Advances in Genetic Programming. Cambridge, MA: MIT Press.

    Google Scholar 

  18. Koza, John R. 1992. Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press.

    MATH  Google Scholar 

  19. Koza, John R. 1994a. Genetic Programming II: Automatic Discovery of Reusable Programs. Cambridge, MA: MIT Press.

    MATH  Google Scholar 

  20. Koza, John R. 1994b. Genetic Programming II Videotape: The Next Generation. Cambridge, MA: MIT Press.

    Google Scholar 

  21. Koza, John R. 1995. Evolving the architecture of a multi-part program in genetic programming using architecture-altering operations. In McDonnell, John R., Reynolds, Robert G., and Fogel, David B. (editors). 1995. Evolutionary Programming IV: Proceedings of the Fourth Annual Conference on Evolutionary Programming. Cambridge, MA: MIT Press, pp. 695–717.

    Google Scholar 

  22. Koza, John R.; Banzhaf, Wolfgang; Chellapilla, Kumar; Deb, Kalyanmoy; Dorigo, Marco; Fogel, David B.; Garzon, Max H.; Goldberg, David E.; Iba, Hitoshi; and Riolo, Rick L. (editors). Genetic Programming 1998: Proceedings of the Third Annual Conference, July 22–25, 1998, University of Wisconsin, Madison, Wisconsin. San Francisco, CA: Morgan Kaufmann.

    Google Scholar 

  23. Koza, John R.; Bennett III, Forrest H; Andre, David; and Keane, Martin A. 1999. Genetic Programming III: Darwinian Invention and Problem Solving. San Francisco, CA: Morgan Kaufmann.

    MATH  Google Scholar 

  24. Koza, John R.; Deb, Kalyanmoy; Dorigo, Marco; Fogel, David B.; Garzon, Max; Iba, Hitoshi; and Riolo, Rick L. (editors). 1997. Genetic Programming 1997: Proceedings of the Second Annual Conference. San Francisco, CA: Morgan Kaufmann.

    Google Scholar 

  25. Koza, John R.; Goldberg, David E.; Fogel, David B.; and Riolo, Rick L. (editors). 1996. Genetic Programming 1996: Proceedings of the First Annual Conference. Cambridge, MA: MIT Press.

    Google Scholar 

  26. Koza, John R., and Rice, James P. 1992. Genetic Programming: The Movie. Cambridge, MA: MIT Press.

    Google Scholar 

  27. Michalewicz, Zbigniew. 1996. Genetic Algorithms + Data Structures = Evolution Programs, 3rd edition. Springer-Verlag.

    Google Scholar 

  28. Mitchell, Melanie. 1996. An Introduction to Genetic Algorithms. Cambridge, MA: MIT Press.

    Google Scholar 

  29. Ohno, Susumu. 1970. Evolution by Gene Duplication. New York, NY: Springer-Verlag.

    Google Scholar 

  30. Quarles, Thomas; Newton, A. R.; Pederson, D. O.; and Sangiovanni-Vincentelli, A. 1994. SPICE 3 Version 3F5 User’s Manual. Department of Electrical Engineering and Computer Science, University of California, Berkeley, CA. March 1994.

    Google Scholar 

  31. Samuel, Arthur L. 1959. Some studies in machine learning using the game of checkers. IBM Journal of Research and Development. 3(3): 210–229.

    Article  Google Scholar 

  32. Samuel, Arthur L. 1983. AI: Where it has been and where it is going. Proceedings of the Eighth International Joint Conference on Artificial Intelligence. Los Altos, CA: Morgan Kaufmann, pp. 1152–1157.

    Google Scholar 

  33. Spector, Lee; Langdon, William B.; O’Reilly, Una-May; and Angeline, Peter (editors). 1999. Advances in Genetic Programming 3. Cambridge, MA: MIT Press.

    Google Scholar 

  34. Van Valkenburg, M. E. 1982. Analog Filter Design. Fort Worth, TX: Harcourt Brace Jovanovich.

    Google Scholar 

  35. Williams, Arthur B. and Taylor, Fred J. 1995. Electronic Filter Design Handbook, 3rd Edition. New York, NY: McGraw-Hill.

    Google Scholar 

  36. Zobel, Otto Julius. 1925. Wave filter. Filed January 15, 1921. U.S. Patent 1,538,964 Issued May 26, 1925.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Koza, J.R., Bennett, F.H., Andre, D., Keane, M.A. (2002). Genetic Programming: Biologically Inspired Computation That Creatively Solves Non-trivial Problems. In: Landweber, L.F., Winfree, E. (eds) Evolution as Computation. Natural Computing Series. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-55606-7_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-55606-7_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-63081-1

  • Online ISBN: 978-3-642-55606-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics