Skip to main content

Feedback-Based Coverage Directed Test Generation: An Industrial Evaluation

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 6504))

Abstract

Although there are quite a few approaches to Coverage Directed test Generation aided by Machine Learning which have been applied successfully to small and medium size digital designs, it is not clear how they would scale on more elaborate industrial-level designs. This paper evaluates one of these techniques, called MicroGP, on a fully fledged industrial design. The results indicate relative success evidenced by a good level of code coverage achieved with reasonably compact tests when compared to traditional test generation approaches. However, there is scope for improvement especially with respect to the diversity of the tests evolved.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. ITRS, International Technology Roadmap for Semiconductors, Design Chapter, 2008 edn. (2008)

    Google Scholar 

  2. Squillero, G.: MicroGP—An Evolutionary Assembly Program Generator. Genetic Programming and Evolvable Machines 6, 247–263 (2005)

    Article  Google Scholar 

  3. Piziali, A.: Functional verification coverage measurement and analysis. Springer, Berlin (2007)

    Google Scholar 

  4. Corno, F., Squillero, G., Reorda, M.S.: Code Generation for Functional Validation of Pipelined Microprocessors. In: Proceedings of the 8th IEEE European Test Workshop, p. 113. IEEE Computer Society, Los Alamitos (2003)

    Google Scholar 

  5. Corno, F., Cumani, G., Squillero, G.: Exploiting Auto-adaptive μGP for Highly Effective Test Programs Generation. In: Tyrrell, A.M., Haddow, P.C., Torresen, J. (eds.) ICES 2003. LNCS, vol. 2606, pp. 262–273. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  6. Corno, F., Cumani, G., Reorda, M.S., Squillero, G.: Fully Automatic Test Program Generation for Microprocessor Cores. In: Proceedings of the conference on Design, Automation and Test in Europe, vol. 1, pp. 1006–1011. IEEE Computer Society, Los Alamitos (2003)

    Google Scholar 

  7. Corno, F., Sánchez, E., Reorda, M.S., Squillero, G.: Automatic Test Program Generation: A Case Study. IEEE Design & Test of Computers 21, 102–109 (2004)

    Article  Google Scholar 

  8. Corno, F., Cumani, G., Reorda, M.S., Squillero, G.: Automatic test program generation for pipelined processors. In: Proceedings of the 2003 ACM Symposium on Applied Computing, Melbourne, pp. 736–740. ACM, Florida (2003)

    Chapter  Google Scholar 

  9. Politechnico di Torino : Research: MicroGP (November 2007), http://www.cad.polito.it/research/microgp.html (accessed 2010-03-14)

  10. Ur, S., Yadin, Y.: Micro architecture coverage directed generation of test programs. In: Proceedings of the 36th Annual ACM/IEEE Design Automation Conference, pp. 175–180. ACM, New Orleans (1999)

    Google Scholar 

  11. Bose, M., Shin, J., Rudnick, E.M., Dukes, T., Abadir, M.: A genetic approach to automatic bias generation for biased random instruction generation, pp. 442-448 (2001)

    Google Scholar 

  12. Tasiran, S., Fallah, F., Chinnery, D.G., Weber, S.J., Keutzer, K.: A functional validation technique: Biased-random simulation guided by observability-based coverage. Institute of Electrical and Electronics Engineers Inc., pp. 82-88 (2001)

    Google Scholar 

  13. Ashlock, D.: Evolutionary Computation for Modeling and Optimization. Springer, Heidelberg (2005)

    MATH  Google Scholar 

  14. Koza, J.R.: Evolution and co-evolution of computer programs to control independently-acting agents. In: Proceedings of the first International Conference on Simulation of Adaptive Behavior on From Animals to Animats, pp. 366–375. MIT Press, Paris (1990)

    Google Scholar 

  15. Bernardi, P., Christou, K., Grosso, M., Michael, M.K., Sanchez, E., Reorda, M.S.: Exploiting MOEA to automatically generate test programs for path-delay faults in microprocessors, pp. 224–234. Springer, Heidelberg (2008)

    Google Scholar 

  16. Ravotto, D., Sanchez, E., Schillaci, M., Squillero, G.: An evolutionary methodology for test generation for peripheral cores via dynamic FSM extraction, pp. 214–223. Springer, Heidelberg (2008)

    Google Scholar 

  17. Ravotto, D., Sanchez, E., Schillaci, M., Squillero, G.: An evolutionary methodology for test generation for peripheral cores via dynamic FSM extraction, pp. 214–223. Springer, Heidelberg (2008)

    Google Scholar 

  18. Robinson, D.: Aspect-Oriented Programming with the e Verification Language: A Pragmatic Guide for Testbench Developers. Morgan Kaufmann, San Francisco (2007)

    MATH  Google Scholar 

  19. Sanchez, E., Schillaci, M., Squillero, G.: Evolutionary Optimization: the μGP toolkit. Springer, Heidelberg (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ioannides, C., Barrett, G., Eder, K. (2011). Feedback-Based Coverage Directed Test Generation: An Industrial Evaluation. In: Barner, S., Harris, I., Kroening, D., Raz, O. (eds) Hardware and Software: Verification and Testing. HVC 2010. Lecture Notes in Computer Science, vol 6504. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19583-9_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19583-9_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19582-2

  • Online ISBN: 978-3-642-19583-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics