Testing Web Enabled Simulation at Scale Using Metamorphic Testing

Created by W.Langdon from gp-bibliography.bib Revision:1.8120

@InProceedings{Ahlgren:2021:ICSE,

• author = "John Ahlgren and Maria Eugenia Berezin and Kinga Bojarczuk and Elena Dulskyte and Inna Dvortsova and Johann George and Natalija Gucevska and Mark Harman and Maria Lomeli and Erik Meijer and Silvia Sapora and Justin Spahr-Summers",
• title = "Testing Web Enabled Simulation at Scale Using Metamorphic Testing",
• booktitle = "Proceedings of the International Conference on Software Engineering, ICSE 2021",
• year = "2021",
• editor = "Arie {van Deursen} and Tao Xie and Natalia Juristo Oscar Dieste",
• pages = "140--149",
• month = "25-28 " # may,
• publisher = "IEEE",
• keywords = "genetic algorithms, genetic programming, Genetic Improvement, SBSE, Metamorphic Testing, Oracle Problem, Scalability, Testing, Test Flakiness, Web-Enabled Simulation",
• URL = "https://research.fb.com/publications/testing-web-enabled-simulation-at-scale-using-metamorphic-testing/",
• URL = "https://research.fb.com/wp-content/uploads/2021/03/Testing-Web-Enabled-Simulation-at-Scale-Using-Metamorphic-Testing.pdf",
• video_url = "https://www.youtube.com/watch?v=pNKqyn-90Ig",
• DOI = "doi:10.1109/ICSE-SEIP52600.2021.00023",
• size = "10 pages",
• abstract = "We report on Facebook deployment of MIA (Metamorphic Interaction Automaton). MIA is used to test Facebook's Web Enabled Simulation, built on a web infrastructure of hundreds of millions of lines of code. MIA tackles the twin problems of test flakiness and the unknowable oracle problem. It uses metamorphic testing to automate continuous integration and regression test execution. MIA also plays the role of a test bot, automatically commenting on all relevant changes submitted for code review. It currently uses a suite of over 40 metamorphic test cases. Even at this extreme scale, a non-trivial metamorphic test suite subset yields outcomes within 20 minutes (sufficient for continuous integration and review processes). Furthermore, our offline mode simulation reduces test flakiness from approximately 50percent (of all online tests) to 0percent (offline). Metamorphic testing has been widely-studied for 22 years. This paper is the first reported deployment into an industrial continuous integration system.",

}

Genetic Programming entries for John Ahlgren Maria Eugenia Berezin Kinga Bojarczuk Elena Dulskyte Inna Dvortsova Johann George Natalija Gucevska Mark Harman Maria Lomeli Erik Meijer Silvia Sapora Justin Spahr-Summers

Citations