Testing Web Enabled Simulation at Scale Using Metamorphic Testing
Created by W.Langdon from
gp-bibliography.bib Revision:1.8098
- @InProceedings{Ahlgren:2021:ICSE,
-
author = "John Ahlgren and Maria Eugenia Berezin and
Kinga Bojarczuk and Elena Dulskyte and Inna Dvortsova and
Johann George and Natalija Gucevska and Mark Harman and
Maria Lomeli and Erik Meijer and Silvia Sapora and
Justin Spahr-Summers",
-
title = "Testing Web Enabled Simulation at Scale Using
Metamorphic Testing",
-
booktitle = "Proceedings of the International Conference on
Software Engineering, ICSE 2021",
-
year = "2021",
-
editor = "Arie {van Deursen} and Tao Xie and
Natalia Juristo Oscar Dieste",
-
pages = "140--149",
-
month = "25-28 " # may,
-
publisher = "IEEE",
-
keywords = "genetic algorithms, genetic programming, Genetic
Improvement, SBSE, Metamorphic Testing, Oracle Problem,
Scalability, Testing, Test Flakiness, Web-Enabled
Simulation",
-
URL = "https://research.fb.com/publications/testing-web-enabled-simulation-at-scale-using-metamorphic-testing/",
-
URL = "https://research.fb.com/wp-content/uploads/2021/03/Testing-Web-Enabled-Simulation-at-Scale-Using-Metamorphic-Testing.pdf",
-
video_url = "https://www.youtube.com/watch?v=pNKqyn-90Ig",
-
DOI = "doi:10.1109/ICSE-SEIP52600.2021.00023",
-
size = "10 pages",
-
abstract = "We report on Facebook deployment of MIA (Metamorphic
Interaction Automaton). MIA is used to test Facebook's
Web Enabled Simulation, built on a web infrastructure
of hundreds of millions of lines of code. MIA tackles
the twin problems of test flakiness and the unknowable
oracle problem. It uses metamorphic testing to automate
continuous integration and regression test execution.
MIA also plays the role of a test bot, automatically
commenting on all relevant changes submitted for code
review. It currently uses a suite of over 40
metamorphic test cases. Even at this extreme scale, a
non-trivial metamorphic test suite subset yields
outcomes within 20 minutes (sufficient for continuous
integration and review processes). Furthermore, our
offline mode simulation reduces test flakiness from
approximately 50percent (of all online tests) to
0percent (offline). Metamorphic testing has been
widely-studied for 22 years. This paper is the first
reported deployment into an industrial continuous
integration system.",
- }
Genetic Programming entries for
John Ahlgren
Maria Eugenia Berezin
Kinga Bojarczuk
Elena Dulskyte
Inna Dvortsova
Johann George
Natalija Gucevska
Mark Harman
Maria Lomeli
Erik Meijer
Silvia Sapora
Justin Spahr-Summers
Citations