Gregory M. Kapfhammer

Using Synthetic Coverage Information to Evaluate Test Suite Prioritizers

Gregory M. Kapfhammer. Using Synthetic Coverage Information to Evaluate Test Suite Prioritizers. Presented at the Chennai Mathematical Institute, Chennai, India, February 19, 2008.
Related Project: DIATOMS, Kanonizo

Abstract

Regression testing techniques reorder and reduce a test suite in an attempt to ensure that test execution is both efficient and effective. The empirical evaluation of an approach to either test prioritization or reduction often involves the use of software tools to test real-world case study applications. Since many regression testing techniques are coverage-based, this presentation describes a method for using synthetic coverage to experimentally assess test suite prioritizers. As an alternative to directly testing case study applications, the use of automatically generated synthetic coverage supports the systematic evaluation of regression testing schemes. To this end, we present algorithms that automatically generate test coverage and timing information while varying both the amount of coverage overlap and the anticipated difficulty of reordering the test suite. This presentation concludes with an examination of empirical results that measure the efficiency and effectiveness of the synthetic coverage generators.

[PDF]

---

Links to this Page

• Complete News Listing last edited on 21 October 2009 at 5:22 pm by 141.195.226.29
• Research Presentations last edited on 29 October 2009 at 12:30 am by 141.195.226.29
• Using Synthetic Coverage Information to Evaluate Test Suite Prioritizers last edited on 12 June 2008 at 4:56 pm by aldenv29.allegheny.edu