Code coverage criteria and their effect on test suite qualities

Examensarbete för masterexamen

Please use this identifier to cite or link to this item: https://hdl.handle.net/20.500.12380/217038
Download file(s):
File Description SizeFormat 
217038.pdfFulltext1.2 MBAdobe PDFView/Open
Type: Examensarbete för masterexamen
Master Thesis
Title: Code coverage criteria and their effect on test suite qualities
Authors: Kalkov, Mikhail
Pamakha, Dzmitry
Abstract: The efficiency of software testing is often assessed based on the results of code coverage analysis, which is performed using such criteria as function, statement and condition/decision coverage. However, it is not uncommon for a criterion definition to vary between tool vendors and programming languages, which makes any analysis and comparison difficult. Given this uncertainty, one also wonders what evidence exists to support the use of code coverage data as a basis for evaluating test efficiency. In this paper various coverage criteria are analyzed and the reason the majority of them are language-specific is discussed. Following that, a test suite quality model is proposed and used to demonstrate the non-linear relationship between defect detection and coverage levels as well as how code coverage data can be used to minimize a test suite, improve its regression sensitivity or even generate missing test cases. Finally, several coverage analysis tool case studies are done and an implementation of a BullseyeCoverage plug-in for Eclipse C/C++ Development Tools environment is described. This report is concluded with a discussion of open questions, such as the feasibility of precisely specified universal coverage criteria, automated coverage-guided test case generation and an approach to measure coverage of generated source code.
Keywords: Data- och informationsvetenskap;Computer and Information Science
Issue Date: 2013
Publisher: Chalmers tekniska högskola / Institutionen för data- och informationsteknik (Chalmers)
Chalmers University of Technology / Department of Computer Science and Engineering (Chalmers)
URI: https://hdl.handle.net/20.500.12380/217038
Collection:Examensarbeten för masterexamen // Master Theses



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.