Test Case Prioritization for Automated Driving Systems: A Cost-Cognizant,Version-Specific, Multi-Objective Black-Box Approach
| dc.contributor.author | KARLSSON, CHRISTOFFER | |
| dc.contributor.department | Chalmers tekniska högskola / Institutionen för data och informationsteknik | sv |
| dc.contributor.examiner | Berger, Christian | |
| dc.contributor.supervisor | Feldt, Robert | |
| dc.date.accessioned | 2019-08-21T12:36:42Z | |
| dc.date.available | 2019-08-21T12:36:42Z | |
| dc.date.issued | 2019 | sv |
| dc.date.submitted | 2019 | |
| dc.description.abstract | Testing and verification of self-driving cars play an important role in ensuring that the vehicles work as intended and that the strict safety requirements are met. Automotive companies are becoming increasingly agile and are adopting the principles of continuous integration, where short feedback loops are essential. Test case prioritization (TCP) techniques can help increase testing efficiency by promoting early fault detection, which enables defects to be found and fixed earlier. This thesis is done at Volvo Car Corporation (VCC), with the aim to investigate the applicability of TCP techniques within the complex autonomous drive verification domain, and to propose a TCP method that can be used in a continuous integration environment. One challenge is that access to historical test data at VCC is limited, as continuous integration has not been fully implemented yet. This is one of the reasons why VCC has developed a system called Verification Data Model and Generator (VeriDaG), which produces a simulated regression test history that is made to mimic the real system in a realistic way. In this way, VCC strives to have a prioritization strategy ready when continuous integration and test automation become fully implemented, as it may otherwise be too late. The thesis is conducted as a case study involving action research. A pre-study is conducted to form the basis of an experiment, in which different TCP techniques are compared. While the results of the thesis indicate that many existing TCP techniques are unsuitable within this domain, there still exist some types of techniques that seem applicable. A proposed black-box TCP method considering multiple factors is implemented and evaluated using the Average Percentage of Faults Detected per Cost (APFDC) metric, which is used to measure the efficiency of TCP techniques. It is black-box in the sense that it does not require access to the source code of the system under test (SUT). Expert-review evaluations are also conducted at the end of the thesis, to get further insights into the usability of the proposed method. Combined evaluation of the proposed method suggests that it can help improve testing efficiency at VCC and likely also at similar companies. | sv |
| dc.identifier.coursecode | DATX05 | sv |
| dc.identifier.uri | https://hdl.handle.net/20.500.12380/300146 | |
| dc.language.iso | eng | sv |
| dc.setspec.uppsok | Technology | |
| dc.subject | testing | sv |
| dc.subject | prioritization | sv |
| dc.subject | TCP | sv |
| dc.subject | RTO | sv |
| dc.subject | value-based | sv |
| dc.subject | software engineering | sv |
| dc.subject | automotive | sv |
| dc.subject | autonomous drive | sv |
| dc.subject | cost-cognizant | sv |
| dc.subject | version-specific | sv |
| dc.subject | multi-objective | sv |
| dc.subject | blackbox | sv |
| dc.title | Test Case Prioritization for Automated Driving Systems: A Cost-Cognizant,Version-Specific, Multi-Objective Black-Box Approach | sv |
| dc.type.degree | Examensarbete för masterexamen | sv |
| dc.type.uppsok | H |