Verification of real-Time Graphics Systems

Abstract

Today, software quality assurance is an important part of software development,where increasingly more research is conducted in order to achieve more efficient and reliable verification processes. However, little progress has been made when it comes to verification of real-time graphics systems. To this day, most verification of such applications is performed through repetitive manual labour, where graphical content is ocularly inspected and subjectively verified. In this thesis, we present the Runtime Graphics Verification Framework (RUGVEF), where we have combined runtime verification with image analysis in order to automate the verification of graphical content. We also provide a proof of concept in the form of a case study, where RUGVEF is evaluated in an industrial setting by verifying CasparCG, an on-air graphics playout system. The results of the case study are five previously unknown defects, together with statistics of previously known defects (which were injected back into the system) that could be detected by our tool.