Toward a Methodology for the Verification and Validation of AI-Based Systems
conference paper
Verification and validation (V&V) is the cornerstone of safety in the automotive industry. The V&V process ensures that every component in a vehicle functions according to its specifications. Automated driving functionality poses considerable challenges to the V&V process, especially when data-driven AI components are present in the system. The aim of this work is to outline a methodology for V&V of AI-based systems. The backbone of this methodology is bridging the semantic gap between the symbolic level at which the operational design domain and requirements are typically specified, and the sub-symbolic, statistical level at which data-driven AI components function. This is accomplished by combining a probabilistic model of the operational design domain and an FMEA of AI with a fitness-for-purpose model of the system itself. The fitness-for-purpose model allows for reasoning about the behavior of the system in its environment, which we argue is essential to determine whether the system meets its requirements. While this work only provides an outline of such a methodology, we point out future research directions toward a full methodology for the V&V of AI-based systems.
Topics
TNO Identifier
998279
ISSN
2574-0741
2574-075X
2574-075X
Source
SAE International Journal of Connected and Automated Vehicles, 8(1)
Publisher
SAE Mobilus
Article nr.
12-08-01-0006
Files
To receive the publication files, please send an e-mail request to TNO Repository.