Deliverable D7.2: Specifications of the Evaluation Framework
interactIVe has the objective to develop new integrated Advanced Driver Assistance Systems (ADAS). In order to evaluate these systems, an evaluation framework is required. Therefore, a horizontal subproject called “Evaluation and Legal Aspects” is part of interactIVe, with the main objective to provide this framework and give support to the vertical subprojects in their evaluation work. This document outlines the specifications for the evaluation framework on the basis of the requirements as described in D7.1. The framework will be further developed in D7.4 (“Test and evaluation plans”). Based on the use cases from deliverable D1.5 and the requirements from D7.1, hypotheses, indicators and test scenarios are formulated and included in this deliverable D7.2. Evaluation has, as in D7.1, been divided in three main categories: - Technical Assessment evaluates the performance of the developed interactIVe functions and collects information and data for safety impact assessment. - User-Related Assessment assesses the functions from the user perspective, and also to provide further input to the safety impact assessment. - Impact Assessment, estimates how and how much the functions influence traffic safety. This deliverable has further defined the evaluation framework by: - Hypotheses definition based on the research questions of D7.1. The hypotheses are set up in two categories per assessment (technical, user related and impact): o General o System specific (SECONDS, INCA, and EMIC). - Indicator definition based on the hypotheses of this deliverable. The indicators are set up per assessment (technical, user related and impact). - Test scenarios definition based on the use cases defined in D1.5. Summarizing, the outcome of this deliverable is a list of hypotheses, indicators and test cases, which will be used to define specific test plans for the interactIVe functions in D7.4. The current status of the project is that the functions that will be developed in interactIVe are not yet totally outlined. This document has D1.5 (v16, Annex1 v2 and Annex2 v12) and D1.6 (v0998) as a basis. Meanwhile these documents may have been updated to newer versions, which is not dealt with in this version of D7.2 but will be integrated into D7.4 (due in M22). Moreover a process of reviewing the hypotheses and test scenarios by the VSPs has started (M17) and may result in an update of some of the hypotheses, indicators and test scenarios. These will also be part of D7.4. The results of the April 2011 SP workshop have been mostly integrated into this deliverable, further discussion will lead to other changes which will be reported in D7.4.
Reliable Mobility Systems
To reference this document use:
Mechatronics, Mechanics & Materials
IVS - Integrated Vehicle Safety
TS - Technical Sciences
7th Framework Programme, ICT-2009.6.1: ICT for Safety and Energy Efficiency in Mobility, Grant Agreement No. 246587, Large-scale Integrated Project Accident avoidance by active intervention for Intelligent Vehicles