Title
Evaluation of detection and tracking performance in imaging systems
Author
Huizinga, W.
van Opbroek, A.G.
Raimon, H.R.
Pruim, R.H.R.
den Hollander, R.J.M.
van den Broek, S.P.
van den Schook, E.S.
Schutte, K.
van den Stap, N.
Dijk, J.
Publication year
2019
Abstract
Imaging systems can be used to obtain situational awareness in maritime situations. Important tools for these systems are automatic detection and tracking of objects in the acquired imagery, in which numerous methods are being developed. When designing a detection or tracking algorithm, its quality should be ensured by a comparison with existing algorithms and/or with a ground truth. Detection and tracking methods are often designed for a specific task, so evaluation with respect to this task is crucial, which demands for different evaluation measures for different tasks. We, therefore, propose a variety of quantitative measures for the performance evaluation of detectors and trackers for a variety of tasks. The proposed measures are a rich set from which an algorithm designer can choose in order to optimally design and assess a detection or tracking algorithm for a specific task. We compare these different evaluation measures by using them to assess detection and tracking quality in different maritime detection and tracking situations, obtained from three real-life infrared video data sets. With the proposed set of evaluation measures, a user is able to quantitatively assess the performance of a detector or tracker, which enables an optimal design for his approach.
Subject
Defence Research
Defence, Safety and Security
Evaluation
Detection
Tracking
Electro-optical systems
Measures
Machine vision
To reference this document use:
http://resolver.tudelft.nl/uuid:485e7d70-e737-4d83-a28b-903c3c50d914
TNO identifier
867959
Source
Optical Engineering, 58 (7)
Document type
article