Repository hosted by TU Delft Library

Home · Contact · About · Disclaimer ·
 

Evaluation of detection and tracking performance in imaging systems

Publication files not online:

Author: Huizinga, W. · Opbroek, A.G. van · Raimon H. R. Pruim, R.H.R. · Hollander, R.J.M. den · Broek, S.P. van den · Schook, E.S. van den · Schutte, K. · Stap, N. van den · Dijk, J.
Type:article
Date:2019
Source:Optical Engineering, 7, 58
Identifier: 867959
Keywords: Evaluation · Detection · Tracking · Electro-optical systems · Measures · Machine vision · Defence Research · Defence, Safety and Security

Abstract

Imaging systems can be used to obtain situational awareness in maritime situations. Important tools for these systems are automatic detection and tracking of objects in the acquired imagery, in which numerous methods are being developed. When designing a detection or tracking algorithm, its quality should be ensured by a comparison with existing algorithms and/or with a ground truth. Detection and tracking methods are often designed for a specific task, so evaluation with respect to this task is crucial, which demands for different evaluation measures for different tasks. We, therefore, propose a variety of quantitative measures for the performance evaluation of detectors and trackers for a variety of tasks. The proposed measures are a rich set from which an algorithm designer can choose in order to optimally design and assess a detection or tracking algorithm for a specific task. We compare these different evaluation measures by using them to assess detection and tracking quality in different maritime detection and tracking situations, obtained from three real-life infrared video data sets. With the proposed set of evaluation measures, a user is able to quantitatively assess the performance of a detector or tracker, which enables an optimal design for his approach.