Title
Recognition and localization of relevant human behavior in videos
Author
Bouma, H.
Burghouts, G.J.
de Penning, H.L.H.
Hanckmann, P.
ten Hove, R.J.M.
Korzec, S.
Kruithof, M.C.
Landsmeer, S.
van Leeuwen, C.J.
van den Broek, S.P.
Halma, A.H.R.
den Hollander, R.J.M.
Schutte, K.
Publication year
2013
Abstract
Ground surveillance is normally performed by human assets, since it requires visual intelligence. However, especially for military operations, this can be dangerous and is very resource intensive. Therefore, unmanned autonomous visual-intelligence systems are desired. In this paper, we present an improved system that can recognize actions of a human and interactions between multiple humans. Central to the new system is our agent-based architecture. The system is trained on thousands of videos and evaluated on realistic persistent surveillance data in the DARPA Mind’s Eye program, with hours of videos of challenging scenes. The results show that our system is able to track the people, detect and localize events, and discriminate between different behaviors, and it performs 3.4 times better than our previous system.
Subject
Visual intelligence
Action recognition
Artificial intelligence
Image retrieval
Computer vision
Safety and Security
Defence, Safety and Security
Physics & Electronics
II - Intelligent Imaging
TS - Technical Sciences
To reference this document use:
http://resolver.tudelft.nl/uuid:5a529002-9805-4f62-8b63-b3e374d0dc3c
DOI
https://doi.org/10.1117/12.2015877
TNO identifier
471229
Publisher
SPIE, Bellingham, WA
Source
Sensors, and Command, Control, Communications, and Intelligence (C3I) Technologies for Homeland Security and Homeland Defense XII, 29 april 2013, Batimore, MD, USA
Series
Proceedings of SPIE
Document type
conference paper