Instantaneous threat detection based on a semantic representation of activities, zones and trajectories

Instantaneous threat detection based on a semantic representation of activities, zones and trajectories

Burghouts, G.J
Schutte, K
ten Hove, R.J.M.
van den Broek, S.P.
Baan, J.
Rajadell, O.
van Huis, J.R.
van Rest, J.H.C.
Hanckmann, P.
Bouma, H.
Sanroma, G.
Evans, M.
Ferryman, J.

2014

Threat detection is a challenging problem, because threats appear in many variations and differences to normal behaviour can be very subtle. In this paper, we consider threats on a parking lot, where theft of a truck’s cargo occurs. The theft takes place in very different forms, in the midst of many people who pose no threat. The threats range from explicit, e.g., a person attacking the truck driver, to implicit, e.g., somebody loitering and then fiddling with the exterior of the truck in order to open it. Our goal is a system that is able to recognize a threat instantaneously as they develop. Typical observables of the threats are a person’s activity, presence in a particular zone, and the trajectory. The novelty of this paper is an encoding of these threat observables in a semantic, intermediate-level representation, based on low-level visual features that have no intrinsic semantic meaning themselves. The semantic representation encodes the notions of trajectories, zones and activities. The aim of this representation is to bridge the semantic gap between the low-level tracks and motion and the higher-level notion of threats. In our experiments, we demonstrate that our semantic representation is more descriptive for threat detection than directly using low-level features. We find that a person’s activities are the most important elements of this semantic representation, followed by the person’s trajectory. The proposed threat detection system is very accurate: 96.6% of the tracks are correctly interpreted, when considering the temporal context. *

TS - Technical Sciences ; ELSS - Earth, Life and Social Sciences
Physics & Electronics ; Resilient Organisations
Defence, Safety and Security
Safety and Security
Threat detection
Video surveillance
Video images
Image processing
Threat observables
Semantic representation
II - Intelligent Imaging ; NO - Networked Organisations ; DSS - Distributed Sensor Systems

http://resolver.tudelft.nl/uuid:362944e4-5853-4835-8f47-be458437945f

https://doi.org/10.1007/s11760-014-0672-1

511410

Springer

Signal Image and Video Processing

article