Modelling Temporal Structures in Video Event Retrieval using an AND-OR Graph

Modelling Temporal Structures in Video Event Retrieval using an AND-OR Graph

de Boer, M.H.T.
Escher, C.
Schutte, K.

2017

One of the challenges in Video Event Retrieval, the field in which (a sequence of frames with) high-level events are retrieved from a set of videos, is to model the temporal structure. One way to incorporate this information is using ANDOR graphs, which is a type of graphical model consisting of layers with AND nodes and OR nodes. We introduce new nodes, such as the BEFORE and WHILE node, for AND-OR graphs to explicitly model temporal information. The advantage of these nodes is that the graph is insightful and transparent for a user. Additionally, the graph can both be created by a user or with the use of training examples. We perform initial experiments on a video surveillance dataset named VIRAT, which contains temporally inverse events with the same concepts, such as entering and exiting a building. We compare performance to state of the art Support Vector Machine and Hidden Markov Model methods. We show that our proposed graph with WHILE and BEFORE nodes outperforms the state of the art methods.

2016 ICT 2015 Observation, Weapon & Protection Systems
II - Intelligent Imaging DSY - Data Systems II - Intelligent Imaging
Temporal Information
Event Retrieval
AND-OR Graph

http://resolver.tudelft.nl/uuid:6ddb7786-3302-4711-8ee0-92972ecd3716

868827

MMEDIA 2017 : The Ninth International Conferences on Advances in Multimedia

conference paper