Title
Automatic analysis of online image data for law enforcement agencies by concept detection and instance search
Author
de Boer, M.H.T.
Bouma, H.
Kruithof, M.C.
ter Haar, F.B.
Fischer, N.M.
Hagendoorn, L.K.
Joosten, B.
Raaijmakers, S.
Publication year
2017
Abstract
The information available on-line and off-line, from open as well as from private sources, is growing at an exponential rate and places an increasing demand on the limited resources of Law Enforcement Agencies (LEAs). The absence of appropriate tools and techniques to collect, process, and analyze the volumes of complex and heterogeneous data has created a severe information overload. If a solution is not found, the impact on law enforcement will be dramatic, e.g. because important evidence is missed or the investigation time is too long. Furthermore, there is an uneven level of capabilities to deal with the large volumes of complex and heterogeneous data that come from multiple open and private sources at national level across the EU, which hinders cooperation and information sharing. Consequently, there is a pertinent need to develop tools, systems and processes which expedite online investigations. In this paper, we describe a suite of analysis tools to identify and localize generic concepts, instances of objects and logos in images, which constitutes a significant portion of everyday law enforcement data. We describe how incremental learning based on only a few examples and large-scale indexing are addressed in both concept detection and instance search. Our search technology allows querying of the database by visual examples and by keywords. Our tools are packaged in a Docker container to guarantee easy deployment on a system and our tools exploit possibilities provided by open source toolboxes, contributing to the technical autonomy of LEAs.
Subject
2016 ICT 2015 Observation, Weapon & Protection Systems
DSC - Data Science II - Intelligent Imaging
TS - Technical Sciences
Cyber Security & Resilience
Informatics
Defence, Safety and Security
Concept detection
Instance search
Logo recognition
Incremental learning
Large scale indexing
Open source software
Law Enforcement Agency (LEA).
To reference this document use:
http://resolver.tudelft.nl/uuid:5a83ddd3-6fb7-48f7-93f2-92fa68cc3889
TNO identifier
781160
Source
Proc. SPIE, Vol. 10441, (2017)
Document type
conference paper