Title
Applying Semantic Reasoning in Image Retrieval
Author
de Boer, M.H.T.
Daniele, L.M.
Brandt, P.
Sappelli, M.
Publication year
2015
Abstract
Abstract—With the growth of open sensor networks, multiple applications in different domains make use of a large amount of sensor data, resulting in an emerging need to search semantically over heterogeneous datasets. In semantic search, an important challenge consists of bridging the semantic gap between the high-level natural language query posed by the users and the low-level sensor data. In this paper, we show that state-of-the-art techniques in Semantic Modelling, Computer Vision and Human Media Interaction can be combined to apply semantic reasoning in the field of image retrieval. We propose a system, GOOSE, which is a general-purpose search engine that allows users to pose natural language queries to retrieve corresponding images. User queries are interpreted using the Stanford Parser, semantic rules and the Linked Open Data source ConceptNet. Interpreted queries are presented to the user as an intuitive and insightful graph in order to collect feedback that is used for further reasoning and system learning. A smart results ranking and retrieval algorithm allows for fast and effective retrieval of images.
Subject
Observation, Weapon & Protection Systems ICT
II - Intelligent Imaging BIS - Business Information Services MNS - Media & Network Services
TS - Technical Sciences
Infostructures
Informatics
Information Society
Semantics
Natural language queries
Semantic reasoning
Image retrieval
Ranking
To reference this document use:
http://resolver.tudelft.nl/uuid:41a2d0f5-20c8-4d29-8646-667510859c59
TNO identifier
528346
Source
Proceedings of the First International Conference on Big Data, Small Data, Linked Data and Open Data, ALLDATA 2015, 19-24 April 2015, Barcelona, Spain, 69-74
Bibliographical note
Conferentie Best Paper Award
Document type
conference paper