A Neural-Symbolic Cognitive Agent with a Mind’s Eye

conference paper
The DARPA Mind’s Eye program seeks to develop in machines a capability that currently exists only in animals: visual intelligence. This paper describes a Neural-Symbolic Cognitive Agent that integrates neural learning, symbolic knowledge representation and temporal reasoning in a visual intelligent system that can reason about actions of entities observed in video. Results have shown that the system is able to learn and represent the underlying semantics of the actions from observation and use this for several visual intelligent tasks, like recognition, description, anomaly detection and gap-filling.
TNO Identifier
455447
Source title
Twenty-Sixth Conference on Artificial Intelligence, AAAI 2012 , 22-26 July 2012, Toronto, Ont, Canada