Title
Telling autonomous systems what to do
Author
Werkhoven, P.
Kester, L.
Neerincx, M.
Publication year
2018
Abstract
Recent progress in Artificial Intelligence, sensing and network technology, robotics, and (cloud) computing has enabled the development of intelligent autonomous machine systems. Telling such autonomous systems "what to do" in a responsible way, is a non-trivial task. For intelligent autonomous machines to function in human society and collaborate with humans, we see three challenges ahead affecting meaningful control of autonomous systems. First, autonomous machines are not yet capable of handling failures and unexpected situations. Providing procedures for all possible failures and situations is unfeasible because the state-action space would explode. Machines should therefore become self-aware (self-assessment, self-management) enabling them to handle unexpected situations when they arise. This is a challenge for the computer science community. Second, in order to keep (meaningful) control, humans come into a new role of providing intelligent autonomous machines with objectives or goal functions (including rules, norms, constraints and moral values), specifying the utility of every possible outcome of actions of autonomous machines. Third, in order to be able to collaborate with humans, autonomous systems will require an understanding of (us) humans (i.e., our social, cognitive, affective and physical behaviors) and the ability to engage in partnership interactions (such as explanations of task performances, and the establishment of joint goals and work agreements). These are new challenges for the cognitive ergonomics community. © 2018 ACM.
Subject
Control
Cognitive systems
Control engineering
Distributed computer systems
Autonomous machines
Autonomous systems
Cognitive ergonomics
Network technologies
Non-trivial tasks
Physical behaviors
Science community
Task performance
Ergonomics
To reference this document use:
http://resolver.tudelft.nl/uuid:543b3279-9b13-4e5b-bbfa-3fb4a0187364
DOI
https://doi.org/10.1145/3232078.3232238
TNO identifier
843133
Publisher
Association for Computing Machinery
ISBN
9781450364492
Source
ACM International Conference Proceeding Series : 36th European Conference on Cognitive Ergonomics, ECCE 2018, 5 September 2018 through 7 September 2018
Article number
2
Document type
conference paper