Bounded autonomy
bookPart
The aim of this concluding chapter is not so much to summarize what has been stated so well by the authors of the various chapters, but rather to reflect on some common themes that run throughout this book, as well as to highlight some additional issues and research challenges, particularly in the field of Human Factors and Ergonomics (HFE). First, I will address the use of AI in military systems and how this relates to the heated debate on ‘killer robots’. Second, I will discuss the concept of ‘autonomy’ and its use in ‘autonomous weapon systems (AWS)’. I will argue that, just as there is no such thing as ‘rationality’ in humans, only ‘bounded rationality’ (Simon, 1955; 1957), there is no such thing as autonomy in systems, only ‘bounded autonomy’. This then will lead to a discussion of the third concept, that of ‘meaningful human control (MHC)’, which, as will be shown, is closely related to the concept of ‘bounded autonomy’. I will argue that the existence of bounded autonomy makes MHC over military systems possible. In the final section, I will discuss what it could mean to develop AI in a responsible fashion in military systems, which, after all, is the title and main topic of this book.
TNO Identifier
995906
ISBN
9781040033739; 9781032524306
Publisher
CRC Press
Source title
Responsible Use of AI in Military Systems
Editor(s)
Schraagen, J.M.
Place of publication
Boca Raton
Pages
345-370