Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy
bookPart
Generative AI presents vast opportunities but also risks. Misuse, whether intentional or not, can lead to significant 'real-world' consequences. We presented subjects (n=139) with five vignettes describing incidents involving generative AI. We explored the relationship between their level of AI literacy, attitude towards AI, trust in AI chatbots, and people's reactions to the vignettes. Attitude and trust, measured before and after the vignettes, declined significantly. However, these changes as well as the reactions to the vignettes were unrelated to AI literacy. Yet, higher AI literacy was associated with more frequent use of AI chatbots, higher trust and more positive attitudes towards AI. So while AI literacy appeared to be related to the general perceptions and usage of generative AI, it was not linked to the evaluation of incidents involving generative AI. The implications for trust calibration and appropriate reliance are discussed. © 2024 The Authors.
TNO Identifier
997666
ISBN
978-164368522-9
Source title
3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI Hybrid Human AI Systems for the Social Good, Malmo 10-12 June 2024
Editor(s)
Lorig, F.
Tucker, J.
Lindstrom, A.D.
Dignum, F.
Murukannaiah, P.
Theodorou, A.
Yolum, P.
Tucker, J.
Lindstrom, A.D.
Dignum, F.
Murukannaiah, P.
Theodorou, A.
Yolum, P.
Pages
188-198