The Cross-modal Congruency Effect as an Objective Measure of Embodiment

The Cross-modal Congruency Effect as an Objective Measure of Embodiment

Verhagen, P.
Kuling, K.
Gijsbertse,
Stuldreher, I.V.
Overvliet, K.
Falcone, S.
van Erp, J.
Brouwer, A.M.

2020

Remote control of robots generally requires a high level of expertise and may impose a considerable cognitive burden on operators. A sense of embodiment over a remote-controlled robot might enhance operators? task performance and reduce cognitive workload. We want to study the extent to which different factors affect embodiment. As a first step, we aimed to validate the cross-modal congruency effect (CCE) as a potential objective measure of embodiment under four conditions with different, a priori expected levels of embodiment, and by comparing CCE scores with subjective reports. The conditions were (1) a real hand condition (real condition), (2) a real hand seen through a telepresence unit (mediated condition), (3) a robotic hand seen through a telepresence unit (robot condition), and (4) a human-looking virtual hand seen through VR glasses (VR condition). We found no unambiguous evidence that the magnitude of the CCE was affected by the degree of visual realism in each of the four conditions. We neither found evidence to support the hypothesis that the CCE and embodiment score as assessed by the subjective reports are correlated. These findings raise serious concerns about the use of the CCE as an objective measure of embodiment.

Teleoperation
Embodiment
Multisensory integration
Visuotactile integration
Cross-modal congruency effect
Cross-modal congruency task

http://resolver.tudelft.nl/uuid:3e54fc5a-368f-4bbd-a6ff-093f8e8b0863

https://doi.org/10.1145/3395035.3425264

885093

Association for Computing Machinery, Inc

9781450375818

ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction, 22nd ACM International Conference on Multimodal Interaction, ICMI 2020, 25 October 2020 through 29 October 2020, 107-111

conference paper