Title
Multisensory memory for object identity and location
Author
van Erp, J.B.F.
Philippi, T.G.
Werkhoven, P.J.
Contributor
Duriez, C. (editor)
Auvray, M. (editor)
Publication year
2014
Abstract
Researchers have reported that audiovisual object presentation improves memory encoding of object identity in comparison to either auditory or visual object presentation. However, multisensory memory effects on retrieval, on object location, and of other multisensory combinations are yet unknown. We investigated the effects of visuotactile presentation on the encoding and retrieval of object identity memory and object location memory. Participants played an electronic memory card game consisting of an encoding and retrieval phase. In the encoding phase (c) they explored four game cards, which were presented on a computer screen in a two by two arrangement. Participants could touch each card to experience a Morse code presented on the screen (V) and/or via a tactile vibrator attached to the participant’s index finger (T). In the retrieval phase (r), they had to indicate for eight cards if (recognition) and where (relocation) these had been presented earlier. Compared with the visual base line (cV-rV), we found that both ‘multisensory encoding’ (cVT-rV) and ‘multisensory retrieval’ (cV-rVT) significantly improved both recognition and relocation performance. Compared with the tactile base line (cT-rT), we found no multisensory encoding or retrieval effects. This means that vision can benefit from adding touch but not vice versa. We conclude that visuotactile presentation improves memory encoding and retrieval of object identity and location. However, it is not yet clear whether these benefits are due to multisensory integration or simply due to the processing of the same information in multiple sensory modalities.
Subject
Human Performances
PCS - Perceptual and Cognitive Systems
ELSS - Earth, Life and Social Sciences
Cognition
Memory
Multimodal
Multisensory
Tactile
Visuotactile
Computer games
Data storage equipment
Neurology
Signaling
Touch screens
Vibrotactile aids
Cognition
Multi-modal
Multisensory
Tactile
Visuotactile
Encoding (symbols)
To reference this document use:
http://resolver.tudelft.nl/uuid:37c9ee91-9a2d-4b1d-a31a-bd27afc73271
DOI
https://doi.org/10.1007/978-3-662-44193-0_22
TNO identifier
520196
Publisher
Springer Verlag
ISBN
9783662441923
ISSN
0302-9743
Source
9th International Conference on Haptics: Neuroscience, Devices, Modeling, and Applications, EuroHaptics 2014; Versailles; France; 24 June 2014 through 26 June 2014, 8618, 169-176
Series
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Document type
conference paper