Multisensory memory for object identity and location
conference paper
Researchers have reported that audiovisual object presentation improves memory encoding of object identity in comparison to either auditory or visual object presentation. However, multisensory memory effects on retrieval, on object location, and of other multisensory combinations are yet unknown. We investigated the effects of visuotactile presentation on the encoding and retrieval of object identity memory and object location memory. Participants played an electronic memory card game consisting of an encoding and retrieval phase. In the encoding phase (c) they explored four game cards, which were presented on a computer screen in a two by two arrangement. Participants could touch each card to experience a Morse code presented on the screen (V) and/or via a tactile vibrator attached to the participant’s index finger (T). In the retrieval phase (r), they had to indicate for eight cards if (recognition) and where (relocation) these had been presented earlier. Compared with the visual base line (cV-rV), we found that both ‘multisensory encoding’ (cVT-rV) and ‘multisensory retrieval’ (cV-rVT) significantly improved both recognition and relocation performance. Compared with the tactile base line (cT-rT), we found no multisensory encoding or retrieval effects. This means that vision can benefit from adding touch but not vice versa. We conclude that visuotactile presentation improves memory encoding and retrieval of object identity and location. However, it is not yet clear whether these benefits are due to multisensory integration or simply due to the processing of the same information in multiple sensory modalities.
Topics
TNO Identifier
520196
ISSN
03029743
ISBN
9783662441923
Publisher
Springer
Source title
EuroHaptics 2014, 9th International Conference on Haptics: Neuroscience, Devices, Modeling, and Applications, Versailles, France, 24-26 June 2014
Editor(s)
Duriez, C.
Auvray, M.
Auvray, M.
Pages
169-176
Files
To receive the publication files, please send an e-mail request to TNO Repository.