Title
Closing the Gap: Human Factors in Cross-Device Media Synchronization
Author
Mu, M.
Fawcett, L.
Bird, J.
Jellicoe, J.
Simpson, S.
Stokking, H.
Race, N.
Publication year
2017
Abstract
The continuing growth in the mobile phone arena, particularly in terms of device capabilities and ownership, is having a transformational impact on media consumption. It is now possible to consider orchestrated multistream experiences delivered across many devices, rather than the playback of content from a single device. However, there are significant challenges in realizing such a vision, particularly around the management of synchronicity between associated media streams. This is compounded by the heterogeneous nature of user devices, the networks upon which they operate, and the perceptions of users. This paper introduces IMSync, an open interstream synchronization framework that incorporates human factors to capture the quality of experience (QoE). IMSync adopts efficient monitoring and control mechanisms, alongside a QoE perception model that has been derived from a series of subjective user experiments. Based on an observation of lag, IMSync is able to use this model of impact to determine an appropriate strategy to catch-up with playback while minimizing the potential detrimental impacts on a users QoE. The impact model adopts a balanced approach: Trading off the potential impact on QoE of initiating a resynchronization process compared with retaining the current levels of nonsynchronicity, in order to maintain high levels of QoE. A series of experiments demonstrate the potential of the framework as a basis for enabling new immersive media experiences. © 2016 IEEE.
Subject
ICT
NTW - Networks
TS - Technical Sciences
Human factors
Multimedia communication
Multimedia systems
Human engineering
Multimedia systems
Device capabilities
Efficient monitoring
Interstream synchronization
Media synchronization
Multi-media communications
Perception Modeling
Quality of experience (QoE)
Transformational impacts
Quality of service
To reference this document use:
http://resolver.tudelft.nl/uuid:d885610b-6da6-4c93-ad1f-9eb55c2f634b
TNO identifier
753488
Publisher
Institute of Electrical and Electronics Engineers Inc.
ISSN
1932-4553
Source
IEEE Journal on Selected Topics in Signal Processing, 11 (1), 180-195
Article number
7781600
Document type
article