Title
Towards a format-agnostic approach for production, delivery and rendering of immersive media
Author
Niamut, O.A.
Kochale, A.
Hidalgo, J.R.
Kaiser, R.
Spille, J.
Macq, J.F.
Kienast, G.
Schreer, O.
Shirley, B.
Publication year
2013
Abstract
The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalization (selection and control of content, availability on many devices). We investigate the feasibility of an end-to-end format-agnostic approach to support both these trends. In this paper, different aspects of a format-agnostic capture, production, delivery and rendering system are discussed. At the capture stage, the concept of layered scene representation is introduced, including panoramic video and 3D audio capture. At the analysis stage, a virtual director component is discussed that allows for automatic execution of cinematographic principles, using feature tracking and saliency detection. At the delivery stage, resolution-independent audiovisual transport mechanisms for both managed and unmanaged networks are treated. In the rendering stage, a rendering process that includes the manipulation of audiovisual content to match the connected display and loudspeaker properties is introduced. Different parts of the complete system are revisited demonstrating the requirements and the potential of this advanced concept. © 2013 ACM.
Subject
Communication & Information
MNS - Media & Network Services
TS - Technical Sciences
Infostructures
Informatics
Information Society
Content analysis
Gesture-based interaction
Immersive media
media aware networking
Panoramic imaging
Spatial audio
Ultra-high definitions
Virtual director
Hardware
Multimedia systems
To reference this document use:
http://resolver.tudelft.nl/uuid:9938dc51-b1d3-493f-9c96-f938776c8fc7
DOI
https://doi.org/10.1145/2483977.2484007
TNO identifier
473205
Source
4th ACM Multimedia Systems Conference, MMSys 2013, 28 February - 1 March 2013, Oslo, Norway, 249-260
Document type
conference paper