Title
VVC bitstream extraction and merging operations for multi-stream media applications
Author
Thomas, E.
Gabriel, A.
el Assal, K.M.
Publication year
2020
Abstract
In traditional video decoding applications, the number of elementary streams that a hardware decoding platform of an end device can decode is determined at runtime by the. Upon request by the application, the decoding platform verifies whether a new decoding instance with an associated requirement in terms of data rate can fit under the current workload. Conversely, if a device candecode one 4K elementary stream in hardware, it may not be able to simultaneously decode four HD elementary streams that would each correspond to requirements in terms of data rate of ¼ of the 4K elementary stream. Current video decoding platforms are thus designed with the assumption that each elementary stream requires the instantiation of a dedicated video decoder instance. At the same time, it has been increasingly common in new media applications such as immersive media applications to simultaneously consumeseveral elementary streams in a synchronised fashion. The demo presents a new paradigm for media applications for which elementary streams may be consumed in such synchronised manner where the same decoder instance can be used. The demonstrator leverages on new features of the Versatile Video Coding (VVC) standard and interfaces being defined in the ongoing standardisation of MPEG-I part 13: Video Decoding Interface for Immersive Media. Stitching and cropping videos in the compressed domain can be achieved by an application via such defined interfaces. Without those interfaces, the same tasks are possiblewith the High Efficiency Video Coding (HEVC) standard to some extent but are tedious. In this demonstrator, we thus show how the new VVC codec can enable the decoupling of the number of elementary streams consumed by the application and the number of running video decoder instances. In addition, memory usage and CPU performance are also collected and compared with a radition multiple decoding instance approach.
Subject
360 video
compressed domain video operations
independent layers
multi-layer bitstream
video decoding
video merging
VVC
Computer hardware description languages
Data streams
Decoding
Multimedia systems
Online systems
Bit-stream extraction
Compressed domain
High-efficiency video coding
Immersive media
Media application
Multi-stream
Video decoders
Video decoding
Video signal processing
To reference this document use:
http://resolver.tudelft.nl/uuid:8c0aca4f-afb1-4902-8d7d-369ee52c234e
TNO identifier
955296
Publisher
Association for Computing Machinery, Inc
ISBN
9781450368452
Source
MMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference, 11th ACM Multimedia Systems Online Conference, MMSys 2020, 8 June 2020 through 11 June 2020, 337-340
Bibliographical note
Sponsor: ACM SIGMM
Document type
conference paper