Title
Virtual Reality Conferencing: Multi-user immersive VR experiences on the web
Author
Gunkel, S.N.B.
Stokking, H.M.
Prins, M.J.
van der Stap, N.
ter Haar, F.B.
Niamut, O.A.
Publication year
2018
Abstract
Virtual Reality (VR) and 360-degree video are set to become part of the future social environment, enriching and enhancing the way we share experiences and collaborate remotely. While Social VR applications are getting more momentum, most services regarding Social VR focus on animated avatars. In this demo, we present our efforts towards Social VR services based on photo-realistic video recordings. In this demo paper, we focus on two parts, the communication between multiple people (max 3) and the integration of new media formats to represent users as 3D point clouds. We enhance a green screen (chroma key) like cut-out of the person with depth data, allowing point cloud based rendering in the client. Further, the paper presents a user study with 54 people evaluating a three-people communication use case and a technical analysis to move towards 3D representations of users. This demo consists of two shared virtual environments to communicate and interact with others, i.e. i) a 360-degree virtual space with users being represented as 2D video streams (with the background removed) and ii) a 3D space with users being represented as point clouds (based on color and depth video data).
Subject
Virtual environments and Gaming
Virtual Reality
Social Virtual Reality
WebRTC
WebVR
Iteractive content
Immersive virtual environments
WebGL
Point-cloud
To reference this document use:
http://resolver.tudelft.nl/uuid:86822b4e-4ff9-48e2-82f8-df395a47db0b
TNO identifier
788630
Source
MMSys’18: 9th ACM Multimedia Systems Conference, June 12–15, 2018, Amsterdam, Netherlands.
Document type
conference paper