Simplified carriage of MPEG immersive video in HEVC bitstream

Mengyu Chen; Basel Salahieh; Max Dmitrichenko; Jill Boyce

doi:10.1117/12.2593869

1 August 2021 Simplified carriage of MPEG immersive video in HEVC bitstream

Mengyu Chen, Basel Salahieh, Max Dmitrichenko, Jill Boyce

Proceedings Volume 11842, Applications of Digital Image Processing XLIV; 118420C (2021) https://doi.org/10.1117/12.2593869
Event: SPIE Optical Engineering + Applications, 2021, San Diego, California, United States

Abstract

Immersive video enables end users to experience video in a more natural way interactively with viewer motion from any position and orientation within a supported viewing space. MPEG Immersive Video (MIV) is an upcoming standard being developed to handle the compression and delivery of immersive media content. It extracts only needed information in the form of patches from a collection of cameras capturing the scene and compresses with video codecs such that the scene can be reconstructed at the decoder side from any pose. A MIV bitstream is composed of non-video components carrying view parameters and patch information in addition to multiple video data sub-bitstreams carrying texture and geometry information. In this paper, we describe a simplified MIV carriage method, using an SEI message within a single layer HEVC bitstream, to take advantage of existing video streaming infrastructure, including legacy video servers. The Freeport player is built on the open-source VLC video player, a GPU DirectX implementation of a MIV renderer, and a face tracking tool for viewer motion. A prerecorded demonstration of Freeport player is provided.

Conference Presentation

Citation Download Citation

Mengyu Chen, Basel Salahieh, Max Dmitrichenko, and Jill Boyce "Simplified carriage of MPEG immersive video in HEVC bitstream", Proc. SPIE 11842, Applications of Digital Image Processing XLIV, 118420C (1 August 2021); https://doi.org/10.1117/12.2593869

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available