Publication: Perceptually-aware Live VBR Encoding Sc...
Master data
Title: | Perceptually-aware Live VBR Encoding Scheme for Adaptive AVC Streaming |
Subtitle: | |
Abstract: | Currently, a fixed set of bitrate-resolution pairs termed a “bitrate ladder” is used in live streaming applications. Similarly, two-pass variable bitrate (VBR) encoding schemes are not used in live streaming applications to avoid the additional latency added by the first-pass. Bitrate ladder optimization is necessary to (i) decrease storage or delivery costs or/and (ii) increase Quality of Experience. Using two-pass VBR encoding improves compression efficiency, owing to better encoding decisions in the second-pass encoding using the first-pass analysis. In this light, this paper introduces a perceptually-aware constrained Variable Bitrate (cVBR) encoding Scheme (Live VBR) for HTTP adaptive streaming applications, which includes a joint optimization of the perceptual redundancy between the representations of the bitrate ladder, maximizing the perceptual quality (in terms of VMAF) and optimized constant rate factor (CRF). Discrete Cosine Transform (DCT)-energy-based low-complexity spatial and temporal features for every video segment, namely, brightness, spatial texture information, and temporal activity, are extracted to predict a perceptually-aware bitrate ladder for encoding. Experimental results show that, on average, Live VBR yields bitrate savings of 7.21% and 13.03% to maintain the same peak PSNR and VMAF, respectively, compared to the reference HTTP Live Streaming (HLS) bitrate ladder Constant Bitrate (CBR) encoding using x264 AVC encoder without any noticeable additional latency in streaming. Additionally, Live VBR results in a 52.59% cumulative decrease in storage space for various representations, and a 28.78% cumulative decrease in energy consumption, considering a perceptual difference of 6 VMAF points. |
Keywords: |
Publication type: | Article in Proceedings (Authorship) |
Publication date: | 14.04.2023 (Online) |
Published by: |
NAB Proceedings of the 2023 NAB Broadcast Engineering and Information Technology (BEIT) Conference
NAB Proceedings of the 2023 NAB Broadcast Engineering and Information Technology (BEIT) Conference
(
National Association of Broadcasters (NAB);
)
to publication |
Title of the series: | - |
Volume number: | - |
First publication: | Yes |
Version: | - |
Page: | - |
Versionen
Keine Version vorhanden |
Publication date: | 14.04.2023 |
ISBN (e-book): | - |
eISSN: | - |
DOI: | - |
Homepage: | https://nabpilot.org/product/perceptually-aware-live-vbr-encoding-scheme-for-adaptive-avc-streaming/ |
Open access |
|
Authors
Vignesh Menon (internal) | ||||
Prajit T Rajendran (external) | ||||
Christian Feldmann
|
||||
Martin Smole (external) | ||||
Klaus Schöffmann (internal) | ||||
Mohammad Ghanbari (internal) | ||||
Christian Timmerer (internal) |
Assignment
Organisation | Address | ||||
---|---|---|---|---|---|
Fakultät für Technische Wissenschaften
Institut für Informationstechnologie
|
AT - 9020 Klagenfurt am Wörthersee |
Categorisation
Subject areas | |
Research Cluster | No research Research Cluster selected |
Peer reviewed |
|
Publication focus |
Classification raster of the assigned organisational units:
|
working groups |
|
Cooperations
Organisation | Address | ||||
---|---|---|---|---|---|
Université Paris-Saclay
|
FR - 91190 Saint-Aubin |
||||
bitmovin GmbH
|
AT - 9020 Klagenfurt am Wörthersee |
Research activities
Projects: |
|
Publications: | No related publications |
Events: | No related events |
Lectures: | No related lectures |