All-intra rate control using low complexity video features for Versatile Video Coding

IEEE International Conference on Image Processing (ICIP), 2023

8-11 October 2023, Kuala Lumpur, Malaysia

Conference Website


Vignesh V Menon (Alpen-Adria-Universität Klagenfurt), Anastasia Henkel (Fraunhofer HHI Berlin), Prajit T Rajendran (Universite Paris-Saclay), Christian R Helmich (Fraunhofer HHI Berlin), Adam Wieckowski (Fraunhofer HHI Berlin), Benjamin Bross (Fraunhofer HHI Berlin), Christian Timmerer (Alpen-Adria-Universität Klagenfurt), and Detlev Marpe (Fraunhofer HHI Berlin).


Versatile Video Coding (VVC) allows for large compression efficiency gains over its predecessor, High Efficiency Video Coding (HEVC). The added efficiency comes at the cost
of increased runtime complexity, especially for encoding. It is thus highly relevant to explore all available runtime reduction options. This paper proposes a novel first pass for
two-pass rate control in all-intra configuration, using low-complexity video analysis and a Random Forest (RF)-based machine learning model to derive the data required for driving the second pass. The proposed method is validated using VVenC, an open and optimized VVC encoder. Compared to the default two-pass rate control algorithm in VVenC, the
proposed method achieves around 32% reduction in encoding time for the preset faster, while on average only causing a 2% BD-rate increase and achieving similar rate control accuracy.

Proposed two-pass rate control encoding architecture.

This entry was posted in ATHENA. Bookmark the permalink.