On the Security of Selectively Encrypted HEVC Video Bitstreams

ACM Transactions on Multimedia Computing Communications and Applications (ACM TOMM)

[PDF]

Chen Chen (Tsinghua University, China),  Lingfeng Qu (Guangzhou University, China), Hadi Amirpour (Alpen-Adria-Universität Klagenfurt), Xingjun Wang (Tsinghua University, China),  Christian Timmerer (Alpen-Adria-Universität Klagenfurt), and Zhihong Tian (Guangzhou University, China)

Abstract:

With the growing applications of video, ensuring its security has become of utmost importance. Selective encryption (SE) has gained significant attention in the field of video content protection due to its compatibility with video codecs, favorable visual distortion, and low time complexity. However, few studies consider SE security under cryptographic attacks. To fill this gap, we analyze the security concerns of encrypted bitstreams by SE schemes and propose two known plaintext attacks (KPAs). Then, the corresponding defense is presented against the KPAs.To validate the effectiveness of the KPA, it is applied to attack two existing SE schemes with superior visual degradation in HEVC videos.

Firstly, the encrypted bitstreams are generated using the HEVC encoder with SE (HESE).
Secondly, the video sequences are encoded using H.265/HEVC. During encoding, the selected syntax elements are recorded. Then, the recorded syntax elements are imported into the HEVC decoder using decryption (HDD). By utilizing the encryption parameters and the imported data in the HDD, it becomes possible to reconstruct a significant portion of the original syntax elements before encryption. Finally, the reconstructed syntax elements are compared with the encrypted syntax elements in the HDD, allowing the design of a pseudo-key stream (PKS) through the inverse of the encryption operations. The PKS is used to decrypt the existing SE scheme, and the experimental results provide evidence that the two existing SE schemes are vulnerable to the proposed KPAs.
In the case of single bitstream estimation (SBE), the average correct rate of key stream estimation exceeds 93%. Moreover, with multi-bitstream complementation (MBC), the average estimation accuracy can be further improved to 99%.

 

Posted in ATHENA | Comments Off on On the Security of Selectively Encrypted HEVC Video Bitstreams

Video Encoding Enhancement via Content-Aware Spatial and Temporal Super-Resolution

European Signal Processing Conference (EUSIPCO)

26-30 August 2024, Lyon, France

[PDF]

Yiying Wei (AAU, Austria), Hadi Amirpour (AAU, Austria) Ahmed Telili (INSA Rennes, France), Wassim Hamidouche (INSA Rennes, France), Guo Lu (Shanghai Jiao Tong University, China) and Christian Timmerer (AAU, Austria)

Abstract: Content-aware deep neural networks (DNNs) are trending in Internet video delivery. They enhance quality within bandwidth limits by transmitting videos as low resolution (LR) bitstreams with overfitted super-resolution (SR) model streams to reconstruct high-resolution (HR) video on the decoder end. However, these methods underutilize spatial and temporal re- dundancy, compromising compression efficiency. In response, our proposed video compression framework introduces spatial- temporal video super-resolution (STVSR), which encodes videos into low spatial-temporal resolution (LSTR) content and a model stream, leveraging the combined spatial and temporal reconstruction capabilities of DNNs. Compared to the state-of- the-art approaches that consider only spatial SR, our approach achieves bitrate savings of 18.71% and 17.04% while maintainingthe same PSNR and VMAF, respectively.

Posted in ATHENA | Comments Off on Video Encoding Enhancement via Content-Aware Spatial and Temporal Super-Resolution

Antrittsvorlesung von Christian Timmerer

Das Original befindet sich hier.

Am 5. Juni 2024 findet an der Universität Klagenfurt die Antrittsvorlesung von Christian Timmerer vom Institut für Informationstechnologie zum Thema „Video Streaming: Then, Now, and in the Future“ statt.   

Das Rektorat der Universität Klagenfurt und der Dekan der Fakultät für Technische Wissenschaften laden herzlich am 5. Juni 2024 zur Antrittsvorlesung von Christian Timmerer ein. Christian Timmerer ist seit Dezember 2022 Universitätsprofessor für Multimedia Systems am Institut für Informationstechnologie der Fakultät für Technische Wissenschaften. Seine Antrittsvorlesung hält er zum Thema:

„Video Streaming: Then, Now, and in the Future“   [Slides]

5. Juni 2024
17.00 Uhr
Universität Klagenfurt
Hörsaal 2 (Zentraltrakt der Universität)

In seinem öffentlichen Vortrag gibt Christian Timmerer Einblicke in die faszinierende Geschichte des Videostreamings, beginnend bei den bescheidenen Anfängen vor YouTube bis hin zu den bahnbrechenden Technologien, die heutzutage Plattformen wie Netflix und ORF ON dominieren. Timmerer präsentiert dabei auch provokante eigene Beiträge, die die Branche maßgeblich beeinflusst haben. Zum Abschluss wirft er einen Blick auf die zukünftigen Herausforderungen und lädt das Publikum zu einer Diskussion ein.

Die Antrittsvorlesung findet in englischer Sprache statt.

Posted in ATHENA | Comments Off on Antrittsvorlesung von Christian Timmerer

Content-aware Reference Frame Synthesis for Enhanced Inter Prediction

European Signal Processing Conference (EUSIPCO)

26-30 August 2024, Lyon, France

[PDF]

Mohammad Ghasempour (AAU, Austria), Yiying Wei (AAU, Austria), Hadi Amirpour (AAU, Austria),  and Christian Timmerer (AAU, Austria)

Abstract: Video coding relies heavily on reducing spatial and temporal redundancy to enable efficient transmission. To tackle the temporal redundancy, each video frame is predicted from the previously encoded frames, known as reference frames. The quality of this prediction is highly dependent on the quality of the reference frames. Recent advancements in machine learning are motivating the exploration of frame synthesis to generate high-quality reference frames. However, the efficacy of such models depends on training with content similar to that encountered during usage, which is challenging due to the diverse nature of video data. This paper introduces a content-aware reference frame synthesis to enhance inter-prediction efficiency. Unlike conventional approaches that rely on pre-trained models, our proposed framework optimizes a deep learning model for each content by fine-tuning only the last layer of the model, requiring the transmission of only a few kilobytes of additional information to the decoder. Experimental results show that the proposed framework yields significant bitrate savings of 12.76%, outperforming its counterpart in the pre-trained framework, which only achieves 5.13% savings in bitrate.

Posted in ATHENA | Comments Off on Content-aware Reference Frame Synthesis for Enhanced Inter Prediction

University of Klagenfurt to Host VQEG Meeting

Video Quality Experts Group (VQEG)

1-5 July 2024

University of Klagenfurt, Austria

[website]

The University of Klagenfurt welcomes VQEG members to the next meeting that will be held in Klagenfurt, Carinthia, Austria, from July 01-05, 2024.

The Video Quality Experts Group (VQEG) convenes a consortium of global specialists from various sectors, including industry, academia, governmental bodies, the International Telecommunication Union, and other standard-setting organizations.

Posted in ATHENA | Comments Off on University of Klagenfurt to Host VQEG Meeting

Patent Approval for “Adaptive Bitrate Algorithm Deployed at Edge Nodes”

Adaptive Bitrate Algorithm Deployed at Edge Nodes

US Patent

[URL][PDF]

Jesús Aguilar-Armijo (Alpen-Adria-Universität Klagenfurt, Austria), Ekrem Çetinkaya (Alpen-Adria-Universität Klagenfurt, Austria), Hermann Hellwagner (Alpen-Adria-Universität Klagenfurt, Austria), Christian Timmerer (Alpen-Adria-Universität Klagenfurt, Austria)

Abstract: The technology described herein relates to implementing an adaptive bitrate (ABR) algorithm at edge nodes. A method for implementing an ABR algorithm at an edge node may include receiving at the edge node a request for a video segment from a client according to the client’s ABR algorithm, the request indicating a quality. A weighted sum score for each of a set of qualities may be computed based on a quality score and a fairness score using the ABR algorithm at the edge node, the qualities including at least the requested quality and another quality. A modified request may be generated in response to the weighted sum score for the other quality being better than the weighted sum score for the requested quality. The modified request may be sent to a server. The video segment in the other quality may be received from the server and provided to a client.

Posted in ATHENA | Comments Off on Patent Approval for “Adaptive Bitrate Algorithm Deployed at Edge Nodes”

Report on GMSys 2024: Second International ACM Green Multimedia Systems Workshop

The second International ACM Green Multimedia Systems Workshop, hosted and organized as part of the 15th ACM Multimedia Systems Conference, took place on Thursday, April 18, 2024, in Bari, Italy. The workshop provided a platform for discussing innovative ideas and research findings in multimedia systems, specifically focusing on energy usage and environmental impact within multimedia frameworks.

GMSys featured five technical presentations, with an acceptance rate of 62.5%. These presentations, comprising both full and short papers, covered a range of innovative approaches and solutions related to green video streaming. It provided a valuable opportunity for multimedia researchers to delve into this critical topic.

The workshop brought together experts and researchers from universities and research institutes, including InterDigital, Fraunhofer FOKUS, Alpen-Adria-Universitat Klagenfurt, University at Buffalo, and researchers from leading companies such as Technology Innovation Institute (TII), Bitmovin, and IBM, all focused on advancing green video streaming technology.

We want to thank you to everyone who made our workshop awesome – participants, speakers, committees, authors, and attendees! Your support was key to our success.

Huge thanks to the ACM organizing team, especially Luca De Cicco and Ali C. Begen, for helping us host this event.

A special thanks to GAIA and Green Streaming for their generous technical sponsorship, which helped us pull everything together smoothly.

Presentations in GMSys’24: 

How to make images less power-hungry: An objective benchmark study 
Emmanuel SAMPAIO (InterDigital, France), Claire-Hélène DEMARTY (InterDigital, France), Olivier Le Meur (InterDigital)

Energy Cost of Coding Omnidirectional Videos using ARM and x86 Platforms
Ibrahim Farhat (Technology Innovation Institure (TII)), Ibrahim Khadraoui (Technology Innovation Institure (TII)), Wassim hamidouche (Technology Innovation Institure (TII)), Mohit K. sharma (Technology Innovation Institure (TII))

Framework for automated energy measurement of video streaming devices
Martin Lasak (Fraunhofer FOKUS), Robert Seeliger (Fraunhofer FOKUS), Goerkem Gueclue (Fraunhofer FOKUS), Stefan Arbanowski (Fraunhofer FOKUS)

VEEP: Video Encoding Energy and CO2 Emission Prediction
Armin Lachini (Bitmovin), Manuel Hoi (Alpen-Adria-Universitat Klagenfurt), Samira Afzal (Alpen-Adria-Universitat Klagenfurt), Sandro Linder (Alpen-Adria-Universitat Klagenfurt), Farzad Tashtarian (Alpen-Adria Universität Klagenfurt), Radu Prodan (University of Klagenfurt), Christian Timmerer (Alpen-Adria Universität Klagenfurt)

Modeling Video Playback Power Consumption on Mobile Devices
Bekir Turkkan (IBM Research), Adithya Raman (University at Buffalo, SUNY), Tevfik Kosar (University at Buffalo, SUNY)

 

Posted in GAIA | Comments Off on Report on GMSys 2024: Second International ACM Green Multimedia Systems Workshop