Neural Network-based Error Concealment for B-Frames in VVC

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publicationIEEE International Symposium on Circuits and Systems, ISCAS 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages511-515
Number of pages5
ISBN (electronic)9781665484855
ISBN (print)978-1-6654-8486-2
Publication statusPublished - 2022
Event2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022 - Austin, United States
Duration: 27 May 20221 Jun 2022

Publication series

NameProceedings - IEEE International Symposium on Circuits and Systems
Volume2022-May
ISSN (Print)0271-4310

Abstract

In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

Keywords

    error concealment, video coding, VVC

ASJC Scopus subject areas

Cite this

Neural Network-based Error Concealment for B-Frames in VVC. / Benjak, Martin; Aust, Niklas; Samayoa, Yasser et al.
IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 511-515 (Proceedings - IEEE International Symposium on Circuits and Systems; Vol. 2022-May).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Benjak, M, Aust, N, Samayoa, Y & Ostermann, J 2022, Neural Network-based Error Concealment for B-Frames in VVC. in IEEE International Symposium on Circuits and Systems, ISCAS 2022. Proceedings - IEEE International Symposium on Circuits and Systems, vol. 2022-May, Institute of Electrical and Electronics Engineers Inc., pp. 511-515, 2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022, Austin, Texas, United States, 27 May 2022. https://doi.org/10.1109/ISCAS48785.2022.9937956
Benjak, M., Aust, N., Samayoa, Y., & Ostermann, J. (2022). Neural Network-based Error Concealment for B-Frames in VVC. In IEEE International Symposium on Circuits and Systems, ISCAS 2022 (pp. 511-515). (Proceedings - IEEE International Symposium on Circuits and Systems; Vol. 2022-May). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISCAS48785.2022.9937956
Benjak M, Aust N, Samayoa Y, Ostermann J. Neural Network-based Error Concealment for B-Frames in VVC. In IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 511-515. (Proceedings - IEEE International Symposium on Circuits and Systems). doi: 10.1109/ISCAS48785.2022.9937956
Benjak, Martin ; Aust, Niklas ; Samayoa, Yasser et al. / Neural Network-based Error Concealment for B-Frames in VVC. IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 511-515 (Proceedings - IEEE International Symposium on Circuits and Systems).
Download
@inproceedings{88a2c5d0cebd436ab262f859884305f2,
title = "Neural Network-based Error Concealment for B-Frames in VVC",
abstract = "In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.",
keywords = "error concealment, video coding, VVC",
author = "Martin Benjak and Niklas Aust and Yasser Samayoa and Jorn Ostermann",
year = "2022",
doi = "10.1109/ISCAS48785.2022.9937956",
language = "English",
isbn = "978-1-6654-8486-2",
series = "Proceedings - IEEE International Symposium on Circuits and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "511--515",
booktitle = "IEEE International Symposium on Circuits and Systems, ISCAS 2022",
address = "United States",
note = "2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022 ; Conference date: 27-05-2022 Through 01-06-2022",

}

Download

TY - GEN

T1 - Neural Network-based Error Concealment for B-Frames in VVC

AU - Benjak, Martin

AU - Aust, Niklas

AU - Samayoa, Yasser

AU - Ostermann, Jorn

PY - 2022

Y1 - 2022

N2 - In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

AB - In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

KW - error concealment

KW - video coding

KW - VVC

UR - http://www.scopus.com/inward/record.url?scp=85142529092&partnerID=8YFLogxK

U2 - 10.1109/ISCAS48785.2022.9937956

DO - 10.1109/ISCAS48785.2022.9937956

M3 - Conference contribution

AN - SCOPUS:85142529092

SN - 978-1-6654-8486-2

T3 - Proceedings - IEEE International Symposium on Circuits and Systems

SP - 511

EP - 515

BT - IEEE International Symposium on Circuits and Systems, ISCAS 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022

Y2 - 27 May 2022 through 1 June 2022

ER -

By the same author(s)