Neural Network-based Error Concealment for B-Frames in VVC

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksIEEE International Symposium on Circuits and Systems, ISCAS 2022
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten511-515
Seitenumfang5
ISBN (elektronisch)9781665484855
ISBN (Print)978-1-6654-8486-2
PublikationsstatusVeröffentlicht - 2022
Veranstaltung2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022 - Austin, USA / Vereinigte Staaten
Dauer: 27 Mai 20221 Juni 2022

Publikationsreihe

NameProceedings - IEEE International Symposium on Circuits and Systems
Band2022-May
ISSN (Print)0271-4310

Abstract

In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

ASJC Scopus Sachgebiete

Zitieren

Neural Network-based Error Concealment for B-Frames in VVC. / Benjak, Martin; Aust, Niklas; Samayoa, Yasser et al.
IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. S. 511-515 (Proceedings - IEEE International Symposium on Circuits and Systems; Band 2022-May).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Benjak, M, Aust, N, Samayoa, Y & Ostermann, J 2022, Neural Network-based Error Concealment for B-Frames in VVC. in IEEE International Symposium on Circuits and Systems, ISCAS 2022. Proceedings - IEEE International Symposium on Circuits and Systems, Bd. 2022-May, Institute of Electrical and Electronics Engineers Inc., S. 511-515, 2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022, Austin, Texas, USA / Vereinigte Staaten, 27 Mai 2022. https://doi.org/10.1109/ISCAS48785.2022.9937956
Benjak, M., Aust, N., Samayoa, Y., & Ostermann, J. (2022). Neural Network-based Error Concealment for B-Frames in VVC. In IEEE International Symposium on Circuits and Systems, ISCAS 2022 (S. 511-515). (Proceedings - IEEE International Symposium on Circuits and Systems; Band 2022-May). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISCAS48785.2022.9937956
Benjak M, Aust N, Samayoa Y, Ostermann J. Neural Network-based Error Concealment for B-Frames in VVC. in IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc. 2022. S. 511-515. (Proceedings - IEEE International Symposium on Circuits and Systems). doi: 10.1109/ISCAS48785.2022.9937956
Benjak, Martin ; Aust, Niklas ; Samayoa, Yasser et al. / Neural Network-based Error Concealment for B-Frames in VVC. IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. S. 511-515 (Proceedings - IEEE International Symposium on Circuits and Systems).
Download
@inproceedings{88a2c5d0cebd436ab262f859884305f2,
title = "Neural Network-based Error Concealment for B-Frames in VVC",
abstract = "In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.",
keywords = "error concealment, video coding, VVC",
author = "Martin Benjak and Niklas Aust and Yasser Samayoa and Jorn Ostermann",
year = "2022",
doi = "10.1109/ISCAS48785.2022.9937956",
language = "English",
isbn = "978-1-6654-8486-2",
series = "Proceedings - IEEE International Symposium on Circuits and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "511--515",
booktitle = "IEEE International Symposium on Circuits and Systems, ISCAS 2022",
address = "United States",
note = "2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022 ; Conference date: 27-05-2022 Through 01-06-2022",

}

Download

TY - GEN

T1 - Neural Network-based Error Concealment for B-Frames in VVC

AU - Benjak, Martin

AU - Aust, Niklas

AU - Samayoa, Yasser

AU - Ostermann, Jorn

PY - 2022

Y1 - 2022

N2 - In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

AB - In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

KW - error concealment

KW - video coding

KW - VVC

UR - http://www.scopus.com/inward/record.url?scp=85142529092&partnerID=8YFLogxK

U2 - 10.1109/ISCAS48785.2022.9937956

DO - 10.1109/ISCAS48785.2022.9937956

M3 - Conference contribution

AN - SCOPUS:85142529092

SN - 978-1-6654-8486-2

T3 - Proceedings - IEEE International Symposium on Circuits and Systems

SP - 511

EP - 515

BT - IEEE International Symposium on Circuits and Systems, ISCAS 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022

Y2 - 27 May 2022 through 1 June 2022

ER -

Von denselben Autoren