Loading [MathJax]/extensions/tex2jax.js

Neural Network-based Error Concealment for B-Frames in VVC

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

Plum Print visual indicator of research metrics
  • Citations
    • Citation Indexes: 1
  • Captures
    • Readers: 1
see details

Details

Original languageEnglish
Title of host publicationIEEE International Symposium on Circuits and Systems, ISCAS 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages511-515
Number of pages5
ISBN (electronic)9781665484855
ISBN (print)978-1-6654-8486-2
Publication statusPublished - 2022
Event2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022 - Austin, United States
Duration: 27 May 20221 Jun 2022

Publication series

NameProceedings - IEEE International Symposium on Circuits and Systems
Volume2022-May
ISSN (Print)0271-4310

Abstract

In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

Keywords

    error concealment, video coding, VVC

ASJC Scopus subject areas

Cite this

Neural Network-based Error Concealment for B-Frames in VVC. / Benjak, Martin; Aust, Niklas; Samayoa, Yasser et al.
IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 511-515 (Proceedings - IEEE International Symposium on Circuits and Systems; Vol. 2022-May).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Benjak, M, Aust, N, Samayoa, Y & Ostermann, J 2022, Neural Network-based Error Concealment for B-Frames in VVC. in IEEE International Symposium on Circuits and Systems, ISCAS 2022. Proceedings - IEEE International Symposium on Circuits and Systems, vol. 2022-May, Institute of Electrical and Electronics Engineers Inc., pp. 511-515, 2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022, Austin, Texas, United States, 27 May 2022. https://doi.org/10.1109/ISCAS48785.2022.9937956
Benjak, M., Aust, N., Samayoa, Y., & Ostermann, J. (2022). Neural Network-based Error Concealment for B-Frames in VVC. In IEEE International Symposium on Circuits and Systems, ISCAS 2022 (pp. 511-515). (Proceedings - IEEE International Symposium on Circuits and Systems; Vol. 2022-May). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISCAS48785.2022.9937956
Benjak M, Aust N, Samayoa Y, Ostermann J. Neural Network-based Error Concealment for B-Frames in VVC. In IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 511-515. (Proceedings - IEEE International Symposium on Circuits and Systems). doi: 10.1109/ISCAS48785.2022.9937956
Benjak, Martin ; Aust, Niklas ; Samayoa, Yasser et al. / Neural Network-based Error Concealment for B-Frames in VVC. IEEE International Symposium on Circuits and Systems, ISCAS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 511-515 (Proceedings - IEEE International Symposium on Circuits and Systems).
Download
@inproceedings{88a2c5d0cebd436ab262f859884305f2,
title = "Neural Network-based Error Concealment for B-Frames in VVC",
abstract = "In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.",
keywords = "error concealment, video coding, VVC",
author = "Martin Benjak and Niklas Aust and Yasser Samayoa and Jorn Ostermann",
year = "2022",
doi = "10.1109/ISCAS48785.2022.9937956",
language = "English",
isbn = "978-1-6654-8486-2",
series = "Proceedings - IEEE International Symposium on Circuits and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "511--515",
booktitle = "IEEE International Symposium on Circuits and Systems, ISCAS 2022",
address = "United States",
note = "2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022 ; Conference date: 27-05-2022 Through 01-06-2022",

}

Download

TY - GEN

T1 - Neural Network-based Error Concealment for B-Frames in VVC

AU - Benjak, Martin

AU - Aust, Niklas

AU - Samayoa, Yasser

AU - Ostermann, Jorn

PY - 2022

Y1 - 2022

N2 - In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

AB - In this paper we introduce an error concealment method for VVC that error-conceals B-frames based on the neural frame interpolation network RIFE. The network is trained using the BVI-DVC dataset to infer even full-HD frames. We integrate our proposed model in the VVC reference software VTM for its evaluation. The average error of a whole GOP with a single corrupted frame is decreased by 15% and 24% in terms of PSNR measurement compared to block matching and frame copy, respectively. To our knowledge, our approach is currently the best performing error concealment algorithm for single slice per B-frame settings.

KW - error concealment

KW - video coding

KW - VVC

UR - http://www.scopus.com/inward/record.url?scp=85142529092&partnerID=8YFLogxK

U2 - 10.1109/ISCAS48785.2022.9937956

DO - 10.1109/ISCAS48785.2022.9937956

M3 - Conference contribution

AN - SCOPUS:85142529092

SN - 978-1-6654-8486-2

T3 - Proceedings - IEEE International Symposium on Circuits and Systems

SP - 511

EP - 515

BT - IEEE International Symposium on Circuits and Systems, ISCAS 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022

Y2 - 27 May 2022 through 1 June 2022

ER -

By the same author(s)