Compensation Learning in Semantic Segmentation

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Organisationseinheiten

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops
UntertitelCVPRW 2023
Herausgeber (Verlag)IEEE Computer Society
Seiten3267-3278
Seitenumfang12
ISBN (elektronisch)9798350302493
ISBN (Print)979-8-3503-0250-9
PublikationsstatusVeröffentlicht - 2023
Veranstaltung2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023 - Vancouver, Kanada
Dauer: 17 Juni 202324 Juni 2023

Publikationsreihe

NameIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Band2023-June
ISSN (Print)2160-7508
ISSN (elektronisch)2160-7516

Abstract

Label noise and ambiguities between similar classes are challenging problems in developing new models and annotating new data for semantic segmentation. In this paper, we propose Compensation Learning in Semantic Segmentation, a framework to identify and compensate ambiguities as well as label noise. More specifically, we add a ground truth depending and globally learned bias to the classification logits and introduce a novel uncertainty branch for neural networks to induce the compensation bias only to relevant regions. Our method is employed into state-of-the-art segmentation frameworks and several experiments demonstrate that our proposed compensation learns inter-class relations that allow global identification of challenging ambiguities as well as the exact localization of subsequent label noise. Additionally, it enlarges robustness against label noise during training and allows target-oriented manipulation during inference. We evaluate the proposed method on Cityscapes, KITTI-STEP, ADE20k, and COCO-stuff10k.

ASJC Scopus Sachgebiete

Zitieren

Compensation Learning in Semantic Segmentation. / Kaiser, Timo; Reinders, Christoph; Rosenhahn, Bodo.
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops: CVPRW 2023. IEEE Computer Society, 2023. S. 3267-3278 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; Band 2023-June).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Kaiser, T, Reinders, C & Rosenhahn, B 2023, Compensation Learning in Semantic Segmentation. in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops: CVPRW 2023. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Bd. 2023-June, IEEE Computer Society, S. 3267-3278, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023, Vancouver, Kanada, 17 Juni 2023. https://doi.org/10.48550/arXiv.2304.13428, https://doi.org/10.1109/CVPRW59228.2023.00329
Kaiser, T., Reinders, C., & Rosenhahn, B. (2023). Compensation Learning in Semantic Segmentation. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops: CVPRW 2023 (S. 3267-3278). (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; Band 2023-June). IEEE Computer Society. https://doi.org/10.48550/arXiv.2304.13428, https://doi.org/10.1109/CVPRW59228.2023.00329
Kaiser T, Reinders C, Rosenhahn B. Compensation Learning in Semantic Segmentation. in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops: CVPRW 2023. IEEE Computer Society. 2023. S. 3267-3278. (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). doi: 10.48550/arXiv.2304.13428, 10.1109/CVPRW59228.2023.00329
Kaiser, Timo ; Reinders, Christoph ; Rosenhahn, Bodo. / Compensation Learning in Semantic Segmentation. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops: CVPRW 2023. IEEE Computer Society, 2023. S. 3267-3278 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops).
Download
@inproceedings{632a913200fe4f7ab47f4599109f525f,
title = "Compensation Learning in Semantic Segmentation",
abstract = "Label noise and ambiguities between similar classes are challenging problems in developing new models and annotating new data for semantic segmentation. In this paper, we propose Compensation Learning in Semantic Segmentation, a framework to identify and compensate ambiguities as well as label noise. More specifically, we add a ground truth depending and globally learned bias to the classification logits and introduce a novel uncertainty branch for neural networks to induce the compensation bias only to relevant regions. Our method is employed into state-of-the-art segmentation frameworks and several experiments demonstrate that our proposed compensation learns inter-class relations that allow global identification of challenging ambiguities as well as the exact localization of subsequent label noise. Additionally, it enlarges robustness against label noise during training and allows target-oriented manipulation during inference. We evaluate the proposed method on Cityscapes, KITTI-STEP, ADE20k, and COCO-stuff10k.",
author = "Timo Kaiser and Christoph Reinders and Bodo Rosenhahn",
note = "Funding Information: This work was supported by the Federal Ministry of Education and Research (BMBF), Germany under the project LeibnizKILabor (grant no. 01DD20003) and the AI service center KISSKI (grant no. 01IS22093C), the Center for Digital Innovations (ZDIN) and the Deutsche Forschungs-gemeinschaft (DFG) under Germany{\textquoteright}s Excellence Strategy within the Cluster of Excellence PhoenixD (EXC 2122). ; 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023 ; Conference date: 17-06-2023 Through 24-06-2023",
year = "2023",
doi = "10.48550/arXiv.2304.13428",
language = "English",
isbn = "979-8-3503-0250-9",
series = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",
publisher = "IEEE Computer Society",
pages = "3267--3278",
booktitle = "2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops",
address = "United States",

}

Download

TY - GEN

T1 - Compensation Learning in Semantic Segmentation

AU - Kaiser, Timo

AU - Reinders, Christoph

AU - Rosenhahn, Bodo

N1 - Funding Information: This work was supported by the Federal Ministry of Education and Research (BMBF), Germany under the project LeibnizKILabor (grant no. 01DD20003) and the AI service center KISSKI (grant no. 01IS22093C), the Center for Digital Innovations (ZDIN) and the Deutsche Forschungs-gemeinschaft (DFG) under Germany’s Excellence Strategy within the Cluster of Excellence PhoenixD (EXC 2122).

PY - 2023

Y1 - 2023

N2 - Label noise and ambiguities between similar classes are challenging problems in developing new models and annotating new data for semantic segmentation. In this paper, we propose Compensation Learning in Semantic Segmentation, a framework to identify and compensate ambiguities as well as label noise. More specifically, we add a ground truth depending and globally learned bias to the classification logits and introduce a novel uncertainty branch for neural networks to induce the compensation bias only to relevant regions. Our method is employed into state-of-the-art segmentation frameworks and several experiments demonstrate that our proposed compensation learns inter-class relations that allow global identification of challenging ambiguities as well as the exact localization of subsequent label noise. Additionally, it enlarges robustness against label noise during training and allows target-oriented manipulation during inference. We evaluate the proposed method on Cityscapes, KITTI-STEP, ADE20k, and COCO-stuff10k.

AB - Label noise and ambiguities between similar classes are challenging problems in developing new models and annotating new data for semantic segmentation. In this paper, we propose Compensation Learning in Semantic Segmentation, a framework to identify and compensate ambiguities as well as label noise. More specifically, we add a ground truth depending and globally learned bias to the classification logits and introduce a novel uncertainty branch for neural networks to induce the compensation bias only to relevant regions. Our method is employed into state-of-the-art segmentation frameworks and several experiments demonstrate that our proposed compensation learns inter-class relations that allow global identification of challenging ambiguities as well as the exact localization of subsequent label noise. Additionally, it enlarges robustness against label noise during training and allows target-oriented manipulation during inference. We evaluate the proposed method on Cityscapes, KITTI-STEP, ADE20k, and COCO-stuff10k.

UR - http://www.scopus.com/inward/record.url?scp=85166780399&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2304.13428

DO - 10.48550/arXiv.2304.13428

M3 - Conference contribution

AN - SCOPUS:85166780399

SN - 979-8-3503-0250-9

T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

SP - 3267

EP - 3278

BT - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops

PB - IEEE Computer Society

T2 - 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023

Y2 - 17 June 2023 through 24 June 2023

ER -

Von denselben Autoren