Requirements on Explanations: A Quality Framework for Explainability

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Organisationseinheiten

Externe Organisationen

  • Technische Universität Berlin
  • Graphmasters GmbH
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2022 IEEE 30th International Requirements Engineering Conference (RE)
Herausgeber/-innenEric Knauss, Gunter Mussbacher, Chetan Arora, Muneera Bano, Jean-Guy Schneider
Seiten140-152
Seitenumfang13
ISBN (elektronisch)978-1-6654-7000-1
PublikationsstatusVeröffentlicht - 2022

Publikationsreihe

NameProceedings of the IEEE International Conference on Requirements Engineering
Band2022-August
ISSN (Print)1090-705X
ISSN (elektronisch)2332-6441

Abstract

Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.

ASJC Scopus Sachgebiete

Zitieren

Requirements on Explanations: A Quality Framework for Explainability. / Chazette, Larissa; Klös, Verena; Herzog, Florian et al.
2022 IEEE 30th International Requirements Engineering Conference (RE). Hrsg. / Eric Knauss; Gunter Mussbacher; Chetan Arora; Muneera Bano; Jean-Guy Schneider. 2022. S. 140-152 (Proceedings of the IEEE International Conference on Requirements Engineering; Band 2022-August).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Chazette, L, Klös, V, Herzog, F & Schneider, K 2022, Requirements on Explanations: A Quality Framework for Explainability. in E Knauss, G Mussbacher, C Arora, M Bano & J-G Schneider (Hrsg.), 2022 IEEE 30th International Requirements Engineering Conference (RE). Proceedings of the IEEE International Conference on Requirements Engineering, Bd. 2022-August, S. 140-152. https://doi.org/10.1109/RE54965.2022.00019
Chazette, L., Klös, V., Herzog, F., & Schneider, K. (2022). Requirements on Explanations: A Quality Framework for Explainability. In E. Knauss, G. Mussbacher, C. Arora, M. Bano, & J.-G. Schneider (Hrsg.), 2022 IEEE 30th International Requirements Engineering Conference (RE) (S. 140-152). (Proceedings of the IEEE International Conference on Requirements Engineering; Band 2022-August). https://doi.org/10.1109/RE54965.2022.00019
Chazette L, Klös V, Herzog F, Schneider K. Requirements on Explanations: A Quality Framework for Explainability. in Knauss E, Mussbacher G, Arora C, Bano M, Schneider JG, Hrsg., 2022 IEEE 30th International Requirements Engineering Conference (RE). 2022. S. 140-152. (Proceedings of the IEEE International Conference on Requirements Engineering). doi: 10.1109/RE54965.2022.00019
Chazette, Larissa ; Klös, Verena ; Herzog, Florian et al. / Requirements on Explanations : A Quality Framework for Explainability. 2022 IEEE 30th International Requirements Engineering Conference (RE). Hrsg. / Eric Knauss ; Gunter Mussbacher ; Chetan Arora ; Muneera Bano ; Jean-Guy Schneider. 2022. S. 140-152 (Proceedings of the IEEE International Conference on Requirements Engineering).
Download
@inproceedings{3bc763a3d8364a0785e75457bba00819,
title = "Requirements on Explanations: A Quality Framework for Explainability",
abstract = "Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.",
keywords = "Case Study, Explainability, Explainable Systems, Explanations, NonFunctional Requirements, Quality Aspects",
author = "Larissa Chazette and Verena Kl{\"o}s and Florian Herzog and Kurt Schneider",
note = "Funding information: ACKNOWLEDGMENTS This work was supported by the research initiative Mobilise between the Technical University of Braunschweig and Leibniz University Hannover, funded by the Ministry for Science and Culture of Lower Saxony. We thank the Graphmasters GmbH for their valuable cooperation, all case study participants, and the anonymous reviewers who gave feedback on our manuscript.",
year = "2022",
doi = "10.1109/RE54965.2022.00019",
language = "English",
isbn = "978-1-6654-7001-8",
series = "Proceedings of the IEEE International Conference on Requirements Engineering",
pages = "140--152",
editor = "Eric Knauss and Gunter Mussbacher and Chetan Arora and Muneera Bano and Jean-Guy Schneider",
booktitle = "2022 IEEE 30th International Requirements Engineering Conference (RE)",

}

Download

TY - GEN

T1 - Requirements on Explanations

T2 - A Quality Framework for Explainability

AU - Chazette, Larissa

AU - Klös, Verena

AU - Herzog, Florian

AU - Schneider, Kurt

N1 - Funding information: ACKNOWLEDGMENTS This work was supported by the research initiative Mobilise between the Technical University of Braunschweig and Leibniz University Hannover, funded by the Ministry for Science and Culture of Lower Saxony. We thank the Graphmasters GmbH for their valuable cooperation, all case study participants, and the anonymous reviewers who gave feedback on our manuscript.

PY - 2022

Y1 - 2022

N2 - Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.

AB - Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.

KW - Case Study

KW - Explainability

KW - Explainable Systems

KW - Explanations

KW - NonFunctional Requirements

KW - Quality Aspects

UR - http://www.scopus.com/inward/record.url?scp=85140978973&partnerID=8YFLogxK

U2 - 10.1109/RE54965.2022.00019

DO - 10.1109/RE54965.2022.00019

M3 - Conference contribution

SN - 978-1-6654-7001-8

T3 - Proceedings of the IEEE International Conference on Requirements Engineering

SP - 140

EP - 152

BT - 2022 IEEE 30th International Requirements Engineering Conference (RE)

A2 - Knauss, Eric

A2 - Mussbacher, Gunter

A2 - Arora, Chetan

A2 - Bano, Muneera

A2 - Schneider, Jean-Guy

ER -

Von denselben Autoren