Requirements on Explanations: A Quality Framework for Explainability

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • Technische Universität Berlin
  • Graphmasters GmbH
View graph of relations

Details

Original languageEnglish
Title of host publication2022 IEEE 30th International Requirements Engineering Conference (RE)
EditorsEric Knauss, Gunter Mussbacher, Chetan Arora, Muneera Bano, Jean-Guy Schneider
Pages140-152
Number of pages13
ISBN (electronic)978-1-6654-7000-1
Publication statusPublished - 2022

Publication series

NameProceedings of the IEEE International Conference on Requirements Engineering
Volume2022-August
ISSN (Print)1090-705X
ISSN (electronic)2332-6441

Abstract

Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.

Keywords

    Case Study, Explainability, Explainable Systems, Explanations, NonFunctional Requirements, Quality Aspects

ASJC Scopus subject areas

Cite this

Requirements on Explanations: A Quality Framework for Explainability. / Chazette, Larissa; Klös, Verena; Herzog, Florian et al.
2022 IEEE 30th International Requirements Engineering Conference (RE). ed. / Eric Knauss; Gunter Mussbacher; Chetan Arora; Muneera Bano; Jean-Guy Schneider. 2022. p. 140-152 (Proceedings of the IEEE International Conference on Requirements Engineering; Vol. 2022-August).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Chazette, L, Klös, V, Herzog, F & Schneider, K 2022, Requirements on Explanations: A Quality Framework for Explainability. in E Knauss, G Mussbacher, C Arora, M Bano & J-G Schneider (eds), 2022 IEEE 30th International Requirements Engineering Conference (RE). Proceedings of the IEEE International Conference on Requirements Engineering, vol. 2022-August, pp. 140-152. https://doi.org/10.1109/RE54965.2022.00019
Chazette, L., Klös, V., Herzog, F., & Schneider, K. (2022). Requirements on Explanations: A Quality Framework for Explainability. In E. Knauss, G. Mussbacher, C. Arora, M. Bano, & J.-G. Schneider (Eds.), 2022 IEEE 30th International Requirements Engineering Conference (RE) (pp. 140-152). (Proceedings of the IEEE International Conference on Requirements Engineering; Vol. 2022-August). https://doi.org/10.1109/RE54965.2022.00019
Chazette L, Klös V, Herzog F, Schneider K. Requirements on Explanations: A Quality Framework for Explainability. In Knauss E, Mussbacher G, Arora C, Bano M, Schneider JG, editors, 2022 IEEE 30th International Requirements Engineering Conference (RE). 2022. p. 140-152. (Proceedings of the IEEE International Conference on Requirements Engineering). doi: 10.1109/RE54965.2022.00019
Chazette, Larissa ; Klös, Verena ; Herzog, Florian et al. / Requirements on Explanations : A Quality Framework for Explainability. 2022 IEEE 30th International Requirements Engineering Conference (RE). editor / Eric Knauss ; Gunter Mussbacher ; Chetan Arora ; Muneera Bano ; Jean-Guy Schneider. 2022. pp. 140-152 (Proceedings of the IEEE International Conference on Requirements Engineering).
Download
@inproceedings{3bc763a3d8364a0785e75457bba00819,
title = "Requirements on Explanations: A Quality Framework for Explainability",
abstract = "Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.",
keywords = "Case Study, Explainability, Explainable Systems, Explanations, NonFunctional Requirements, Quality Aspects",
author = "Larissa Chazette and Verena Kl{\"o}s and Florian Herzog and Kurt Schneider",
note = "Funding information: ACKNOWLEDGMENTS This work was supported by the research initiative Mobilise between the Technical University of Braunschweig and Leibniz University Hannover, funded by the Ministry for Science and Culture of Lower Saxony. We thank the Graphmasters GmbH for their valuable cooperation, all case study participants, and the anonymous reviewers who gave feedback on our manuscript.",
year = "2022",
doi = "10.1109/RE54965.2022.00019",
language = "English",
isbn = "978-1-6654-7001-8",
series = "Proceedings of the IEEE International Conference on Requirements Engineering",
pages = "140--152",
editor = "Eric Knauss and Gunter Mussbacher and Chetan Arora and Muneera Bano and Jean-Guy Schneider",
booktitle = "2022 IEEE 30th International Requirements Engineering Conference (RE)",

}

Download

TY - GEN

T1 - Requirements on Explanations

T2 - A Quality Framework for Explainability

AU - Chazette, Larissa

AU - Klös, Verena

AU - Herzog, Florian

AU - Schneider, Kurt

N1 - Funding information: ACKNOWLEDGMENTS This work was supported by the research initiative Mobilise between the Technical University of Braunschweig and Leibniz University Hannover, funded by the Ministry for Science and Culture of Lower Saxony. We thank the Graphmasters GmbH for their valuable cooperation, all case study participants, and the anonymous reviewers who gave feedback on our manuscript.

PY - 2022

Y1 - 2022

N2 - Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.

AB - Explainability has been acknowledged as a fundamental requirement for modern information systems. However, there are currently only few guidelines available to assist software professionals in dealing with this requirement and integrating it into systems. More precisely, there is a lack of frameworks and guidelines that help to define and operationalize explainability requirements. To address this need, we present a quality framework that aggregates external dependencies, characteristics of explanations, and evaluation methods to facilitate the analysis, operationalization, and evaluation of explainability requirements. We conducted a literature study to construct the framework and demonstrated its applicability by using it as a guideline for incorporating explanations into an existing navigation system. Finally, we evaluated the quality and effect of the explanations through an experiment within our case study. Our results show that the quality framework is applicable and beneficial in an industrial context and leads to the construction of explanations that increase usage frequency, system acceptance and user satisfaction.

KW - Case Study

KW - Explainability

KW - Explainable Systems

KW - Explanations

KW - NonFunctional Requirements

KW - Quality Aspects

UR - http://www.scopus.com/inward/record.url?scp=85140978973&partnerID=8YFLogxK

U2 - 10.1109/RE54965.2022.00019

DO - 10.1109/RE54965.2022.00019

M3 - Conference contribution

SN - 978-1-6654-7001-8

T3 - Proceedings of the IEEE International Conference on Requirements Engineering

SP - 140

EP - 152

BT - 2022 IEEE 30th International Requirements Engineering Conference (RE)

A2 - Knauss, Eric

A2 - Mussbacher, Gunter

A2 - Arora, Chetan

A2 - Bano, Muneera

A2 - Schneider, Jean-Guy

ER -

By the same author(s)