Do End-Users Want Explanations? Analyzing the Role of Explainability as an Emerging Aspect of Non-Functional Requirements

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publication2019 IEEE 27th International Requirements Engineering Conference (RE)
Subtitle of host publicationProceedings
EditorsDaniela Damian, Anna Perini, Seok-Won Lee
Pages223-233
Number of pages11
ISBN (electronic)978-1-7281-3912-8
Publication statusPublished - Sept 2019
Event2019 IEEE 27th International Requirements Engineering Conference (REW) - Jeju, Korea, Republic of
Duration: 23 Sept 201927 Sept 2019

Publication series

NameProceedings of the IEEE International Conference on Requirements Engineering
Volume2019-September
ISSN (Print)1090-705X
ISSN (electronic)2332-6441

Abstract

Software systems are getting more and more complex. Their ubiquitous presence makes users more dependent on them and their correctness in many aspects of daily life. Thus, there is a rising need to make software systems and their decisions more comprehensible. This seems to call for more transparency in software-supported decisions. Therefore, transparency is gaining importance as a non-functional requirement. However, the abstract quality aspect of transparency needs to be better understood and related to mechanisms that can foster it. Integrating explanations in software to leverage systems' opacity has been discussed often. Yet, an important first step is to understand user requirements with respect to explainable software behavior: Are users really interested in transparency, and are explanations considered an adequate mechanism to achieve it? We conducted a survey with 107 end-users to assess their opinion on the current status of transparency in software systems, and what they consider main advantages and disadvantages of explanations embedded in software. The overall attitude towards embedded explanations was positive. However, we also identified potential disadvantages. We assess the relation between explanations and transparency and analyze its possible impact on software quality.

Keywords

    Explanations, Interpretability, Non-Functional Requirements, Qualitative Evaluation, Software Transparency

ASJC Scopus subject areas

Cite this

Do End-Users Want Explanations? Analyzing the Role of Explainability as an Emerging Aspect of Non-Functional Requirements. / Chazette, Larissa; Karras, Oliver; Schneider, Kurt.
2019 IEEE 27th International Requirements Engineering Conference (RE): Proceedings. ed. / Daniela Damian; Anna Perini; Seok-Won Lee. 2019. p. 223-233 8920547 (Proceedings of the IEEE International Conference on Requirements Engineering; Vol. 2019-September).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Chazette, L, Karras, O & Schneider, K 2019, Do End-Users Want Explanations? Analyzing the Role of Explainability as an Emerging Aspect of Non-Functional Requirements. in D Damian, A Perini & S-W Lee (eds), 2019 IEEE 27th International Requirements Engineering Conference (RE): Proceedings., 8920547, Proceedings of the IEEE International Conference on Requirements Engineering, vol. 2019-September, pp. 223-233, 2019 IEEE 27th International Requirements Engineering Conference (REW), Korea, Republic of, 23 Sept 2019. https://doi.org/10.1109/re.2019.00032
Chazette, L., Karras, O., & Schneider, K. (2019). Do End-Users Want Explanations? Analyzing the Role of Explainability as an Emerging Aspect of Non-Functional Requirements. In D. Damian, A. Perini, & S.-W. Lee (Eds.), 2019 IEEE 27th International Requirements Engineering Conference (RE): Proceedings (pp. 223-233). Article 8920547 (Proceedings of the IEEE International Conference on Requirements Engineering; Vol. 2019-September). https://doi.org/10.1109/re.2019.00032
Chazette L, Karras O, Schneider K. Do End-Users Want Explanations? Analyzing the Role of Explainability as an Emerging Aspect of Non-Functional Requirements. In Damian D, Perini A, Lee SW, editors, 2019 IEEE 27th International Requirements Engineering Conference (RE): Proceedings. 2019. p. 223-233. 8920547. (Proceedings of the IEEE International Conference on Requirements Engineering). doi: 10.1109/re.2019.00032
Chazette, Larissa ; Karras, Oliver ; Schneider, Kurt. / Do End-Users Want Explanations? Analyzing the Role of Explainability as an Emerging Aspect of Non-Functional Requirements. 2019 IEEE 27th International Requirements Engineering Conference (RE): Proceedings. editor / Daniela Damian ; Anna Perini ; Seok-Won Lee. 2019. pp. 223-233 (Proceedings of the IEEE International Conference on Requirements Engineering).
Download
@inproceedings{7a2ee5f347024ae2920dded0c5af2592,
title = "Do End-Users Want Explanations?: Analyzing the Role of Explainability as an Emerging Aspect of Non-Functional Requirements",
abstract = "Software systems are getting more and more complex. Their ubiquitous presence makes users more dependent on them and their correctness in many aspects of daily life. Thus, there is a rising need to make software systems and their decisions more comprehensible. This seems to call for more transparency in software-supported decisions. Therefore, transparency is gaining importance as a non-functional requirement. However, the abstract quality aspect of transparency needs to be better understood and related to mechanisms that can foster it. Integrating explanations in software to leverage systems' opacity has been discussed often. Yet, an important first step is to understand user requirements with respect to explainable software behavior: Are users really interested in transparency, and are explanations considered an adequate mechanism to achieve it? We conducted a survey with 107 end-users to assess their opinion on the current status of transparency in software systems, and what they consider main advantages and disadvantages of explanations embedded in software. The overall attitude towards embedded explanations was positive. However, we also identified potential disadvantages. We assess the relation between explanations and transparency and analyze its possible impact on software quality.",
keywords = "Explanations, Interpretability, Non-Functional Requirements, Qualitative Evaluation, Software Transparency",
author = "Larissa Chazette and Oliver Karras and Kurt Schneider",
year = "2019",
month = sep,
doi = "10.1109/re.2019.00032",
language = "English",
isbn = "978-1-7281-3913-5",
series = "Proceedings of the IEEE International Conference on Requirements Engineering",
pages = "223--233",
editor = "Daniela Damian and Anna Perini and Seok-Won Lee",
booktitle = "2019 IEEE 27th International Requirements Engineering Conference (RE)",
note = "2019 IEEE 27th International Requirements Engineering Conference (REW) ; Conference date: 23-09-2019 Through 27-09-2019",

}

Download

TY - GEN

T1 - Do End-Users Want Explanations?

T2 - 2019 IEEE 27th International Requirements Engineering Conference (REW)

AU - Chazette, Larissa

AU - Karras, Oliver

AU - Schneider, Kurt

PY - 2019/9

Y1 - 2019/9

N2 - Software systems are getting more and more complex. Their ubiquitous presence makes users more dependent on them and their correctness in many aspects of daily life. Thus, there is a rising need to make software systems and their decisions more comprehensible. This seems to call for more transparency in software-supported decisions. Therefore, transparency is gaining importance as a non-functional requirement. However, the abstract quality aspect of transparency needs to be better understood and related to mechanisms that can foster it. Integrating explanations in software to leverage systems' opacity has been discussed often. Yet, an important first step is to understand user requirements with respect to explainable software behavior: Are users really interested in transparency, and are explanations considered an adequate mechanism to achieve it? We conducted a survey with 107 end-users to assess their opinion on the current status of transparency in software systems, and what they consider main advantages and disadvantages of explanations embedded in software. The overall attitude towards embedded explanations was positive. However, we also identified potential disadvantages. We assess the relation between explanations and transparency and analyze its possible impact on software quality.

AB - Software systems are getting more and more complex. Their ubiquitous presence makes users more dependent on them and their correctness in many aspects of daily life. Thus, there is a rising need to make software systems and their decisions more comprehensible. This seems to call for more transparency in software-supported decisions. Therefore, transparency is gaining importance as a non-functional requirement. However, the abstract quality aspect of transparency needs to be better understood and related to mechanisms that can foster it. Integrating explanations in software to leverage systems' opacity has been discussed often. Yet, an important first step is to understand user requirements with respect to explainable software behavior: Are users really interested in transparency, and are explanations considered an adequate mechanism to achieve it? We conducted a survey with 107 end-users to assess their opinion on the current status of transparency in software systems, and what they consider main advantages and disadvantages of explanations embedded in software. The overall attitude towards embedded explanations was positive. However, we also identified potential disadvantages. We assess the relation between explanations and transparency and analyze its possible impact on software quality.

KW - Explanations

KW - Interpretability

KW - Non-Functional Requirements

KW - Qualitative Evaluation

KW - Software Transparency

UR - http://www.scopus.com/inward/record.url?scp=85076895913&partnerID=8YFLogxK

U2 - 10.1109/re.2019.00032

DO - 10.1109/re.2019.00032

M3 - Conference contribution

SN - 978-1-7281-3913-5

T3 - Proceedings of the IEEE International Conference on Requirements Engineering

SP - 223

EP - 233

BT - 2019 IEEE 27th International Requirements Engineering Conference (RE)

A2 - Damian, Daniela

A2 - Perini, Anna

A2 - Lee, Seok-Won

Y2 - 23 September 2019 through 27 September 2019

ER -

By the same author(s)