How Explainable Is Your System? Towards a Quality Model for Explainability

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandBeitrag in Buch/SammelwerkForschungPeer-Review

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksRequirements Engineering
UntertitelFoundation for Software Quality - 30th International Working Conference, REFSQ 2024, Proceedings
Herausgeber/-innenDaniel Mendez, Daniel Mendez, Ana Moreira, Ana Moreira
Herausgeber (Verlag)Springer Nature Switzerland AG
Seiten3-19
Seitenumfang17
ISBN (elektronisch)978-3-031-57327-9
ISBN (Print)9783031573262
PublikationsstatusVeröffentlicht - 30 März 2024

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band14588 LNCS
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Abstract

[Context and motivation] Explainability is a software quality aspect that is gaining relevance in the field of requirements engineering. The complexity of modern software systems is steadily growing. Thus, understanding how these systems function becomes increasingly difficult. At the same time, stakeholders rely on these systems in an expanding number of crucial areas, such as medicine and finance. [Question/problem] While a lot of research focuses on how to make AI algorithms explainable, there is a lack of fundamental research on explainability in requirements engineering. For instance, there has been little research on the elicitation and verification of explainability requirements. [Principal ideas/results] Quality models provide means and measures to specify and evaluate quality requirements. As a solid foundation for our quality model, we first conducted a literature review. Based on the results, we then designed a user-centered quality model for explainability. We identified ten different aspects of explainability and offer criteria and metrics to measure them. [Contribution] Our quality model provides metrics that enable software engineers to check whether specified explainability requirements have been met. By identifying different aspects of explainability, we offer a view from different angles that consider different goals of explanations. Thus, we provide a foundation that will improve the management and verification of explainability requirements.

ASJC Scopus Sachgebiete

Zitieren

How Explainable Is Your System? Towards a Quality Model for Explainability. / Deters, Hannah; Droste, Jakob; Obaidi, Martin et al.
Requirements Engineering: Foundation for Software Quality - 30th International Working Conference, REFSQ 2024, Proceedings. Hrsg. / Daniel Mendez; Daniel Mendez; Ana Moreira; Ana Moreira. Springer Nature Switzerland AG, 2024. S. 3-19 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 14588 LNCS).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandBeitrag in Buch/SammelwerkForschungPeer-Review

Deters, H, Droste, J, Obaidi, M & Schneider, K 2024, How Explainable Is Your System? Towards a Quality Model for Explainability. in D Mendez, D Mendez, A Moreira & A Moreira (Hrsg.), Requirements Engineering: Foundation for Software Quality - 30th International Working Conference, REFSQ 2024, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 14588 LNCS, Springer Nature Switzerland AG, S. 3-19. https://doi.org/10.1007/978-3-031-57327-9_1
Deters, H., Droste, J., Obaidi, M., & Schneider, K. (2024). How Explainable Is Your System? Towards a Quality Model for Explainability. In D. Mendez, D. Mendez, A. Moreira, & A. Moreira (Hrsg.), Requirements Engineering: Foundation for Software Quality - 30th International Working Conference, REFSQ 2024, Proceedings (S. 3-19). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 14588 LNCS). Springer Nature Switzerland AG. https://doi.org/10.1007/978-3-031-57327-9_1
Deters H, Droste J, Obaidi M, Schneider K. How Explainable Is Your System? Towards a Quality Model for Explainability. in Mendez D, Mendez D, Moreira A, Moreira A, Hrsg., Requirements Engineering: Foundation for Software Quality - 30th International Working Conference, REFSQ 2024, Proceedings. Springer Nature Switzerland AG. 2024. S. 3-19. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-57327-9_1
Deters, Hannah ; Droste, Jakob ; Obaidi, Martin et al. / How Explainable Is Your System? Towards a Quality Model for Explainability. Requirements Engineering: Foundation for Software Quality - 30th International Working Conference, REFSQ 2024, Proceedings. Hrsg. / Daniel Mendez ; Daniel Mendez ; Ana Moreira ; Ana Moreira. Springer Nature Switzerland AG, 2024. S. 3-19 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inbook{92775e93c37241ba8aae6b5c5b9d8d9d,
title = "How Explainable Is Your System? Towards a Quality Model for Explainability",
abstract = "[Context and motivation] Explainability is a software quality aspect that is gaining relevance in the field of requirements engineering. The complexity of modern software systems is steadily growing. Thus, understanding how these systems function becomes increasingly difficult. At the same time, stakeholders rely on these systems in an expanding number of crucial areas, such as medicine and finance. [Question/problem] While a lot of research focuses on how to make AI algorithms explainable, there is a lack of fundamental research on explainability in requirements engineering. For instance, there has been little research on the elicitation and verification of explainability requirements. [Principal ideas/results] Quality models provide means and measures to specify and evaluate quality requirements. As a solid foundation for our quality model, we first conducted a literature review. Based on the results, we then designed a user-centered quality model for explainability. We identified ten different aspects of explainability and offer criteria and metrics to measure them. [Contribution] Our quality model provides metrics that enable software engineers to check whether specified explainability requirements have been met. By identifying different aspects of explainability, we offer a view from different angles that consider different goals of explanations. Thus, we provide a foundation that will improve the management and verification of explainability requirements.",
keywords = "Explainability, Literature Studies, Metrics, Quality Models, Requirements Engineering",
author = "Hannah Deters and Jakob Droste and Martin Obaidi and Kurt Schneider",
note = "Funding Information: This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Grant No.: 470146331, project softXplain (2022-2025).",
year = "2024",
month = mar,
day = "30",
doi = "10.1007/978-3-031-57327-9_1",
language = "English",
isbn = "9783031573262",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Nature Switzerland AG",
pages = "3--19",
editor = "Daniel Mendez and Daniel Mendez and Ana Moreira and Ana Moreira",
booktitle = "Requirements Engineering",
address = "Switzerland",

}

Download

TY - CHAP

T1 - How Explainable Is Your System? Towards a Quality Model for Explainability

AU - Deters, Hannah

AU - Droste, Jakob

AU - Obaidi, Martin

AU - Schneider, Kurt

N1 - Funding Information: This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Grant No.: 470146331, project softXplain (2022-2025).

PY - 2024/3/30

Y1 - 2024/3/30

N2 - [Context and motivation] Explainability is a software quality aspect that is gaining relevance in the field of requirements engineering. The complexity of modern software systems is steadily growing. Thus, understanding how these systems function becomes increasingly difficult. At the same time, stakeholders rely on these systems in an expanding number of crucial areas, such as medicine and finance. [Question/problem] While a lot of research focuses on how to make AI algorithms explainable, there is a lack of fundamental research on explainability in requirements engineering. For instance, there has been little research on the elicitation and verification of explainability requirements. [Principal ideas/results] Quality models provide means and measures to specify and evaluate quality requirements. As a solid foundation for our quality model, we first conducted a literature review. Based on the results, we then designed a user-centered quality model for explainability. We identified ten different aspects of explainability and offer criteria and metrics to measure them. [Contribution] Our quality model provides metrics that enable software engineers to check whether specified explainability requirements have been met. By identifying different aspects of explainability, we offer a view from different angles that consider different goals of explanations. Thus, we provide a foundation that will improve the management and verification of explainability requirements.

AB - [Context and motivation] Explainability is a software quality aspect that is gaining relevance in the field of requirements engineering. The complexity of modern software systems is steadily growing. Thus, understanding how these systems function becomes increasingly difficult. At the same time, stakeholders rely on these systems in an expanding number of crucial areas, such as medicine and finance. [Question/problem] While a lot of research focuses on how to make AI algorithms explainable, there is a lack of fundamental research on explainability in requirements engineering. For instance, there has been little research on the elicitation and verification of explainability requirements. [Principal ideas/results] Quality models provide means and measures to specify and evaluate quality requirements. As a solid foundation for our quality model, we first conducted a literature review. Based on the results, we then designed a user-centered quality model for explainability. We identified ten different aspects of explainability and offer criteria and metrics to measure them. [Contribution] Our quality model provides metrics that enable software engineers to check whether specified explainability requirements have been met. By identifying different aspects of explainability, we offer a view from different angles that consider different goals of explanations. Thus, we provide a foundation that will improve the management and verification of explainability requirements.

KW - Explainability

KW - Literature Studies

KW - Metrics

KW - Quality Models

KW - Requirements Engineering

UR - http://www.scopus.com/inward/record.url?scp=85190708404&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-57327-9_1

DO - 10.1007/978-3-031-57327-9_1

M3 - Contribution to book/anthology

SN - 9783031573262

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 3

EP - 19

BT - Requirements Engineering

A2 - Mendez, Daniel

A2 - Mendez, Daniel

A2 - Moreira, Ana

A2 - Moreira, Ana

PB - Springer Nature Switzerland AG

ER -

Von denselben Autoren