Loading [MathJax]/extensions/tex2jax.js

Consequence-Aware Sequential Counterfactual Generation

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Philip Naumann
  • Eirini Ntoutsi

Research Organisations

External Research Organisations

  • Freie Universität Berlin (FU Berlin)

Details

Original languageEnglish
Title of host publicationMachine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings
EditorsNuria Oliver, Fernando Pérez-Cruz, Stefan Kramer, Jesse Read, Jose A. Lozano
PublisherSpringer Science and Business Media Deutschland GmbH
Pages682-698
Number of pages17
ISBN (electronic)978-3-030-86520-7
ISBN (print)9783030865191
Publication statusPublished - 10 Sept 2021
EventEuropean Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2021 - Bilbao, Spain
Duration: 13 Sept 202117 Sept 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12976 LNAI
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing approaches assume instant materialization of these changes, ignoring that they may require effort and a specific order of application. Recently, methods have been proposed that also consider the order in which actions are applied, leading to the so-called sequential counterfactual generation problem. In this work, we propose a model-agnostic method for sequential counterfactual generation. We formulate the task as a multi-objective optimization problem and present a genetic algorithm approach to find optimal sequences of actions leading to the counterfactuals. Our cost model considers not only the direct effect of an action, but also its consequences. Experimental results show that compared to state-of-the-art, our approach generates less costly solutions, is more efficient and provides the user with a diverse set of solutions to choose from.

Keywords

    Genetic algorithms, Model-agnostic, Multi-objective optimization, Sequential counterfactuals

ASJC Scopus subject areas

Cite this

Consequence-Aware Sequential Counterfactual Generation. / Naumann, Philip; Ntoutsi, Eirini.
Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings. ed. / Nuria Oliver; Fernando Pérez-Cruz; Stefan Kramer; Jesse Read; Jose A. Lozano. Springer Science and Business Media Deutschland GmbH, 2021. p. 682-698 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12976 LNAI).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Naumann, P & Ntoutsi, E 2021, Consequence-Aware Sequential Counterfactual Generation. in N Oliver, F Pérez-Cruz, S Kramer, J Read & JA Lozano (eds), Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12976 LNAI, Springer Science and Business Media Deutschland GmbH, pp. 682-698, European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2021, Bilbao, Spain, 13 Sept 2021. https://doi.org/10.48550/arXiv.2104.05592, https://doi.org/10.1007/978-3-030-86520-7_42
Naumann, P., & Ntoutsi, E. (2021). Consequence-Aware Sequential Counterfactual Generation. In N. Oliver, F. Pérez-Cruz, S. Kramer, J. Read, & J. A. Lozano (Eds.), Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings (pp. 682-698). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12976 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.48550/arXiv.2104.05592, https://doi.org/10.1007/978-3-030-86520-7_42
Naumann P, Ntoutsi E. Consequence-Aware Sequential Counterfactual Generation. In Oliver N, Pérez-Cruz F, Kramer S, Read J, Lozano JA, editors, Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 682-698. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.48550/arXiv.2104.05592, 10.1007/978-3-030-86520-7_42
Naumann, Philip ; Ntoutsi, Eirini. / Consequence-Aware Sequential Counterfactual Generation. Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings. editor / Nuria Oliver ; Fernando Pérez-Cruz ; Stefan Kramer ; Jesse Read ; Jose A. Lozano. Springer Science and Business Media Deutschland GmbH, 2021. pp. 682-698 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{49a4741e392441e19781a7c64b884db6,
title = "Consequence-Aware Sequential Counterfactual Generation",
abstract = "Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing approaches assume instant materialization of these changes, ignoring that they may require effort and a specific order of application. Recently, methods have been proposed that also consider the order in which actions are applied, leading to the so-called sequential counterfactual generation problem. In this work, we propose a model-agnostic method for sequential counterfactual generation. We formulate the task as a multi-objective optimization problem and present a genetic algorithm approach to find optimal sequences of actions leading to the counterfactuals. Our cost model considers not only the direct effect of an action, but also its consequences. Experimental results show that compared to state-of-the-art, our approach generates less costly solutions, is more efficient and provides the user with a diverse set of solutions to choose from.",
keywords = "Genetic algorithms, Model-agnostic, Multi-objective optimization, Sequential counterfactuals",
author = "Philip Naumann and Eirini Ntoutsi",
year = "2021",
month = sep,
day = "10",
doi = "10.48550/arXiv.2104.05592",
language = "English",
isbn = "9783030865191",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "682--698",
editor = "Nuria Oliver and Fernando P{\'e}rez-Cruz and Stefan Kramer and Jesse Read and Lozano, {Jose A.}",
booktitle = "Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings",
address = "Germany",
note = "European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2021 ; Conference date: 13-09-2021 Through 17-09-2021",

}

Download

TY - GEN

T1 - Consequence-Aware Sequential Counterfactual Generation

AU - Naumann, Philip

AU - Ntoutsi, Eirini

PY - 2021/9/10

Y1 - 2021/9/10

N2 - Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing approaches assume instant materialization of these changes, ignoring that they may require effort and a specific order of application. Recently, methods have been proposed that also consider the order in which actions are applied, leading to the so-called sequential counterfactual generation problem. In this work, we propose a model-agnostic method for sequential counterfactual generation. We formulate the task as a multi-objective optimization problem and present a genetic algorithm approach to find optimal sequences of actions leading to the counterfactuals. Our cost model considers not only the direct effect of an action, but also its consequences. Experimental results show that compared to state-of-the-art, our approach generates less costly solutions, is more efficient and provides the user with a diverse set of solutions to choose from.

AB - Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing approaches assume instant materialization of these changes, ignoring that they may require effort and a specific order of application. Recently, methods have been proposed that also consider the order in which actions are applied, leading to the so-called sequential counterfactual generation problem. In this work, we propose a model-agnostic method for sequential counterfactual generation. We formulate the task as a multi-objective optimization problem and present a genetic algorithm approach to find optimal sequences of actions leading to the counterfactuals. Our cost model considers not only the direct effect of an action, but also its consequences. Experimental results show that compared to state-of-the-art, our approach generates less costly solutions, is more efficient and provides the user with a diverse set of solutions to choose from.

KW - Genetic algorithms

KW - Model-agnostic

KW - Multi-objective optimization

KW - Sequential counterfactuals

UR - http://www.scopus.com/inward/record.url?scp=85115701969&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2104.05592

DO - 10.48550/arXiv.2104.05592

M3 - Conference contribution

AN - SCOPUS:85115701969

SN - 9783030865191

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 682

EP - 698

BT - Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Proceedings

A2 - Oliver, Nuria

A2 - Pérez-Cruz, Fernando

A2 - Kramer, Stefan

A2 - Read, Jesse

A2 - Lozano, Jose A.

PB - Springer Science and Business Media Deutschland GmbH

T2 - European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2021

Y2 - 13 September 2021 through 17 September 2021

ER -