Multi-dimensional Discrimination in Law and Machine Learning: A Comparative Overview

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Arjun Roy
  • Jan Horstmann
  • Eirini Ntoutsi

Research Organisations

External Research Organisations

  • Freie Universität Berlin (FU Berlin)
  • Universität der Bundeswehr München
View graph of relations

Details

Original languageEnglish
Title of host publicationFAccT '23
Subtitle of host publicationProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency
PublisherAssociation for Computing Machinery (ACM)
Pages89-100
Number of pages12
ISBN (electronic)9781450372527
Publication statusPublished - 12 Jun 2023
Event6th ACM Conference on Fairness, Accountability, and Transparency, FAccT 2023 - Chicago, United States
Duration: 12 Jun 202315 Jun 2023

Publication series

NameACM International Conference Proceeding Series

Abstract

AI-driven decision-making can lead to discrimination against certain individuals or social groups based on protected characteristics/attributes such as race, gender, or age. The domain of fairness-aware machine learning focuses on methods and algorithms for understanding, mitigating, and accounting for bias in AI/ML models. Still, thus far, the vast majority of the proposed methods assess fairness based on a single protected attribute, e.g. only gender or race. In reality, though, human identities are multi-dimensional, and discrimination can occur based on more than one protected characteristic, leading to the so-called "multi-dimensional discrimination"or "multi-dimensional fairness"problem. While well-elaborated in legal literature, the multi-dimensionality of discrimination is less explored in the machine learning community. Recent approaches in this direction mainly follow the so-called intersectional fairness definition from the legal domain, whereas other notions like additive and sequential discrimination are less studied or not considered thus far. In this work, we overview the different definitions of multi-dimensional discrimination/fairness in the legal domain as well as how they have been transferred/ operationalized (if) in the fairness-aware machine learning domain. By juxtaposing these two domains, we draw the connections, identify the limitations, and point out open research directions.

Keywords

    additive fairness, intersectional fairness, multi-discrimination, multi-fairness, sequential fairness

ASJC Scopus subject areas

Cite this

Multi-dimensional Discrimination in Law and Machine Learning: A Comparative Overview. / Roy, Arjun; Horstmann, Jan; Ntoutsi, Eirini.
FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery (ACM), 2023. p. 89-100 (ACM International Conference Proceeding Series).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Roy, A, Horstmann, J & Ntoutsi, E 2023, Multi-dimensional Discrimination in Law and Machine Learning: A Comparative Overview. in FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. ACM International Conference Proceeding Series, Association for Computing Machinery (ACM), pp. 89-100, 6th ACM Conference on Fairness, Accountability, and Transparency, FAccT 2023, Chicago, United States, 12 Jun 2023. https://doi.org/10.48550/arXiv.2302.05995, https://doi.org/10.1145/3593013.3593979
Roy, A., Horstmann, J., & Ntoutsi, E. (2023). Multi-dimensional Discrimination in Law and Machine Learning: A Comparative Overview. In FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (pp. 89-100). (ACM International Conference Proceeding Series). Association for Computing Machinery (ACM). https://doi.org/10.48550/arXiv.2302.05995, https://doi.org/10.1145/3593013.3593979
Roy A, Horstmann J, Ntoutsi E. Multi-dimensional Discrimination in Law and Machine Learning: A Comparative Overview. In FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery (ACM). 2023. p. 89-100. (ACM International Conference Proceeding Series). doi: 10.48550/arXiv.2302.05995, 10.1145/3593013.3593979
Roy, Arjun ; Horstmann, Jan ; Ntoutsi, Eirini. / Multi-dimensional Discrimination in Law and Machine Learning : A Comparative Overview. FAccT '23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery (ACM), 2023. pp. 89-100 (ACM International Conference Proceeding Series).
Download
@inproceedings{a9ffe49c62ff4f299a1ef9962275c8a6,
title = "Multi-dimensional Discrimination in Law and Machine Learning: A Comparative Overview",
abstract = "AI-driven decision-making can lead to discrimination against certain individuals or social groups based on protected characteristics/attributes such as race, gender, or age. The domain of fairness-aware machine learning focuses on methods and algorithms for understanding, mitigating, and accounting for bias in AI/ML models. Still, thus far, the vast majority of the proposed methods assess fairness based on a single protected attribute, e.g. only gender or race. In reality, though, human identities are multi-dimensional, and discrimination can occur based on more than one protected characteristic, leading to the so-called {"}multi-dimensional discrimination{"}or {"}multi-dimensional fairness{"}problem. While well-elaborated in legal literature, the multi-dimensionality of discrimination is less explored in the machine learning community. Recent approaches in this direction mainly follow the so-called intersectional fairness definition from the legal domain, whereas other notions like additive and sequential discrimination are less studied or not considered thus far. In this work, we overview the different definitions of multi-dimensional discrimination/fairness in the legal domain as well as how they have been transferred/ operationalized (if) in the fairness-aware machine learning domain. By juxtaposing these two domains, we draw the connections, identify the limitations, and point out open research directions.",
keywords = "additive fairness, intersectional fairness, multi-discrimination, multi-fairness, sequential fairness",
author = "Arjun Roy and Jan Horstmann and Eirini Ntoutsi",
note = "Funding Information: This research work is funded by Volkswagen Foundation under the call “Artificial Intelligence and the Society of the Future{"} project “Bias and Discrimination in Big Data and Algorithmic Processing -BIAS” and by the European Union under the Horizon Europe MAMMOth project, Grant Agreement ID: 101070285. We especially thank our colleagues in the projects for invaluable discussions and helpful suggestions; 6th ACM Conference on Fairness, Accountability, and Transparency, FAccT 2023 ; Conference date: 12-06-2023 Through 15-06-2023",
year = "2023",
month = jun,
day = "12",
doi = "10.48550/arXiv.2302.05995",
language = "English",
series = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery (ACM)",
pages = "89--100",
booktitle = "FAccT '23",
address = "United States",

}

Download

TY - GEN

T1 - Multi-dimensional Discrimination in Law and Machine Learning

T2 - 6th ACM Conference on Fairness, Accountability, and Transparency, FAccT 2023

AU - Roy, Arjun

AU - Horstmann, Jan

AU - Ntoutsi, Eirini

N1 - Funding Information: This research work is funded by Volkswagen Foundation under the call “Artificial Intelligence and the Society of the Future" project “Bias and Discrimination in Big Data and Algorithmic Processing -BIAS” and by the European Union under the Horizon Europe MAMMOth project, Grant Agreement ID: 101070285. We especially thank our colleagues in the projects for invaluable discussions and helpful suggestions

PY - 2023/6/12

Y1 - 2023/6/12

N2 - AI-driven decision-making can lead to discrimination against certain individuals or social groups based on protected characteristics/attributes such as race, gender, or age. The domain of fairness-aware machine learning focuses on methods and algorithms for understanding, mitigating, and accounting for bias in AI/ML models. Still, thus far, the vast majority of the proposed methods assess fairness based on a single protected attribute, e.g. only gender or race. In reality, though, human identities are multi-dimensional, and discrimination can occur based on more than one protected characteristic, leading to the so-called "multi-dimensional discrimination"or "multi-dimensional fairness"problem. While well-elaborated in legal literature, the multi-dimensionality of discrimination is less explored in the machine learning community. Recent approaches in this direction mainly follow the so-called intersectional fairness definition from the legal domain, whereas other notions like additive and sequential discrimination are less studied or not considered thus far. In this work, we overview the different definitions of multi-dimensional discrimination/fairness in the legal domain as well as how they have been transferred/ operationalized (if) in the fairness-aware machine learning domain. By juxtaposing these two domains, we draw the connections, identify the limitations, and point out open research directions.

AB - AI-driven decision-making can lead to discrimination against certain individuals or social groups based on protected characteristics/attributes such as race, gender, or age. The domain of fairness-aware machine learning focuses on methods and algorithms for understanding, mitigating, and accounting for bias in AI/ML models. Still, thus far, the vast majority of the proposed methods assess fairness based on a single protected attribute, e.g. only gender or race. In reality, though, human identities are multi-dimensional, and discrimination can occur based on more than one protected characteristic, leading to the so-called "multi-dimensional discrimination"or "multi-dimensional fairness"problem. While well-elaborated in legal literature, the multi-dimensionality of discrimination is less explored in the machine learning community. Recent approaches in this direction mainly follow the so-called intersectional fairness definition from the legal domain, whereas other notions like additive and sequential discrimination are less studied or not considered thus far. In this work, we overview the different definitions of multi-dimensional discrimination/fairness in the legal domain as well as how they have been transferred/ operationalized (if) in the fairness-aware machine learning domain. By juxtaposing these two domains, we draw the connections, identify the limitations, and point out open research directions.

KW - additive fairness

KW - intersectional fairness

KW - multi-discrimination

KW - multi-fairness

KW - sequential fairness

UR - http://www.scopus.com/inward/record.url?scp=85163682034&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2302.05995

DO - 10.48550/arXiv.2302.05995

M3 - Conference contribution

AN - SCOPUS:85163682034

T3 - ACM International Conference Proceeding Series

SP - 89

EP - 100

BT - FAccT '23

PB - Association for Computing Machinery (ACM)

Y2 - 12 June 2023 through 15 June 2023

ER -