Learning to Teach Fairness-Aware Deep Multi-task Learning

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Arjun Roy
  • Eirini Ntoutsi

Organisationseinheiten

Externe Organisationen

  • Freie Universität Berlin (FU Berlin)
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksMachine Learning and Knowledge Discovery in Databases
UntertitelEuropean Conference, ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part I
Herausgeber/-innenMassih-Reza Amini, Stéphane Canu, Asja Fischer, Tias Guns, Petra Kralj Novak, Grigorios Tsoumakas
ErscheinungsortCham
Seiten710-726
Seitenumfang17
Auflage1.
ISBN (elektronisch)978-3-031-26387-3
PublikationsstatusVeröffentlicht - 17 März 2023
Veranstaltung22nd Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2022 - Grenoble, Frankreich
Dauer: 19 Sept. 202223 Sept. 2022

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band13713 LNAI
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Abstract

Fairness-aware learning mainly focuses on single task learning (STL). The fairness implications of multi-task learning (MTL) have only recently been considered and a seminal approach has been proposed that considers the fairness-accuracy trade-off for each task and the performance trade-off among different tasks. Instead of a rigid fairness-accuracy trade-off formulation, we propose a flexible approach that learns how to be fair in a MTL setting by selecting which objective (accuracy or fairness) to optimize at each step. We introduce the L2T-FMT algorithm that is a teacher-student network trained collaboratively; the student learns to solve the fair MTL problem while the teacher instructs the student to learn from either accuracy or fairness, depending on what is harder to learn for each task. Moreover, this dynamic selection of which objective to use at each step for each task reduces the number of trade-off weights from 2T to T, where T is the number of tasks. Our experiments on three real datasets show that L2T-FMT improves on both fairness (12–19%) and accuracy (up to 2%) over state-of-the-art approaches.

ASJC Scopus Sachgebiete

Zitieren

Learning to Teach Fairness-Aware Deep Multi-task Learning. / Roy, Arjun; Ntoutsi, Eirini.
Machine Learning and Knowledge Discovery in Databases : European Conference, ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part I. Hrsg. / Massih-Reza Amini; Stéphane Canu; Asja Fischer; Tias Guns; Petra Kralj Novak; Grigorios Tsoumakas. 1. Aufl. Cham, 2023. S. 710-726 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 13713 LNAI).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Roy, A & Ntoutsi, E 2023, Learning to Teach Fairness-Aware Deep Multi-task Learning. in M-R Amini, S Canu, A Fischer, T Guns, P Kralj Novak & G Tsoumakas (Hrsg.), Machine Learning and Knowledge Discovery in Databases : European Conference, ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part I. 1. Aufl., Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 13713 LNAI, Cham, S. 710-726, 22nd Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2022, Grenoble, Frankreich, 19 Sept. 2022. https://doi.org/10.48550/arXiv.2206.08403, https://doi.org/10.1007/978-3-031-26387-3_43
Roy, A., & Ntoutsi, E. (2023). Learning to Teach Fairness-Aware Deep Multi-task Learning. In M.-R. Amini, S. Canu, A. Fischer, T. Guns, P. Kralj Novak, & G. Tsoumakas (Hrsg.), Machine Learning and Knowledge Discovery in Databases : European Conference, ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part I (1. Aufl., S. 710-726). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 13713 LNAI).. https://doi.org/10.48550/arXiv.2206.08403, https://doi.org/10.1007/978-3-031-26387-3_43
Roy A, Ntoutsi E. Learning to Teach Fairness-Aware Deep Multi-task Learning. in Amini MR, Canu S, Fischer A, Guns T, Kralj Novak P, Tsoumakas G, Hrsg., Machine Learning and Knowledge Discovery in Databases : European Conference, ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part I. 1. Aufl. Cham. 2023. S. 710-726. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.48550/arXiv.2206.08403, 10.1007/978-3-031-26387-3_43
Roy, Arjun ; Ntoutsi, Eirini. / Learning to Teach Fairness-Aware Deep Multi-task Learning. Machine Learning and Knowledge Discovery in Databases : European Conference, ECML PKDD 2022, Grenoble, France, September 19–23, 2022, Proceedings, Part I. Hrsg. / Massih-Reza Amini ; Stéphane Canu ; Asja Fischer ; Tias Guns ; Petra Kralj Novak ; Grigorios Tsoumakas. 1. Aufl. Cham, 2023. S. 710-726 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{d44721fbddb34cfbafaa352f4b56bb97,
title = "Learning to Teach Fairness-Aware Deep Multi-task Learning",
abstract = "Fairness-aware learning mainly focuses on single task learning (STL). The fairness implications of multi-task learning (MTL) have only recently been considered and a seminal approach has been proposed that considers the fairness-accuracy trade-off for each task and the performance trade-off among different tasks. Instead of a rigid fairness-accuracy trade-off formulation, we propose a flexible approach that learns how to be fair in a MTL setting by selecting which objective (accuracy or fairness) to optimize at each step. We introduce the L2T-FMT algorithm that is a teacher-student network trained collaboratively; the student learns to solve the fair MTL problem while the teacher instructs the student to learn from either accuracy or fairness, depending on what is harder to learn for each task. Moreover, this dynamic selection of which objective to use at each step for each task reduces the number of trade-off weights from 2T to T, where T is the number of tasks. Our experiments on three real datasets show that L2T-FMT improves on both fairness (12–19%) and accuracy (up to 2%) over state-of-the-art approaches.",
author = "Arjun Roy and Eirini Ntoutsi",
note = "Funding Information: Acknowledgements. The work of A.Roy is supported by Volkswagen Foundation under the call “Artificial Intelligence and the Society of the Future” project “Bias and Discrimination in Big Data and Algorithmic Processing - BIAS”.; 22nd Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2022 ; Conference date: 19-09-2022 Through 23-09-2022",
year = "2023",
month = mar,
day = "17",
doi = "10.48550/arXiv.2206.08403",
language = "English",
isbn = "9783031263866",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "710--726",
editor = "Massih-Reza Amini and St{\'e}phane Canu and Asja Fischer and Tias Guns and {Kralj Novak}, Petra and Grigorios Tsoumakas",
booktitle = "Machine Learning and Knowledge Discovery in Databases",
edition = "1.",

}

Download

TY - GEN

T1 - Learning to Teach Fairness-Aware Deep Multi-task Learning

AU - Roy, Arjun

AU - Ntoutsi, Eirini

N1 - Funding Information: Acknowledgements. The work of A.Roy is supported by Volkswagen Foundation under the call “Artificial Intelligence and the Society of the Future” project “Bias and Discrimination in Big Data and Algorithmic Processing - BIAS”.

PY - 2023/3/17

Y1 - 2023/3/17

N2 - Fairness-aware learning mainly focuses on single task learning (STL). The fairness implications of multi-task learning (MTL) have only recently been considered and a seminal approach has been proposed that considers the fairness-accuracy trade-off for each task and the performance trade-off among different tasks. Instead of a rigid fairness-accuracy trade-off formulation, we propose a flexible approach that learns how to be fair in a MTL setting by selecting which objective (accuracy or fairness) to optimize at each step. We introduce the L2T-FMT algorithm that is a teacher-student network trained collaboratively; the student learns to solve the fair MTL problem while the teacher instructs the student to learn from either accuracy or fairness, depending on what is harder to learn for each task. Moreover, this dynamic selection of which objective to use at each step for each task reduces the number of trade-off weights from 2T to T, where T is the number of tasks. Our experiments on three real datasets show that L2T-FMT improves on both fairness (12–19%) and accuracy (up to 2%) over state-of-the-art approaches.

AB - Fairness-aware learning mainly focuses on single task learning (STL). The fairness implications of multi-task learning (MTL) have only recently been considered and a seminal approach has been proposed that considers the fairness-accuracy trade-off for each task and the performance trade-off among different tasks. Instead of a rigid fairness-accuracy trade-off formulation, we propose a flexible approach that learns how to be fair in a MTL setting by selecting which objective (accuracy or fairness) to optimize at each step. We introduce the L2T-FMT algorithm that is a teacher-student network trained collaboratively; the student learns to solve the fair MTL problem while the teacher instructs the student to learn from either accuracy or fairness, depending on what is harder to learn for each task. Moreover, this dynamic selection of which objective to use at each step for each task reduces the number of trade-off weights from 2T to T, where T is the number of tasks. Our experiments on three real datasets show that L2T-FMT improves on both fairness (12–19%) and accuracy (up to 2%) over state-of-the-art approaches.

UR - http://www.scopus.com/inward/record.url?scp=85151065743&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2206.08403

DO - 10.48550/arXiv.2206.08403

M3 - Conference contribution

AN - SCOPUS:85151065743

SN - 9783031263866

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 710

EP - 726

BT - Machine Learning and Knowledge Discovery in Databases

A2 - Amini, Massih-Reza

A2 - Canu, Stéphane

A2 - Fischer, Asja

A2 - Guns, Tias

A2 - Kralj Novak, Petra

A2 - Tsoumakas, Grigorios

CY - Cham

T2 - 22nd Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2022

Y2 - 19 September 2022 through 23 September 2022

ER -