Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

  • Sofiane Laridi
  • Gregory Palmer
  • Kam Ming Mark Tam

Externe Organisationen

  • The University of Hong Kong
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Aufsatznummer26704
FachzeitschriftScientific reports
Jahrgang14
Ausgabenummer1
PublikationsstatusVeröffentlicht - 4 Nov. 2024

Abstract

In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.

ASJC Scopus Sachgebiete

Zitieren

Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding. / Laridi, Sofiane; Palmer, Gregory; Tam, Kam Ming Mark.
in: Scientific reports, Jahrgang 14, Nr. 1, 26704, 04.11.2024.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Laridi S, Palmer G, Tam KMM. Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding. Scientific reports. 2024 Nov 4;14(1):26704. doi: 10.1038/s41598-024-76961-2
Laridi, Sofiane ; Palmer, Gregory ; Tam, Kam Ming Mark. / Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding. in: Scientific reports. 2024 ; Jahrgang 14, Nr. 1.
Download
@article{c24e7ba6f1e74cb3badaf3061cefce82,
title = "Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding",
abstract = "In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.",
keywords = "Anomaly Detection, Autoencoders, Federated Learning",
author = "Sofiane Laridi and Gregory Palmer and Tam, {Kam Ming Mark}",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.",
year = "2024",
month = nov,
day = "4",
doi = "10.1038/s41598-024-76961-2",
language = "English",
volume = "14",
journal = "Scientific reports",
issn = "2045-2322",
publisher = "Nature Publishing Group",
number = "1",

}

Download

TY - JOUR

T1 - Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding

AU - Laridi, Sofiane

AU - Palmer, Gregory

AU - Tam, Kam Ming Mark

N1 - Publisher Copyright: © The Author(s) 2024.

PY - 2024/11/4

Y1 - 2024/11/4

N2 - In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.

AB - In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.

KW - Anomaly Detection

KW - Autoencoders

KW - Federated Learning

UR - http://www.scopus.com/inward/record.url?scp=85208516884&partnerID=8YFLogxK

U2 - 10.1038/s41598-024-76961-2

DO - 10.1038/s41598-024-76961-2

M3 - Article

C2 - 39496691

AN - SCOPUS:85208516884

VL - 14

JO - Scientific reports

JF - Scientific reports

SN - 2045-2322

IS - 1

M1 - 26704

ER -