Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Sofiane Laridi
  • Gregory Palmer
  • Kam Ming Mark Tam

External Research Organisations

  • The University of Hong Kong
View graph of relations

Details

Original languageEnglish
Article number26704
JournalScientific reports
Volume14
Issue number1
Publication statusPublished - 4 Nov 2024

Abstract

In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.

Keywords

    Anomaly Detection, Autoencoders, Federated Learning

ASJC Scopus subject areas

Cite this

Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding. / Laridi, Sofiane; Palmer, Gregory; Tam, Kam Ming Mark.
In: Scientific reports, Vol. 14, No. 1, 26704, 04.11.2024.

Research output: Contribution to journalArticleResearchpeer review

Laridi S, Palmer G, Tam KMM. Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding. Scientific reports. 2024 Nov 4;14(1):26704. doi: 10.1038/s41598-024-76961-2
Laridi, Sofiane ; Palmer, Gregory ; Tam, Kam Ming Mark. / Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding. In: Scientific reports. 2024 ; Vol. 14, No. 1.
Download
@article{c24e7ba6f1e74cb3badaf3061cefce82,
title = "Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding",
abstract = "In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.",
keywords = "Anomaly Detection, Autoencoders, Federated Learning",
author = "Sofiane Laridi and Gregory Palmer and Tam, {Kam Ming Mark}",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.",
year = "2024",
month = nov,
day = "4",
doi = "10.1038/s41598-024-76961-2",
language = "English",
volume = "14",
journal = "Scientific reports",
issn = "2045-2322",
publisher = "Nature Publishing Group",
number = "1",

}

Download

TY - JOUR

T1 - Enhanced federated anomaly detection through autoencoders using summary statistics-based thresholding

AU - Laridi, Sofiane

AU - Palmer, Gregory

AU - Tam, Kam Ming Mark

N1 - Publisher Copyright: © The Author(s) 2024.

PY - 2024/11/4

Y1 - 2024/11/4

N2 - In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.

AB - In Federated Learning, Anomaly Detection poses significant challenges due to the decentralized nature of data, especially under Non-IID distributions. This study proposes a federated threshold calculation method that aggregates summary statistics from normal and anomalous data across clients to create a global threshold for Anomaly Detection with federated Autoencoders, enhancing detection accuracy and robustness while ensuring privacy. Extensive experiments on datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, show that our approach consistently outperforms existing federated and local threshold calculation methods. These findings highlight the potential of summary statistics in improving federated Anomaly Detection under Non-IID conditions.

KW - Anomaly Detection

KW - Autoencoders

KW - Federated Learning

UR - http://www.scopus.com/inward/record.url?scp=85208516884&partnerID=8YFLogxK

U2 - 10.1038/s41598-024-76961-2

DO - 10.1038/s41598-024-76961-2

M3 - Article

C2 - 39496691

AN - SCOPUS:85208516884

VL - 14

JO - Scientific reports

JF - Scientific reports

SN - 2045-2322

IS - 1

M1 - 26704

ER -