Multivariate Time Series Analysis: An Interpretable CNN-based Model

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Raneen Younis
  • Sergej Zerr
  • Zahra Ahmadi

Organisationseinheiten

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2022 IEEE 9th International Conference on Data Science and Advanced Analytics
Untertitel(DSAA)
Herausgeber/-innenJoshua Zhexue Huang, Yi Pan, Barbara Hammer, Muhammad Khurram Khan, Xing Xie, Laizhong Cui, Yulin He
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
ISBN (elektronisch)9781665473309
ISBN (Print)978-1-6654-7331-6
PublikationsstatusVeröffentlicht - 2022
Veranstaltung9th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2022 - Shenzhen, China
Dauer: 13 Okt. 202216 Okt. 2022

Abstract

Deep neural networks, especially the Convolutional Neural Network (CNN) models, have shown promising results in multivariate time series data analysis. However, the predictions of these data-driven black-box models are tough to interpret from a human perspective, making it questionable to trust and rely on the predictions made by these models, specifically for time series data with the append-only feature. This paper proposes a new approach to interpret the CNN outputs by extracting and clustering the activated time series sequences learned from a trained network. These sequences show the representative features for each output label and form interpretable representations from the original time series data. Our approach is the first framework to identify each signal's role and dependencies, consider all possible combinations of signals in the multivariate time-series input, and visualize the data representative features. Our experiments on the Baydogan's archive indicate remarkable improvements in the interpretability of the network predictions and relation identification of each input signal to the output label and the channels of the network layers. Furthermore, the conducted experiments confirm that the extracted patterns are representative of the multivariate input and changing them results in a drastic reduction in the prediction accuracy.

ASJC Scopus Sachgebiete

Zitieren

Multivariate Time Series Analysis: An Interpretable CNN-based Model. / Younis, Raneen; Zerr, Sergej; Ahmadi, Zahra.
2022 IEEE 9th International Conference on Data Science and Advanced Analytics : (DSAA). Hrsg. / Joshua Zhexue Huang; Yi Pan; Barbara Hammer; Muhammad Khurram Khan; Xing Xie; Laizhong Cui; Yulin He. Institute of Electrical and Electronics Engineers Inc., 2022.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Younis, R, Zerr, S & Ahmadi, Z 2022, Multivariate Time Series Analysis: An Interpretable CNN-based Model. in JZ Huang, Y Pan, B Hammer, MK Khan, X Xie, L Cui & Y He (Hrsg.), 2022 IEEE 9th International Conference on Data Science and Advanced Analytics : (DSAA). Institute of Electrical and Electronics Engineers Inc., 9th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2022, Shenzhen, China, 13 Okt. 2022. https://doi.org/10.1109/DSAA54385.2022.10032335
Younis, R., Zerr, S., & Ahmadi, Z. (2022). Multivariate Time Series Analysis: An Interpretable CNN-based Model. In J. Z. Huang, Y. Pan, B. Hammer, M. K. Khan, X. Xie, L. Cui, & Y. He (Hrsg.), 2022 IEEE 9th International Conference on Data Science and Advanced Analytics : (DSAA) Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DSAA54385.2022.10032335
Younis R, Zerr S, Ahmadi Z. Multivariate Time Series Analysis: An Interpretable CNN-based Model. in Huang JZ, Pan Y, Hammer B, Khan MK, Xie X, Cui L, He Y, Hrsg., 2022 IEEE 9th International Conference on Data Science and Advanced Analytics : (DSAA). Institute of Electrical and Electronics Engineers Inc. 2022 doi: 10.1109/DSAA54385.2022.10032335
Younis, Raneen ; Zerr, Sergej ; Ahmadi, Zahra. / Multivariate Time Series Analysis : An Interpretable CNN-based Model. 2022 IEEE 9th International Conference on Data Science and Advanced Analytics : (DSAA). Hrsg. / Joshua Zhexue Huang ; Yi Pan ; Barbara Hammer ; Muhammad Khurram Khan ; Xing Xie ; Laizhong Cui ; Yulin He. Institute of Electrical and Electronics Engineers Inc., 2022.
Download
@inproceedings{472a93f85e584932af0caf0383ce6168,
title = "Multivariate Time Series Analysis: An Interpretable CNN-based Model",
abstract = "Deep neural networks, especially the Convolutional Neural Network (CNN) models, have shown promising results in multivariate time series data analysis. However, the predictions of these data-driven black-box models are tough to interpret from a human perspective, making it questionable to trust and rely on the predictions made by these models, specifically for time series data with the append-only feature. This paper proposes a new approach to interpret the CNN outputs by extracting and clustering the activated time series sequences learned from a trained network. These sequences show the representative features for each output label and form interpretable representations from the original time series data. Our approach is the first framework to identify each signal's role and dependencies, consider all possible combinations of signals in the multivariate time-series input, and visualize the data representative features. Our experiments on the Baydogan's archive indicate remarkable improvements in the interpretability of the network predictions and relation identification of each input signal to the output label and the channels of the network layers. Furthermore, the conducted experiments confirm that the extracted patterns are representative of the multivariate input and changing them results in a drastic reduction in the prediction accuracy.",
keywords = "classification, interpretability, neural networks, time series",
author = "Raneen Younis and Sergej Zerr and Zahra Ahmadi",
note = "Funding Information: This work was supported by German Federal Ministry of Education and Research (BMBF) under grant agreement No. 01IS19063A (project HAISEM-Lab, 2019-2022), and the European Union{\textquoteright}s Horizon 2020 research and innovation program under grant agreement No. 833635 (project ROXANNE: Real-time network, text, and speaker analytics for combating organized crime, 2019-2022). ; 9th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2022 ; Conference date: 13-10-2022 Through 16-10-2022",
year = "2022",
doi = "10.1109/DSAA54385.2022.10032335",
language = "English",
isbn = "978-1-6654-7331-6",
editor = "Huang, {Joshua Zhexue} and Yi Pan and Barbara Hammer and Khan, {Muhammad Khurram} and Xing Xie and Laizhong Cui and Yulin He",
booktitle = "2022 IEEE 9th International Conference on Data Science and Advanced Analytics",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Download

TY - GEN

T1 - Multivariate Time Series Analysis

T2 - 9th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2022

AU - Younis, Raneen

AU - Zerr, Sergej

AU - Ahmadi, Zahra

N1 - Funding Information: This work was supported by German Federal Ministry of Education and Research (BMBF) under grant agreement No. 01IS19063A (project HAISEM-Lab, 2019-2022), and the European Union’s Horizon 2020 research and innovation program under grant agreement No. 833635 (project ROXANNE: Real-time network, text, and speaker analytics for combating organized crime, 2019-2022).

PY - 2022

Y1 - 2022

N2 - Deep neural networks, especially the Convolutional Neural Network (CNN) models, have shown promising results in multivariate time series data analysis. However, the predictions of these data-driven black-box models are tough to interpret from a human perspective, making it questionable to trust and rely on the predictions made by these models, specifically for time series data with the append-only feature. This paper proposes a new approach to interpret the CNN outputs by extracting and clustering the activated time series sequences learned from a trained network. These sequences show the representative features for each output label and form interpretable representations from the original time series data. Our approach is the first framework to identify each signal's role and dependencies, consider all possible combinations of signals in the multivariate time-series input, and visualize the data representative features. Our experiments on the Baydogan's archive indicate remarkable improvements in the interpretability of the network predictions and relation identification of each input signal to the output label and the channels of the network layers. Furthermore, the conducted experiments confirm that the extracted patterns are representative of the multivariate input and changing them results in a drastic reduction in the prediction accuracy.

AB - Deep neural networks, especially the Convolutional Neural Network (CNN) models, have shown promising results in multivariate time series data analysis. However, the predictions of these data-driven black-box models are tough to interpret from a human perspective, making it questionable to trust and rely on the predictions made by these models, specifically for time series data with the append-only feature. This paper proposes a new approach to interpret the CNN outputs by extracting and clustering the activated time series sequences learned from a trained network. These sequences show the representative features for each output label and form interpretable representations from the original time series data. Our approach is the first framework to identify each signal's role and dependencies, consider all possible combinations of signals in the multivariate time-series input, and visualize the data representative features. Our experiments on the Baydogan's archive indicate remarkable improvements in the interpretability of the network predictions and relation identification of each input signal to the output label and the channels of the network layers. Furthermore, the conducted experiments confirm that the extracted patterns are representative of the multivariate input and changing them results in a drastic reduction in the prediction accuracy.

KW - classification

KW - interpretability

KW - neural networks

KW - time series

UR - http://www.scopus.com/inward/record.url?scp=85148536963&partnerID=8YFLogxK

U2 - 10.1109/DSAA54385.2022.10032335

DO - 10.1109/DSAA54385.2022.10032335

M3 - Conference contribution

AN - SCOPUS:85148536963

SN - 978-1-6654-7331-6

BT - 2022 IEEE 9th International Conference on Data Science and Advanced Analytics

A2 - Huang, Joshua Zhexue

A2 - Pan, Yi

A2 - Hammer, Barbara

A2 - Khan, Muhammad Khurram

A2 - Xie, Xing

A2 - Cui, Laizhong

A2 - He, Yulin

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 13 October 2022 through 16 October 2022

ER -