Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • University of Liverpool
  • University of Strathclyde
View graph of relations

Details

Original languageEnglish
Title of host publicationProceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022
EditorsMichael Beer, Enrico Zio, Kok-Kwang Phoon, Bilal M. Ayyub
Pages173-178
Number of pages6
Publication statusPublished - 2022
Event8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022 - Hannover, Germany
Duration: 4 Sept 20227 Sept 2022

Abstract

In this work we quantify the uncertainty over Power Spectral Density estimation of stochastic processes based on realizations with gapped missing data. For the purpose of imputation, a fully-connected neural network architecture that works in an autoregressive manner is firstly constructed to probabilistically capture the temporal patterns in the time series data. Particularly, under the Bayesian scheme, uncertainties with respect to the parameters of the neural network model (i.e. weights) are introduced by multivariate Gaussian distribution. During training, the posteriors are learnt through variational inference approach. As a result, the missing gaps can be recursively imputed via our neural network in each realization, and thanks to the probabilistic merit of Bayesian inference, an ensemble of reconstructed realizations can then be obtained. Further, by resorting to a Fourier-based spectral estimation method, a probabilistic power spectrum could be derived, with each frequency component represented by a probability distribution.

Keywords

    Bayesian neural network, missing data, spectral estimation, stochastic process, Variational Bayesian inference

ASJC Scopus subject areas

Cite this

Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference. / Chen, Yu; Patelli, Edoardo; Beer, Michael et al.
Proceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022. ed. / Michael Beer; Enrico Zio; Kok-Kwang Phoon; Bilal M. Ayyub. 2022. p. 173-178.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Chen, Y, Patelli, E, Beer, M & Edwards, B 2022, Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference. in M Beer, E Zio, K-K Phoon & BM Ayyub (eds), Proceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022. pp. 173-178, 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022, Hannover, Germany, 4 Sept 2022. https://doi.org/10.3850/978-981-18-5184-1_MS-06-179-cd
Chen, Y., Patelli, E., Beer, M., & Edwards, B. (2022). Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference. In M. Beer, E. Zio, K.-K. Phoon, & B. M. Ayyub (Eds.), Proceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022 (pp. 173-178) https://doi.org/10.3850/978-981-18-5184-1_MS-06-179-cd
Chen Y, Patelli E, Beer M, Edwards B. Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference. In Beer M, Zio E, Phoon KK, Ayyub BM, editors, Proceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022. 2022. p. 173-178 doi: 10.3850/978-981-18-5184-1_MS-06-179-cd
Chen, Yu ; Patelli, Edoardo ; Beer, Michael et al. / Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference. Proceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022. editor / Michael Beer ; Enrico Zio ; Kok-Kwang Phoon ; Bilal M. Ayyub. 2022. pp. 173-178
Download
@inproceedings{176d5c79659144eca6122fed9a7fe123,
title = "Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference",
abstract = "In this work we quantify the uncertainty over Power Spectral Density estimation of stochastic processes based on realizations with gapped missing data. For the purpose of imputation, a fully-connected neural network architecture that works in an autoregressive manner is firstly constructed to probabilistically capture the temporal patterns in the time series data. Particularly, under the Bayesian scheme, uncertainties with respect to the parameters of the neural network model (i.e. weights) are introduced by multivariate Gaussian distribution. During training, the posteriors are learnt through variational inference approach. As a result, the missing gaps can be recursively imputed via our neural network in each realization, and thanks to the probabilistic merit of Bayesian inference, an ensemble of reconstructed realizations can then be obtained. Further, by resorting to a Fourier-based spectral estimation method, a probabilistic power spectrum could be derived, with each frequency component represented by a probability distribution.",
keywords = "Bayesian neural network, missing data, spectral estimation, stochastic process, Variational Bayesian inference",
author = "Yu Chen and Edoardo Patelli and Michael Beer and Ben Edwards",
note = "Publisher Copyright: {\textcopyright} 2022 ISRERM Organizers. Published by Research Publishing, Singapore.; 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022 ; Conference date: 04-09-2022 Through 07-09-2022",
year = "2022",
doi = "10.3850/978-981-18-5184-1_MS-06-179-cd",
language = "English",
isbn = "9789811851841",
pages = "173--178",
editor = "Michael Beer and Enrico Zio and Kok-Kwang Phoon and Ayyub, {Bilal M.}",
booktitle = "Proceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022",

}

Download

TY - GEN

T1 - Uncertainty Quantification Over Spectral Estimation of Stochastic Processes Subject to Gapped Missing Data Using Variational Bayesian Inference

AU - Chen, Yu

AU - Patelli, Edoardo

AU - Beer, Michael

AU - Edwards, Ben

N1 - Publisher Copyright: © 2022 ISRERM Organizers. Published by Research Publishing, Singapore.

PY - 2022

Y1 - 2022

N2 - In this work we quantify the uncertainty over Power Spectral Density estimation of stochastic processes based on realizations with gapped missing data. For the purpose of imputation, a fully-connected neural network architecture that works in an autoregressive manner is firstly constructed to probabilistically capture the temporal patterns in the time series data. Particularly, under the Bayesian scheme, uncertainties with respect to the parameters of the neural network model (i.e. weights) are introduced by multivariate Gaussian distribution. During training, the posteriors are learnt through variational inference approach. As a result, the missing gaps can be recursively imputed via our neural network in each realization, and thanks to the probabilistic merit of Bayesian inference, an ensemble of reconstructed realizations can then be obtained. Further, by resorting to a Fourier-based spectral estimation method, a probabilistic power spectrum could be derived, with each frequency component represented by a probability distribution.

AB - In this work we quantify the uncertainty over Power Spectral Density estimation of stochastic processes based on realizations with gapped missing data. For the purpose of imputation, a fully-connected neural network architecture that works in an autoregressive manner is firstly constructed to probabilistically capture the temporal patterns in the time series data. Particularly, under the Bayesian scheme, uncertainties with respect to the parameters of the neural network model (i.e. weights) are introduced by multivariate Gaussian distribution. During training, the posteriors are learnt through variational inference approach. As a result, the missing gaps can be recursively imputed via our neural network in each realization, and thanks to the probabilistic merit of Bayesian inference, an ensemble of reconstructed realizations can then be obtained. Further, by resorting to a Fourier-based spectral estimation method, a probabilistic power spectrum could be derived, with each frequency component represented by a probability distribution.

KW - Bayesian neural network

KW - missing data

KW - spectral estimation

KW - stochastic process

KW - Variational Bayesian inference

UR - http://www.scopus.com/inward/record.url?scp=85202046515&partnerID=8YFLogxK

U2 - 10.3850/978-981-18-5184-1_MS-06-179-cd

DO - 10.3850/978-981-18-5184-1_MS-06-179-cd

M3 - Conference contribution

AN - SCOPUS:85202046515

SN - 9789811851841

SP - 173

EP - 178

BT - Proceedings of the 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022

A2 - Beer, Michael

A2 - Zio, Enrico

A2 - Phoon, Kok-Kwang

A2 - Ayyub, Bilal M.

T2 - 8th International Symposium on Reliability Engineering and Risk Management, ISRERM 2022

Y2 - 4 September 2022 through 7 September 2022

ER -

By the same author(s)