Gaussian process for activity modeling and anomaly detection

Research output: Contribution to journalConference articleResearchpeer review

Authors

Research Organisations

External Research Organisations

  • Technische Universität Dresden
View graph of relations

Details

Original languageEnglish
Pages (from-to)467-474
Number of pages8
JournalISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Volume2
Issue number3W5
Publication statusPublished - 20 Aug 2015
EventISPRS Geospatial Week 2015 - La Grande Motte, France
Duration: 28 Sept 20153 Oct 2015

Abstract

Complex activity modeling and identification of anomaly is one of the most interesting and desired capabilities for automated video behavior analysis. A number of different approaches have been proposed in the past to tackle this problem. There are two main challenges for activity modeling and anomaly detection: 1) most existing approaches require sufficient data and supervision for learning; 2) the most interesting abnormal activities arise rarely and are ambiguous among typical activities, i.e. hard to be precisely defined. In this paper, we propose a novel approach to model complex activities and detect anomalies by using non-parametric Gaussian Process (GP) models in a crowded and complicated traffic scene. In comparison with parametric models such as HMM, GP models are nonparametric and have their advantages. Our GP models exploit implicit spatial-temporal dependence among local activity patterns. The learned GP regression models give a probabilistic prediction of regional activities at next time interval based on observations at present. An anomaly will be detected by comparing the actual observations with the prediction at real time. We verify the effectiveness and robustness of the proposed model on the QMUL Junction Dataset. Furthermore, we provide a publicly available manually labeled ground truth of this data set.

Keywords

    Activity modeling, Anomaly detection, Gaussian Process regression

ASJC Scopus subject areas

Cite this

Gaussian process for activity modeling and anomaly detection. / Liao, Wentong; Rosenhahn, Bodo; Ying Yang, M.
In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 2, No. 3W5, 20.08.2015, p. 467-474.

Research output: Contribution to journalConference articleResearchpeer review

Liao, W, Rosenhahn, B & Ying Yang, M 2015, 'Gaussian process for activity modeling and anomaly detection', ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 2, no. 3W5, pp. 467-474. https://doi.org/10.5194/isprsannals-II-3-W5-467-2015
Liao, W., Rosenhahn, B., & Ying Yang, M. (2015). Gaussian process for activity modeling and anomaly detection. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2(3W5), 467-474. https://doi.org/10.5194/isprsannals-II-3-W5-467-2015
Liao W, Rosenhahn B, Ying Yang M. Gaussian process for activity modeling and anomaly detection. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2015 Aug 20;2(3W5):467-474. doi: 10.5194/isprsannals-II-3-W5-467-2015
Liao, Wentong ; Rosenhahn, Bodo ; Ying Yang, M. / Gaussian process for activity modeling and anomaly detection. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2015 ; Vol. 2, No. 3W5. pp. 467-474.
Download
@article{5b4307fe2283481ca85bd13ea0973472,
title = "Gaussian process for activity modeling and anomaly detection",
abstract = "Complex activity modeling and identification of anomaly is one of the most interesting and desired capabilities for automated video behavior analysis. A number of different approaches have been proposed in the past to tackle this problem. There are two main challenges for activity modeling and anomaly detection: 1) most existing approaches require sufficient data and supervision for learning; 2) the most interesting abnormal activities arise rarely and are ambiguous among typical activities, i.e. hard to be precisely defined. In this paper, we propose a novel approach to model complex activities and detect anomalies by using non-parametric Gaussian Process (GP) models in a crowded and complicated traffic scene. In comparison with parametric models such as HMM, GP models are nonparametric and have their advantages. Our GP models exploit implicit spatial-temporal dependence among local activity patterns. The learned GP regression models give a probabilistic prediction of regional activities at next time interval based on observations at present. An anomaly will be detected by comparing the actual observations with the prediction at real time. We verify the effectiveness and robustness of the proposed model on the QMUL Junction Dataset. Furthermore, we provide a publicly available manually labeled ground truth of this data set.",
keywords = "Activity modeling, Anomaly detection, Gaussian Process regression",
author = "Wentong Liao and Bodo Rosenhahn and {Ying Yang}, M.",
year = "2015",
month = aug,
day = "20",
doi = "10.5194/isprsannals-II-3-W5-467-2015",
language = "English",
volume = "2",
pages = "467--474",
number = "3W5",
note = "ISPRS Geospatial Week 2015 ; Conference date: 28-09-2015 Through 03-10-2015",

}

Download

TY - JOUR

T1 - Gaussian process for activity modeling and anomaly detection

AU - Liao, Wentong

AU - Rosenhahn, Bodo

AU - Ying Yang, M.

PY - 2015/8/20

Y1 - 2015/8/20

N2 - Complex activity modeling and identification of anomaly is one of the most interesting and desired capabilities for automated video behavior analysis. A number of different approaches have been proposed in the past to tackle this problem. There are two main challenges for activity modeling and anomaly detection: 1) most existing approaches require sufficient data and supervision for learning; 2) the most interesting abnormal activities arise rarely and are ambiguous among typical activities, i.e. hard to be precisely defined. In this paper, we propose a novel approach to model complex activities and detect anomalies by using non-parametric Gaussian Process (GP) models in a crowded and complicated traffic scene. In comparison with parametric models such as HMM, GP models are nonparametric and have their advantages. Our GP models exploit implicit spatial-temporal dependence among local activity patterns. The learned GP regression models give a probabilistic prediction of regional activities at next time interval based on observations at present. An anomaly will be detected by comparing the actual observations with the prediction at real time. We verify the effectiveness and robustness of the proposed model on the QMUL Junction Dataset. Furthermore, we provide a publicly available manually labeled ground truth of this data set.

AB - Complex activity modeling and identification of anomaly is one of the most interesting and desired capabilities for automated video behavior analysis. A number of different approaches have been proposed in the past to tackle this problem. There are two main challenges for activity modeling and anomaly detection: 1) most existing approaches require sufficient data and supervision for learning; 2) the most interesting abnormal activities arise rarely and are ambiguous among typical activities, i.e. hard to be precisely defined. In this paper, we propose a novel approach to model complex activities and detect anomalies by using non-parametric Gaussian Process (GP) models in a crowded and complicated traffic scene. In comparison with parametric models such as HMM, GP models are nonparametric and have their advantages. Our GP models exploit implicit spatial-temporal dependence among local activity patterns. The learned GP regression models give a probabilistic prediction of regional activities at next time interval based on observations at present. An anomaly will be detected by comparing the actual observations with the prediction at real time. We verify the effectiveness and robustness of the proposed model on the QMUL Junction Dataset. Furthermore, we provide a publicly available manually labeled ground truth of this data set.

KW - Activity modeling

KW - Anomaly detection

KW - Gaussian Process regression

UR - http://www.scopus.com/inward/record.url?scp=85044546770&partnerID=8YFLogxK

U2 - 10.5194/isprsannals-II-3-W5-467-2015

DO - 10.5194/isprsannals-II-3-W5-467-2015

M3 - Conference article

AN - SCOPUS:85044546770

VL - 2

SP - 467

EP - 474

JO - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

JF - ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SN - 2194-9042

IS - 3W5

T2 - ISPRS Geospatial Week 2015

Y2 - 28 September 2015 through 3 October 2015

ER -

By the same author(s)