Prospective infectious disease outbreak detection using markov switching models

Hsin Min Lu, Daniel Zeng, Hsinchun Chen

Research output: Contribution to journalArticlepeer-review

51 Scopus citations

Abstract

Accurate and timely detection of infectious disease outbreaks provides valuable information which can enable public health officials to respond to major public health threats in a timely fashion. However, disease outbreaks are often not directly observable. For surveillance systems used to detect outbreaks, noises caused by routine behavioral patterns and by special events can further complicate the detection task. Most existing detection methods combine a time series filtering procedure followed by a statistical surveillance method. The performance of this "two-step detection method is hampered by the unrealistic assumption that the training data are outbreak-free. Moreover, existing approaches are sensitive to extreme values, which are common in real-world data sets. We considered the problem of identifying outbreak patterns in a syndrome count time series using Markov switching models. The disease outbreak states are modeled as hidden state variables which control the observed time series. A jump component is introduced to absorb sporadic extreme values that may otherwise weaken the ability to detect slow-moving disease outbreaks. Our approach outperformed several state-of-the-art detection methods in terms of detection sensitivity using both simulated and real-world data.

Original languageEnglish (US)
Article number4912199
Pages (from-to)565-577
Number of pages13
JournalIEEE Transactions on Knowledge and Data Engineering
Volume22
Issue number4
DOIs
StatePublished - Apr 2010

Keywords

  • Gibbs sampling
  • Markov switching models
  • Outbreak detection
  • Syndromic surveillance

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'Prospective infectious disease outbreak detection using markov switching models'. Together they form a unique fingerprint.

Cite this