Active hypothesis testing for anomaly detection

Kobi Cohen, Qing Zhao

Research output: Contribution to journalArticlepeer-review

Abstract

The problem of detecting a single anomalous process among a finite number M of processes is considered. At each time, a subset of the processes can be observed, and the observations from each chosen process follow two different distributions, depending on whether the process is normal or abnormal. The objective is a sequential search strategy that minimizes the expected detection time subject to an error probability constraint. This problem can be considered as a special case of active hypothesis testing first considered by Chernoff where a randomized strategy, referred to as the Chernoff test, was proposed and shown to be asymptotically (as the error probability approaches zero) optimal. For the special case considered in this paper, we show that a simple deterministic test achieves asymptotic optimality and offers better performance in the finite regime. We further extend the problem to the case where multiple anomalous processes are present. In particular, we examine the case where only an upper bound on the number of anomalous processes is known.

Original languageAmerican English
Article number7001595
Pages (from-to)1432-1450
Number of pages19
JournalIEEE Transactions on Information Theory
Volume61
Issue number3
DOIs
StatePublished - 1 Mar 2015
Externally publishedYes

Keywords

  • Sequential detection
  • active hypothesis testing
  • anomaly detection
  • controlled sensing
  • dynamic search

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'Active hypothesis testing for anomaly detection'. Together they form a unique fingerprint.

Cite this