Concept drift detection through resampling

Maayan Harel, Koby Crammer, Ran El-Yaniv, Shie Mannor

Research output: Contribution to journalConference articlepeer-review

Abstract

Detecting changes in data-streams is an important part of enhancing learning quality in dy-namic environments. We devise a procedure for detecting concept drifts in data-streams that re-lies on analyzing the empirical loss of learning algorithms. Our method is based on obtaining statistics from the loss distribution by reusing the data multiple times via resampling. We present theoretical guarantees for the proposed procedure based on the stability of the underlying learning algorithms. Experimental results show that the method has high recall and precision, and performs well in the presence of noise.

Original languageEnglish
Pages (from-to)2682-2694
Number of pages13
JournalProceedings of Machine Learning Research
Volume32
StatePublished - 2014
Event31st International Conference on Machine Learning, ICML 2014 - Beijing, China
Duration: 21 Jun 201426 Jun 2014

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Software

Fingerprint

Dive into the research topics of 'Concept drift detection through resampling'. Together they form a unique fingerprint.

Cite this