Context based predictive information

Yuval Shalev, Irad Ben-Gal

Research output: Contribution to journalArticlepeer-review

Abstract

We propose a new algorithm called the context-based predictive information (CBPI) for estimating the predictive information (PI) between time series, by utilizing a lossy compression algorithm. The advantage of this approach over existing methods resides in the case of sparse predictive information (SPI) conditions, where the ratio between the number of informative sequences to uninformative sequences is small. It is shown that the CBPI achieves a better PI estimation than benchmark methods by ignoring uninformative sequences while improving explainability by identifying the informative sequences. We also provide an implementation of the CBPI algorithm on a real dataset of large banks' stock prices in the U.S. In the last part of this paper, we show how the CBPI algorithm is related to the well-known information bottleneck in its deterministic version.

Original languageEnglish
Article number645
JournalEntropy
Volume21
Issue number7
DOIs
StatePublished - 1 Jul 2019

Keywords

  • Context tree
  • Information bottleneck
  • Predictive information
  • Time series analysis

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Mathematical Physics
  • Physics and Astronomy (miscellaneous)
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Context based predictive information'. Together they form a unique fingerprint.

Cite this