Information, Estimation, and Lookahead in the Gaussian Channel

Kartik Venkat, Tsachy Weissman, Yair Carmon, Shlomo Shamai

Research output: Contribution to journalArticlepeer-review

Abstract

We consider mean squared estimation with lookahead of a continuous-time signal corrupted by additive white Gaussian noise. We show that the mutual information rate function, i.e., the mutual information rate as function of the signal-to-noise ratio (SNR), does not, in general, determine the minimum mean squared error (MMSE) with fixed finite lookahead, in contrast to the special cases with 0 and infinite lookahead (filtering and smoothing errors), respectively, which were previously established in the literature. Further, we investigate the simple class of continuous-time stationary Gauss-Markov processes (Ornstein-Uhlenbeck processes) as channel inputs, and explicitly characterize the behavior of the minimum mean squared error (MMSE) with finite lookahead and signal-to-noise ratio (SNR). We extend our results to mixtures of Ornstein-Uhlenbeck processes, and use the insight gained to present lower and upper bounds on the MMSE with lookahead for a class of stationary Gaussian input processes, whose spectrum can be expressed as a mixture of Ornstein-Uhlenbeck spectra.

Original languageEnglish
Article number7437484
Pages (from-to)3605-3618
Number of pages14
JournalIEEE Transactions on Signal Processing
Volume64
Issue number14
DOIs
StatePublished - 15 Jul 2016

Keywords

  • Brownian motion
  • Mutual information
  • mean squared error

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Information, Estimation, and Lookahead in the Gaussian Channel'. Together they form a unique fingerprint.

Cite this