A Simple Proof for the Optimality of Randomized Posterior Matching

Ofer Shayevitz, Meir Feder

Research output: Contribution to journalArticlepeer-review

Abstract

Posterior matching (PM) is a sequential horizon-free feedback communication scheme introduced by the authors, who also provided a rather involved optimality proof, showing that it achieves capacity for a large class of memoryless channels. Naghshvar et al. considered a non-sequential variation of PM with a fixed number of messages and a random decision-time, and gave a simpler proof establishing its optimality via a novel extrinsic Jensen-Shannon divergence argument. Another simpler optimality proof was given by Li and El Gamal, who considered a fixed-rate fixed block-length variation of PM with an additional randomization. Both these works also provided error exponent bounds. However, their simpler achievability proofs apply only to discrete memoryless channels, and are restricted to a non-sequential setup with a fixed number of messages. In this paper, we provide a short and transparent proof for the optimality of the fully sequential randomized horizon-free PM scheme over general memoryless channels. Borrowing the key randomization idea of Li and El Gamal, our proof is based on analyzing the random walk behavior of the shrinking posterior intervals induced by a reversed iterated function system decoder.

Original languageEnglish
Article number7445237
Pages (from-to)3410-3418
Number of pages9
JournalIEEE Transactions on Information Theory
Volume62
Issue number6
DOIs
StatePublished - Jun 2016

Keywords

  • Posterior matching
  • channel capacity
  • feedback communications

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'A Simple Proof for the Optimality of Randomized Posterior Matching'. Together they form a unique fingerprint.

Cite this