Universal Slepian-Wolf Coding for Individual Sequences

Research output: Contribution to journalArticlepeer-review

Abstract

We establish a coding theorem and a matching converse theorem for separate encodings and joint decoding of individual sequences using finite-state machines. The achievable rate region is characterized in terms of the Lempel-Ziv (LZ) complexities, the conditional LZ complexities and the joint LZ complexity of the two source sequences. An important feature that is needed to this end, which may be interesting on its own right, is a certain asymptotic form of a chain rule for LZ complexities, which we establish in this work. The main emphasis in the achievability scheme is on the universal decoder and its properties. We then show that the achievable rate region is universally attainable by a modified version of Draper’s universal incremental Slepian-Wolf (SW) coding scheme, provided that there exists a low-rate reliable feedback link.

Original languageEnglish
Pages (from-to)783-796
Number of pages14
JournalIEEE Transactions on Information Theory
Volume71
Issue number1
DOIs
StatePublished - 2025

Keywords

  • Lempel-Ziv algorithm
  • Lempel-Ziv complexity
  • Slepian-Wolf coding
  • finite-state machines
  • universal decoding

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Cite this