On the data processing theorem in the semi-deterministic setting

Research output: Contribution to journalArticlepeer-review

Abstract

Data processing lower bounds on the expected distortion are derived in the finite-alphabet semideterministic setting, where the source produces a deterministic, individual sequence, but the channel model is probabilistic, and the decoder is subjected to various kinds of limitations, e.g., decoders implementable by finite-state machines, with or without counters, and with or without a restriction of common reconstruction with high probability. Some of our bounds are given in terms of the Lempel-Ziv complexity of the source sequence or the reproduction sequence. We also demonstrate how some analogous results can be obtained for classes of linear encoders and linear decoders in the continuous alphabet case.

Original languageEnglish
Article number6858082
Pages (from-to)6032-6040
Number of pages9
JournalIEEE Transactions on Information Theory
Volume60
Issue number10
DOIs
StatePublished - 1 Oct 2014

Keywords

  • Data processing theorem
  • Lempel-Ziv algorithm
  • common reconstruction
  • delay
  • finite-state machine
  • redundancy

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Cite this