TY - GEN
T1 - Information-theoretic applications of the logarithmic probability comparison bound
AU - ATAR, RAMI
AU - Merhav, Neri
N1 - Publisher Copyright: © 2015 IEEE.
PY - 2015/9/28
Y1 - 2015/9/28
N2 - A well-known technique in assessing probabilities of rare events (used, e.g., in the sphere-packing bound), is that of finding a reference measure under which the event of interest has probability of order one and estimating the probability in question using the Kullback-Leibler divergence (KLD). A recent method has been proposed [2], that can be viewed as an extension of this idea in which the probability under the reference measure may itself be decaying exponentially, and the Rényi divergence (RD) is used instead. We demonstrate the usefulness of this approach in various information-theoretic settings. For channel coding, we provide a method for obtaining matched, mismatched and robust error exponent bounds, as well as new results in a variety of particular channel models. Other applications we address include rate-distortion coding and the problem of guessing.
AB - A well-known technique in assessing probabilities of rare events (used, e.g., in the sphere-packing bound), is that of finding a reference measure under which the event of interest has probability of order one and estimating the probability in question using the Kullback-Leibler divergence (KLD). A recent method has been proposed [2], that can be viewed as an extension of this idea in which the probability under the reference measure may itself be decaying exponentially, and the Rényi divergence (RD) is used instead. We demonstrate the usefulness of this approach in various information-theoretic settings. For channel coding, we provide a method for obtaining matched, mismatched and robust error exponent bounds, as well as new results in a variety of particular channel models. Other applications we address include rate-distortion coding and the problem of guessing.
UR - http://www.scopus.com/inward/record.url?scp=84969761242&partnerID=8YFLogxK
U2 - https://doi.org/10.1109/ISIT.2015.7282552
DO - https://doi.org/10.1109/ISIT.2015.7282552
M3 - منشور من مؤتمر
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 735
EP - 739
BT - Proceedings - 2015 IEEE International Symposium on Information Theory, ISIT 2015
T2 - IEEE International Symposium on Information Theory, ISIT 2015
Y2 - 14 June 2015 through 19 June 2015
ER -