TY - GEN
T1 - Second-Order Asymptotics of Rate-Distortion using Gaussian Codebooks for Arbitrary Sources
AU - Zhou, Lin
AU - Tan, Vincent Y.F.
AU - Motani, Mehul
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/8/15
Y1 - 2018/8/15
N2 - The rate-distortion saddle-point problem considered by Lapidoth (1997) consists in finding the minimum rate to compress an arbitrary ergodic source when one is constrained to use a random Gaussian codebook and minimum (Euclidean) distance encoding is employed. We extend Lapidoth's analysis in several directions in this paper. Firstly, we consider second-order asymptotics. In particular, when the source is stationary and memoryless, we establish ensemble tight second-order coding rate for the problem. Secondly, by 'random Gaussian codebook', Lapidoth refers to a collection of random codewords, each of which is drawn independently and uniformly from the surface of an n-dimensional sphere. To be more precise, we term this as a spherical Gaussian codebook. We also consider i.i.d. Gaussian codebooks in which each random codeword is drawn independently from a product Gaussian distribution. We also derive the second-order asymptotics when i.i.d. Gaussian codebooks are employed. Interestingly, in contrast to the recent work on the channel coding counterpart by Scarlett, Tan and Durisi (2017), the dispersions for spherical and i.i.d. Gaussian code books are identical for the rate-distortion saddle-point problem.
AB - The rate-distortion saddle-point problem considered by Lapidoth (1997) consists in finding the minimum rate to compress an arbitrary ergodic source when one is constrained to use a random Gaussian codebook and minimum (Euclidean) distance encoding is employed. We extend Lapidoth's analysis in several directions in this paper. Firstly, we consider second-order asymptotics. In particular, when the source is stationary and memoryless, we establish ensemble tight second-order coding rate for the problem. Secondly, by 'random Gaussian codebook', Lapidoth refers to a collection of random codewords, each of which is drawn independently and uniformly from the surface of an n-dimensional sphere. To be more precise, we term this as a spherical Gaussian codebook. We also consider i.i.d. Gaussian codebooks in which each random codeword is drawn independently from a product Gaussian distribution. We also derive the second-order asymptotics when i.i.d. Gaussian codebooks are employed. Interestingly, in contrast to the recent work on the channel coding counterpart by Scarlett, Tan and Durisi (2017), the dispersions for spherical and i.i.d. Gaussian code books are identical for the rate-distortion saddle-point problem.
KW - Dispersion
KW - Ensemble tightness
KW - Gaussian codebook
KW - Lossy data compression
KW - Minimum distance encoding
KW - Mismatched encoding
KW - Rate-distortion
KW - Second-order asymptotics
UR - https://www.scopus.com/pages/publications/85052486687
U2 - 10.1109/ISIT.2018.8437506
DO - 10.1109/ISIT.2018.8437506
M3 - 会议稿件
AN - SCOPUS:85052486687
SN - 9781538647806
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 1495
EP - 1499
BT - 2018 IEEE International Symposium on Information Theory, ISIT 2018
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2018 IEEE International Symposium on Information Theory, ISIT 2018
Y2 - 17 June 2018 through 22 June 2018
ER -