Skip to main navigation Skip to search Skip to main content

Second-Order Asymptotics of Rate-Distortion using Gaussian Codebooks for Arbitrary Sources

  • Lin Zhou
  • , Vincent Y.F. Tan
  • , Mehul Motani
  • National University of Singapore

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The rate-distortion saddle-point problem considered by Lapidoth (1997) consists in finding the minimum rate to compress an arbitrary ergodic source when one is constrained to use a random Gaussian codebook and minimum (Euclidean) distance encoding is employed. We extend Lapidoth's analysis in several directions in this paper. Firstly, we consider second-order asymptotics. In particular, when the source is stationary and memoryless, we establish ensemble tight second-order coding rate for the problem. Secondly, by 'random Gaussian codebook', Lapidoth refers to a collection of random codewords, each of which is drawn independently and uniformly from the surface of an n-dimensional sphere. To be more precise, we term this as a spherical Gaussian codebook. We also consider i.i.d. Gaussian codebooks in which each random codeword is drawn independently from a product Gaussian distribution. We also derive the second-order asymptotics when i.i.d. Gaussian codebooks are employed. Interestingly, in contrast to the recent work on the channel coding counterpart by Scarlett, Tan and Durisi (2017), the dispersions for spherical and i.i.d. Gaussian code books are identical for the rate-distortion saddle-point problem.

Original languageEnglish
Title of host publication2018 IEEE International Symposium on Information Theory, ISIT 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1495-1499
Number of pages5
ISBN (Print)9781538647806
DOIs
StatePublished - 15 Aug 2018
Externally publishedYes
Event2018 IEEE International Symposium on Information Theory, ISIT 2018 - Vail, United States
Duration: 17 Jun 201822 Jun 2018

Publication series

NameIEEE International Symposium on Information Theory - Proceedings
Volume2018-June
ISSN (Print)2157-8095

Conference

Conference2018 IEEE International Symposium on Information Theory, ISIT 2018
Country/TerritoryUnited States
CityVail
Period17/06/1822/06/18

Keywords

  • Dispersion
  • Ensemble tightness
  • Gaussian codebook
  • Lossy data compression
  • Minimum distance encoding
  • Mismatched encoding
  • Rate-distortion
  • Second-order asymptotics

Fingerprint

Dive into the research topics of 'Second-Order Asymptotics of Rate-Distortion using Gaussian Codebooks for Arbitrary Sources'. Together they form a unique fingerprint.

Cite this