 |
Discrete Mathematics & Theoretical Computer Science |
Dominique Bontemps ; Stephane Boucheron ; Elisabeth Gassiat - Adaptive compression against a countable alphabet
dmtcs:2995 - Discrete Mathematics & Theoretical Computer Science, January 1, 2012, DMTCS Proceedings vol. AQ, 23rd Intern. Meeting on Probabilistic, Combinatorial, and Asymptotic Methods for the Analysis of Algorithms (AofA'12) - https://doi.org/10.46298/dmtcs.2995
1; Stephane Boucheron 2; Elisabeth Gassiat 3
- 1 Institut de Mathématiques de Toulouse UMR5219
- 2 Laboratoire de Probabilités et Modèles Aléatoires
- 3 Laboratoire de Mathématiques d'Orsay
This paper sheds light on universal coding with respect to classes of memoryless sources over a countable alphabet defined by an envelope function with finite and non-decreasing hazard rate. We prove that the auto-censuring (AC) code introduced by Bontemps (2011) is adaptive with respect to the collection of such classes. The analysis builds on the tight characterization of universal redundancy rate in terms of metric entropy by Haussler and Opper (1997) and on a careful analysis of the performance of the AC-coding algorithm. The latter relies on non-asymptotic bounds for maxima of samples from discrete distributions with finite and non-decreasing hazard rate.