Live briefing
Everything about Entropy coding
Lossless data compression scheme
In information theory, an entropy coding is any lossless data compression method that attempts to approach the lower bound declared by Shannon's source coding theorem, which states that any lossless data compression method must have an expected code length greater than or equal to the entropy of the source. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Entropy codingA 5-minute orientation
- Skim a recent paper: Pre-Training General Trajectory Embeddings With Maximum Multi-View Entropy CodingInfluential work since 2022
- Pick up a classic book: High order entropy-constrained residual VQ for lossless compression of imagesThe most-reprinted book on the subject
- Read the landmark paper: Information entropy of coding metasurfaceCited 325 times
- Go sideways: Asymmetric numeral systemsA closely related topic
- Go sideways: Arithmetic codingA closely related topic
📖 Definitions
No dictionary entry for this exact phrase.
🗂️ The subject at a glance
🏆 Landmark papers (most cited)
Information entropy of coding metasurface
A coding theorem and Rényi's entropy
High Throughput CABAC Entropy Coding in HEVC
Quantization and Entropy Coding in the Versatile Video Coding (VVC) Standard
Adaptive entropy coded subband coding of images
Adaptive noise spectral shaping and entropy coding in predictive coding of speech
Random coding strategies for minimum entropy
Chains, entropy, coding
🆕 Influential since 2022
Pre-Training General Trajectory Embeddings With Maximum Multi-View Entropy Coding
Point Cloud Compression Based on Joint Optimization of Graph Transform and Entropy Coding for Efficient Data Broadcasting
HDVC: Deep Video Compression With Hyperprior-Based Entropy Coding
Tree-Coding-Aided Adaptive-Cross-Entropy Algorithm for Hybrid Precoding With Low-Resolution Analog Phase Shifters
JPEG image encryption with grouping coefficients based on entropy coding
📚 Books worth reading
- 📕High order entropy-constrained residual VQ for lossless compression of imagesFaouzi Kossentini · 1995
- 📕Conditional entropy-constrained residual VQ with application to image codingFaouzi Kossentini · 1996
Concentration Of Measure Inequalities In Information Theory, Communications, And CodingMaxim Raginsky, Igal Sason · 2013
Information and the Internal Structure of the UniverseStonier, Tom. · 1990
Entropy Coders of the H.264/AVC StandardXiaohua Tian · 2010
Information Dynamics and Open SystemsRoman S. Ingarden · 2010- 📕Radar Waveform Design Based on Optimization TheoryGuolong Cui, Antonio De Maio · 2020
Entropy and information theoryRobert M. Gray · 1990
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Asymmetric numeral systems Asymmetric numeral systems (ANS) is a family of entropy encoding methods introduced by Jarosław (Jarek) Duda from Jagiellonian University, used in data…
- Arithmetic coding Arithmetic coding (AC) is a form of entropy coding used in lossless data compression. Normally, a string of characters is represented using a fixed number…
- Huffman coding In computer science and information theory, a Huffman code is a particular type of optimal prefix code that is commonly used for lossless data compression…
- Shannon–Fano coding In the field of data compression, Shannon–Fano coding, named after Claude Shannon and Robert Fano, is one of two related techniques for constructing a…
- Timeline of information theory A timeline of events related to information theory, quantum information theory and statistical physics, data compression, error correcting codes and…
- Shannon coding In the field of data compression, Shannon coding, named after its creator, Claude Shannon, is a lossless data compression technique for constructing a…
- Range coding Range coding (or range encoding) is an entropy coding method defined by G. Nigel N. Martin in a 1979 paper, which effectively rediscovered the FIFO arithmetic…
- Entropy (information theory) In information theory, the entropy of a random variable quantifies the average level of uncertainty or information associated with the variable's potential…