Everything about Shannon coding

🧭 Start here: a 6-step reading path

1. Read the overview: Shannon codingA 5-minute orientation
2. Skim a recent paper: On the Use of Variability Measures to Analyze Source Coding Data Based on the Shannon EntropyInfluential work since 2022
3. Pick up a classic book: The Code of the WarriorThe most-reprinted book on the subject
4. Read the landmark paper: Shannon-kotel-nikov mappings in joint source-channel codingCited 149 times
5. Go sideways: Shannon–Fano codingA closely related topic
6. Go sideways: Shannon–Fano–Elias codingA closely related topic

🏆 Landmark papers (most cited)

• Shannon-kotel-nikov mappings in joint source-channel coding

  Fredrik Hekland, Pal Anders Floor, Tor A. Ramstad · 2009 · IEEE Transactions on Communications · 149 citations

• Extrinsic Jensen–Shannon Divergence: Applications to Variable-Length Coding

  Mohammad Naghshvar, Tara Javidi, Michele Wigger · 2015 · IEEE Transactions on Information Theory · 54 citations

• Fuzzy concept lattice reduction using Shannon entropy and Huffman coding

  Prem Kumar Singh, Abdullah Gani · 2015 · Journal of Applied Non-Classical Logics · 50 citations

• Shannon Information Theoretic Computation of Synonymous Codon Usage Biases in Coding Regions of Human and Mouse Genomes

  Barry Zeeberg · 2002 · Genome Research · 47 citations

• Conjugate gradient descent learned ANN for Indian summer monsoon rainfall and efficiency assessment through Shannon-Fano coding

  Surajit Chattopadhyay, Goutami Chattopadhyay · 2018 · Journal of Atmospheric and Solar-Terrestrial Physics · 35 citations

• Stable stem enabled Shannon entropies distinguish non-coding RNAs from random backgrounds

  Yingfeng Wang, Amir Manzour, Pooya Shareghi · 2012 · BMC Bioinformatics · 30 citations

• Index Coding Capacity: How Far Can One Go With Only Shannon Inequalities?

  Hua Sun, Syed Ali Jafar · 2015 · IEEE Transactions on Information Theory · 27 citations

• Optimistic Shannon coding theorems for arbitrary single-user systems

  Po-Ning Chen, F. Alajaji · 1999 · IEEE Transactions on Information Theory · 17 citations

🆕 Influential since 2022

• On the Use of Variability Measures to Analyze Source Coding Data Based on the Shannon Entropy

  Helio M. de Oliveira, Raydonal Ospina, Carlos Martin-Barreiro · 2023 · Mathematics · 3 citations

• In search for the simplest example that proves Huffman coding overperforms Shannon-Fano coding

  Macarie Breazu, Daniel I. Morariu, Radu G. Crețulescu · 2022 · International Journal of Advanced Statistics and IT&C for Economics and Life Sciences · 1 citations

• Image Compression Using Huffman and Shannon-Fano Coding: Performance Evaluation

  Nihar Patil · 2024 · International Journal for Research in Applied Science and Engineering Technology · 0 citations

• Analisis Perbandingan Kualitas Kompresi Citra Menggunakan Algoritma Shannon-Fano dan Huffman Coding Serta Pengujian Efek Noise AWGN Pada Citra Rekonstruksi

  Mahalalila Hayuning Sekarbayu, Beby H. A. Manafe, Silvester Tena · 2026 · Komputika : Jurnal Sistem Komputer · 0 citations

• An Advanced Approach to Image Hiding Using Shannon Coding and Run-Length Lossless Image Compression in 2D Wavelet Packet

  Najla Matti Isaac, Sundus Khaleel Ebraheem, Hadia Saleh Abdullah · 2026 · International Journal of Computing and Digital Systems · 0 citations

📚 Books worth reading

• The Code of the WarriorShannon E. French · 2003
• Coding MissionShannon Miller, Blake A. Hoena · 2018
• A student's guide to coding and information theoryStefan M. Moser · 2012
• Code and Clay, Data and DirtShannon Christine Mattern · 2017
• No regretsShannon K. Butcher · 2007
• 📕Investigation of near Shannon limit coding schemesS. C. Kwatra · 1999
• 📕Scaling up SimplifiedShannon Teague · 2021
• 📕Theory of Information TransmissionNicolaos S. Tzannes · 1979

Ranked by number of editions on Open Library, a rough measure of how lasting a book is.

🔗 Related topics

• Shannon–Fano coding In the field of data compression, Shannon–Fano coding, named after Claude Shannon and Robert Fano, is one of two related techniques for constructing a…
• Shannon–Fano–Elias coding In information theory, Shannon–Fano–Elias coding is a precursor to arithmetic coding, in which probabilities are used to determine codewords. It is named…
• Entropy coding In information theory, an entropy coding (or entropy encoding) is any lossless data compression method that attempts to approach the lower bound declared…
• Tunstall coding In computer science and information theory, Tunstall coding is a form of entropy coding used for lossless data compression. Tunstall coding was the subject…
• Huffman coding In computer science and information theory, a Huffman code is a particular type of optimal prefix code that is commonly used for lossless data compression…
• Noisy-channel coding theorem In information theory, the noisy-channel coding theorem (sometimes Shannon's theorem or Shannon's limit), establishes that for any given degree of noise…
• Timeline of information theory A timeline of events related to information theory, quantum information theory and statistical physics, data compression, error correcting codes and…
• Information theory Information theory is the mathematical study of the quantification, storage, and communication of a particular type of mathematically defined information…