Live briefing
Everything about Entropy estimation
Methods of estimating differential entropy given some observations
In various science/engineering applications, such as independent component analysis, image analysis, genetic analysis, speech recognition, manifold learning, and time delay estimation it is useful to estimate the differential entropy of a system or process, given some observations. Wikipedia →
🧭 Start here: a 6-step reading path
- Read the overview: Entropy estimationA 5-minute orientation
- Skim a recent paper: Phase transition in stabilizer entropy and efficient purity estimationInfluential work since 2022
- Pick up a classic book: Maximum entropy econometricsThe most-reprinted book on the subject
- Read the landmark paper: Entropy estimation of symbol sequencesCited 227 times
- Go sideways: Importance samplingA closely related topic
- Go sideways: Spectral density estimationA closely related topic
📖 Definitions
No dictionary entry for this exact phrase.
🏆 Landmark papers (most cited)
Entropy estimation of symbol sequences
Recursive Multichannel Maximum Entropy Spectral Estimation
Entropy in biological binding processes: Estimation of translational entropy loss
On the estimation of entropy
Entropy production estimation with optimal current
On the estimation of topological entropy
Bias analysis in entropy estimation
Mismatched Estimation and Relative Entropy
🆕 Influential since 2022
📚 Books worth reading
Maximum entropy econometricsAmos Golan · 1996- 📕Exploiting continuityHenri Theil · 1984
Information and entropy econometricsAmos Golan · 2008
Entropy and the quantum IIArizona School of Analysis with Applications (2nd 2010 University of Arizona) · 2011
Ranked by number of editions on Open Library, a rough measure of how lasting a book is.
🔗 Related topics
- Importance sampling Importance sampling is a Monte Carlo method for evaluating properties of a particular distribution, while only having samples generated from a different…
- Spectral density estimation In statistical signal processing, the goal of spectral density estimation (SDE) or simply spectral estimation is to estimate the spectral density (also…
- Kernel density estimation In statistics, kernel density estimation (KDE) is the application of kernel smoothing for probability density estimation, i.e., a non-parametric method…
- Estimation theory Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component…
- Point estimation In statistics, point estimation involves the use of sample data to calculate a single value (known as a point estimate, since it identifies a point rather…
- Glossary of probability and statistics These terms and concepts are used in the mathematical sciences of statistics and probability, their sub-disciplines, and related fields. For additional…
- Parametric statistics Parametric statistics is a branch of statistics that is concerned with the analysis of and inference from data assuming that the underlying distribution…
- Fisher information In mathematical statistics, the Fisher information is a way of measuring the amount of information that an observable random variable X carries about an…