Everything About ___
Live briefing

Everything about Discrete diffusion model

Technique for the generative modeling of a discrete probability distribution

In machine learning, discrete diffusion models are a class of diffusion models, which themselves are a class of latent variable generative models. Each discrete diffusion model consists of two major components: the forward jump diffusion process, and the reverse jump diffusion process. The goal of diffusion modeling is, given a given dataset and a forward process, to learn a model for the reverse process, such that the reverse process can generate new elements that are distributed similarly as the original dataset. A trained discrete diffusion model can be sampled in many ways, which trades off computational efficiency and sample quality. In general, higher quality data can be obtained, but at the price of higher computational cost. Wikipedia →

🧭 Start here: a 6-step reading path

  1. Read the overview: Discrete diffusion modelA 5-minute orientation
  2. Skim a recent paper: General Methods to Synchronize Fractional Discrete Reaction–Diffusion Systems Applied to the Glycolysis ModelInfluential work since 2022
  3. Pick up a classic book: Telling from discrete data whether the underlying continuous-time model is a diffusionThe most-reprinted book on the subject
  4. Read the landmark paper: Diffsound: Discrete Diffusion Model for Text-to-Sound GenerationCited 195 times
  5. Go sideways: Diffusion modelA closely related topic
  6. Go sideways: Fokker–Planck equationA closely related topic

📖 Definitions

No dictionary entry for this exact phrase.

🏆 Landmark papers (most cited)

🆕 Influential since 2022

📚 Books worth reading

Ranked by number of editions on Open Library, a rough measure of how lasting a book is.

🔗 Related topics