Continuous Diffusion Language Models (CDLM's)

Automated excerpt

Schematic diagram of (a) an autoregressive model, (b) a discrete diffusion model (masked diffusion) and (c) a continuous diffusion model. RePlaid and LangFlow even make the opposite claim in their respective paper titles: ‘Continuous Diffusion Scales Competitively with Discrete Diffusion for Language’, ‘Continuous Diffusion Rivals Discrete in Language Modeling’. Posterior Refinement71 wraps continuous diffusion within masked diffusion.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.