English
Related papers

Related papers: On the Equivalence of Consistency-Type Models: Con…

200 papers

Understanding natural language requires common sense, one aspect of which is the ability to discern the plausibility of events. While distributional models -- most recently pre-trained, Transformer language models -- have demonstrated…

Computation and Language · Computer Science 2021-04-22 Ian Porada , Kaheer Suleman , Adam Trischler , Jackie Chi Kit Cheung

The inverse problem of backward diffusion is known to be ill-posed and highly unstable. Backward diffusion processes appear naturally in image enhancement and deblurring applications. It is therefore greatly desirable to establish a…

Numerical Analysis · Mathematics 2020-06-18 Leif Bergerhoff , Marcelo Cárdenas , Joachim Weickert , Martin Welk

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

Diffusion models have emerged as a powerful paradigm for modern generative modeling, demonstrating strong potential for large language models (LLMs). Unlike conventional autoregressive (AR) models that generate tokens sequentially,…

Machine Learning · Computer Science 2026-01-09 Gen Li , Changxiao Cai

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

We consider the solvability of the Fokker-Planck equation with both time-dependent drift and diffusion coefficients by means of the similarity method. By the introduction of the similarity variable, the Fokker-Planck equation is reduced to…

Mathematical Physics · Physics 2016-12-28 C. -L. Ho

We synthesize and unify notions of regularity, both of individual sets and of collections of sets, as they appear in the convergence theory of projection methods for consistent feasibility problems. Several new characterizations of…

Optimization and Control · Mathematics 2018-05-15 Alexander Y. Kruger , D. Russell Luke , Nguyen H. Thao

Discrete diffusion models have recently become competitive with autoregressive models for language modeling, even outperforming them on reasoning tasks requiring planning and global coherence, but they require more computation at inference…

Machine Learning · Computer Science 2026-02-04 Andre He , Sean Welleck , Daniel Fried

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

Self-similar solutions of the coherent diffusion equation are derived and measured. The set of real similarity solutions is generalized by the introduction of a nonuniform phase surface, based on the elegant Gaussian modes of optical…

Quantum Physics · Physics 2015-05-19 O. Firstenberg , P. London , D. Yankelev , R. Pugatch , M. Shuker , N. Davidson

This paper provides an in-depth examination of the concept of semantic diffusion as a complementary instrument to large language models (LLMs) for design applications. Conventional LLMs and diffusion models fail to induce a convergent,…

Human-Computer Interaction · Computer Science 2025-05-15 Alexander P. Ryjov , Alina A. Egorova

Diffusion posterior sampling solves inverse problems by combining a pretrained diffusion prior with measurement-consistency guidance, but it often fails to recover fine details because measurement terms are applied in a manner that is…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Feng Tian , Yixuan Li , Weili Zeng , Weitian Zhang , Yichao Yan , Xiaokang Yang

Large language models (LLMs) have achieved widespread success on a variety of in-context few-shot tasks, but this success is typically evaluated via correctness rather than consistency. We argue that self-consistency is an important…

Computation and Language · Computer Science 2024-02-09 Angelica Chen , Jason Phang , Alicia Parrish , Vishakh Padmakumar , Chen Zhao , Samuel R. Bowman , Kyunghyun Cho

We investigate intermittent diffusion using cycle expansions, and show that a truncation based on cycle stability achieves reasonable convergence.

chao-dyn · Physics 2009-10-30 Carl Dettmann , Predrag Cvitanovic'

We develop a comprehensive theory of the stable representation categories of several sequences of groups, including the classical and symmetric groups, and their relation to the unstable categories. An important component of this theory is…

Representation Theory · Mathematics 2015-06-17 Steven V Sam , Andrew Snowden

In recent years, denoising diffusion models have become a crucial area of research due to their abundance in the rapidly expanding field of generative AI. While recent statistical advances have delivered explanations for the generation…

Statistics Theory · Mathematics 2026-03-04 Asbjørn Holk , Claudia Strauch , Lukas Trottner

Diffusion models have demonstrated remarkable capabilities in synthesizing realistic images, spurring interest in using their representations for various downstream tasks. To better understand the robustness of these representations, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jonas Loos , Lorenz Linhardt

We propose an alternative method for one-dimensional continuum diffusion models with spatially variable (heterogeneous) diffusivity. Our method, which extends recent work on stochastic diffusion, assumes the constant-coefficient homogenized…

Computational Physics · Physics 2019-12-18 Elliot J. Carr

Flow-based generative models achieve state-of-the-art sample quality, but require the expensive solution of a differential equation at inference time. Flow map models, commonly known as consistency models, encompass many recent efforts to…

Machine Learning · Computer Science 2025-10-07 Nicholas M. Boffi , Michael S. Albergo , Eric Vanden-Eijnden

The function of biomolecules such as proteins depends on their ability to interconvert between a wide range of structures or "conformations." Researchers have endeavored for decades to develop computational methods to predict the…

Biomolecules · Quantitative Biology 2026-02-05 Daniel D. Richman , Jessica Karaguesian , Carl-Mikael Suomivuori , Ron O. Dror