English
Related papers

Related papers: Dynamical Regimes of Multimodal Diffusion Models

200 papers

Generative diffusion models have recently emerged as a leading approach for generating high-dimensional data. In this paper, we show that the dynamics of these models exhibit a spontaneous symmetry breaking that divides the generative…

Machine Learning · Computer Science 2023-10-27 Gabriel Raya , Luca Ambrogioni

Recent advances in latent diffusion models have demonstrated state-of-the-art performance in high-dimensional time-series data synthesis while providing flexible control through conditioning and guidance. However, existing methodologies…

Machine Learning · Computer Science 2025-11-11 Matteo Pettenó , Alessandro Ilic Mezza , Alberto Bernardini

We introduce and study a class of probabilistic generative models, where the latent object is a finite-dimensional diffusion process on a finite time interval and the observed variable is drawn conditionally on the terminal point of the…

Probability · Mathematics 2019-06-03 Belinda Tzen , Maxim Raginsky

We survey continuous-time generative modeling methods based on transporting a simple reference distribution to a data distribution via stochastic or deterministic dynamics. We present a unified framework in which diffusion models,…

Machine Learning · Computer Science 2026-05-11 Aditya Ranganath , Mukesh Singhal

Wall-bounded turbulent flows are chaotic and multiscale, rendering real-time prediction at high Reynolds numbers computationally prohibitive in applications such as wind farms. Classical data assimilation methods are based on repeated…

Fluid Dynamics · Physics 2026-05-25 Fabian Steinbrenner , Baris Turan , Hao Teng , Heng Xiao

In this paper, we analyze the use of the Ornstein-Uhlenbeck process to model dynamical systems subjected to bounded noisy perturbations. In order to discuss the main characteristics of this new approach we consider some basic models in…

Dynamical Systems · Mathematics 2024-01-17 Tomás Caraballo , Renato Colucci , Javier López-de-la-Cruz , Alain Rapaport

Generative models often treat continuous data and discrete events as separate processes, creating a gap in modeling complex systems where they interact synchronously. To bridge this gap, we introduce JointDiff, a novel diffusion framework…

Machine Learning · Computer Science 2026-01-30 Guillem Capellera , Luis Ferraz , Antonio Rubio , Alexandre Alahi , Antonio Agudo

Diffusion models, emerging as powerful deep generative tools, excel in various applications. They operate through a two-steps process: introducing noise into training samples and then employing a model to convert random noise into new…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Huijie Zhang , Yifu Lu , Ismail Alkhouri , Saiprasad Ravishankar , Dogyoon Song , Qing Qu

Diffusion-based generative models have achieved remarkable performance across various domains, yet their practical deployment is often limited by high sampling costs. While prior work focuses on training objectives or individual solvers,…

Machine Learning · Computer Science 2026-02-16 Sangwoo Jo , Sungjoon Choi

Chaotic dynamical systems exhibit strong sensitivity to initial conditions and often contain unresolved multiscale processes, making deterministic forecasting fundamentally limited. Generative models offer an appealing alternative by…

Machine Learning · Computer Science 2026-01-01 Patrick Wyrod , Ashesh Chattopadhyay , Daniele Venturi

Denoising diffusion probabilistic models (DDPMs) represent a recent advance in generative modelling that has delivered state-of-the-art results across many domains of applications. Despite their success, a rigorous theoretical understanding…

Statistics Theory · Mathematics 2025-08-21 Miha Brešar , Aleksandar Mijatović

Generative models based on diffusion have become the state of the art in the last few years, notably for image generation. Here, we analyse them in the high-dimensional limit, where data are formed by a very large number of variables. We…

Disordered Systems and Neural Networks · Physics 2023-10-31 Giulio Biroli , Marc Mézard

We explore the dynamics of active elements performing persistent random motion with fluctuating active speed and in the presence of translational noise in a $d$-dimensional harmonic trap, modeling active speed generation through an…

Statistical Mechanics · Physics 2025-02-18 Manish Patel , Amir Shee , Debasish Chaudhuri

This work presents an autoregressive generative diffusion model (DiffObs) to predict the global evolution of daily precipitation, trained on a satellite observational product, and assessed with domain-specific diagnostics. The model is…

Computational Physics · Physics 2024-04-11 Jason Stock , Jaideep Pathak , Yair Cohen , Mike Pritchard , Piyush Garg , Dale Durran , Morteza Mardani , Noah Brenowitz

Although autoregressive models have dominated language modeling in recent years, there has been a growing interest in exploring alternative paradigms to the conventional next-token prediction framework. Diffusion-based language models have…

Computation and Language · Computer Science 2025-10-23 Chihan Huang , Hao Tang

Learning the distribution of data on Riemannian manifolds is crucial for modeling data from non-Euclidean space, which is required by many applications in diverse scientific fields. Yet, existing generative models on manifolds suffer from…

Machine Learning · Computer Science 2024-06-04 Jaehyeong Jo , Sung Ju Hwang

We present a new theoretical framework for Diffusion Limited Aggregation and associated Dielectric Breakdown Models in two dimensions. Key steps are understanding how these models interrelate when the ultra-violet cut-off strategy is…

Statistical Mechanics · Physics 2007-05-23 R. C. Ball , E. Somfai

Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zijie Li , Henry Li , Yichun Shi , Amir Barati Farimani , Yuval Kluger , Linjie Yang , Peng Wang

We demonstrate how conditional generation from diffusion models can be used to tackle a variety of realistic tasks in the production of music in 44.1kHz stereo audio with sampling-time guidance. The scenarios we consider include…

Sound · Computer Science 2023-12-06 Mark Levy , Bruno Di Giorgi , Floris Weers , Angelos Katharopoulos , Tom Nickson

Beyond high-fidelity image synthesis, diffusion models have recently exhibited promising results in dense visual perception tasks. However, most existing work treats diffusion models as a standalone component for perception tasks, employing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shuhong Zheng , Zhipeng Bao , Ruoyu Zhao , Martial Hebert , Yu-Xiong Wang