English
Related papers

Related papers: Dynamical Regimes of Multimodal Diffusion Models

200 papers

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Autoregressive generative PDE solvers can be accurate one step ahead yet drift over long rollouts, especially in coarse-to-fine regimes where each step must regenerate unresolved fine scales. This is the regime of diffusion and…

Machine Learning · Computer Science 2026-02-09 Victor Armegioiu

High-fidelity numerical simulations of chaotic, high dimensional nonlinear dynamical systems are computationally expensive, necessitating the development of efficient surrogate models. Most surrogate models for such systems are…

Machine Learning · Computer Science 2026-03-16 Dibyajyoti Chakraborty , Hojin Kim , Romit Maulik

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk

In autonomous driving tasks, trajectory prediction in complex traffic environments requires adherence to real-world context conditions and behavior multimodalities. Existing methods predominantly rely on prior assumptions or generative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yiming Xu , Hao Cheng , Monika Sester

Recently, the advent of generative AI technologies has made transformational impacts on our daily lives, yet its application in scientific applications remains in its early stages. Data scarcity is a major, well-known barrier in data-driven…

Machine Learning · Computer Science 2025-01-03 Junhuan Yang , Yuzhou Zhang , Yi Sheng , Youzuo Lin , Lei Yang

The generation of synthetic financial data is a critical technology in the financial domain, addressing challenges posed by limited data availability. Traditionally, statistical models have been employed to generate synthetic data. However,…

Computational Finance · Quantitative Finance 2025-03-07 Yuki Tanaka , Ryuji Hashimoto , Takehiro Takayanagi , Zhe Piao , Yuri Murayama , Kiyoshi Izumi

Controllable diffusion generation often relies on various heuristics that are seemingly disconnected without a unified understanding. We bridge this gap with Diffusion Controller (DiffCon), a unified control-theoretic view that casts…

Machine Learning · Computer Science 2026-03-10 Tong Yang , Moonkyung Ryu , Chih-Wei Hsu , Guy Tennenholtz , Yuejie Chi , Craig Boutilier , Bo Dai

Diffusion-based generative models have recently emerged as powerful solutions for high-quality synthesis in multiple domains. Leveraging the bidirectional Markov chains, diffusion probabilistic models generate samples by inferring the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Mengyi Zhao , Mengyuan Liu , Bin Ren , Shuling Dai , Nicu Sebe

Generative models such as diffusion models, excel at capturing high-dimensional distributions with diverse input modalities, e.g. robot trajectories, but are less effective at multi-step constraint reasoning. Task and Motion Planning (TAMP)…

This paper addresses the problem of generating dynamically admissible trajectories for control tasks using diffusion models, particularly in scenarios where the environment is complex and system dynamics are crucial for practical…

Robotics · Computer Science 2025-10-15 Darshan Gadginmath , Fabio Pasqualetti

The emergence of deep generative models has recently enabled the automatic generation of massive amounts of graphical content, both in 2D and in 3D. Generative Adversarial Networks (GANs) and style control mechanisms, such as Adaptive…

Graphics · Computer Science 2020-04-28 Omry Sendik , Dani Lischinski , Daniel Cohen-Or

Generative modeling becomes increasingly data-intensive in high-dimensional spaces. In molecular science, where data collection is expensive and important events are rare, compression to lower-dimensional manifolds is especially important…

Machine Learning · Computer Science 2025-10-14 Richard John , Yunrui Qiu , Lukas Herron , Pratyush Tiwary

The paradigm shift toward structure-driven molecule generation has been propelled by advances in deep generative models, such as variational auto-encoders and diffusion models. However, these generative models for molecular design remain…

Machine Learning · Computer Science 2026-04-17 Peidong Liu , Wenbo Zhang , Wei Ju , Jiancheng Lv , Xianggen Liu

Dynamical downscaling is crucial for deriving high-resolution meteorological fields from coarse-scale simulations, enabling detailed analysis for critical applications such as weather forecasting and renewable energy modeling. Generative…

Machine Learning · Computer Science 2025-10-16 Alessandro Brusaferri , Andrea Ballarino

Deep generative models learn the data distribution, which is concentrated on a low-dimensional manifold. The geometric analysis of distribution transformation provides a better understanding of data structure and enables a variety of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Junhao Chen , Manyi Li , Zherong Pan , Xifeng Gao , Changhe Tu

Conventional phase-field models often drive solid-solid interfaces to coalesce when in close proximity. This feature limits their use for processes like diffusion bonding, where the interfaces might need to remain distinct under certain…

Materials Science · Physics 2026-02-20 Maryam Khodadad , Noel Walkington , Suresh Kalyanam , Matteo Pozzi , Kaushik Dayal

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

With the rapid development of diffusion models in image generation, the demand for more powerful and flexible controllable frameworks is increasing. Although existing methods can guide generation beyond text prompts, the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haoxuan Wang , Jinlong Peng , Qingdong He , Hao Yang , Ying Jin , Jiafu Wu , Xiaobin Hu , Yanjie Pan , Zhenye Gan , Mingmin Chi , Bo Peng , Yabiao Wang

The function of biomolecules such as proteins depends on their ability to interconvert between a wide range of structures or "conformations." Researchers have endeavored for decades to develop computational methods to predict the…

Biomolecules · Quantitative Biology 2026-02-05 Daniel D. Richman , Jessica Karaguesian , Carl-Mikael Suomivuori , Ron O. Dror