English
Related papers

Related papers: Moment Estimates and DeepRitz Methods on Learning …

200 papers

Using statistical physics methods, we study generative diffusion models in the regime where the dimension of space and the number of data are large, and the score function has been trained optimally. Our analysis reveals three distinct…

Machine Learning · Computer Science 2025-01-08 Giulio Biroli , Tony Bonnaire , Valentin de Bortoli , Marc Mézard

Distributionally robust policy learning aims to find a policy that performs well under the worst-case distributional shift, and yet most existing methods for robust policy learning consider the worst-case joint distribution of the covariate…

Machine Learning · Computer Science 2025-06-03 Jingyuan Wang , Zhimei Ren , Ruohan Zhan , Zhengyuan Zhou

Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result,…

Graphics · Computer Science 2025-05-20 Javier E. Santos , Agnese Marcato , Roman Colman , Nicholas Lubbers , Yen Ting Lin

Accurate pedestrian trajectory prediction is crucial for ensuring safety and efficiency in autonomous driving and human-robot interaction scenarios. Earlier studies primarily utilized sufficient observational data to predict future…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Yuhao Luo , Yuang Zhang , Kehua Chen , Xinyu Zheng , Shucheng Zhang , Sikai Chen , Yinhai Wang

Motivated by the challenge of moment recovery in hydrodynamic approximation in kinetic theory, we propose a data-driven approach for the hydrodynamic models. Inspired by continuous data assimilation, our method introduces a relaxation-based…

Numerical Analysis · Mathematics 2025-07-25 Jingcheng Lu , Kunlun Qi , Li Wang , Jeff Calder

We introduce a two-state non-conserving driven-diffusive system in one-dimension under a discrete-time updating scheme. We show that the steady-state of the system can be obtained using a matrix product approach. On the other hand, the…

Statistical Mechanics · Physics 2014-03-07 S. R. Masharian , F. H. Jafarpour , A. Aghamohammadi

We develop a flux-conservative formalism for a Newtonian multi-fluid system, including dissipation and entrainment (i.e. allowing the momentum of one fluid to be a linear combination of the velocities of all fluids). Maximum use is made of…

Fluid Dynamics · Physics 2016-09-08 Nils Andersson , G. L. Comer

It is currently difficult to distill discrete diffusion models. In contrast, continuous diffusion literature has many distillation approaches methods that can reduce sampling steps to a handful. Our method, Discrete Moment Matching…

Machine Learning · Computer Science 2026-03-23 Emiel Hoogeboom , David Ruhe , Jonathan Heek , Thomas Mensink , Tim Salimans

Animals learn the timing between consecutive events very easily. Their precision is usually proportional to the interval to time (Weber's law for timing). Most current timing models either require a central clock and unbounded accumulator…

Neurons and Cognition · Quantitative Biology 2011-03-15 Francois Rivest , Yoshua Bengio

Diffusion models excel at generating diverse and multimodal trajectories for robotic planning, yet their iterative denoising process introduces latency that is incompatible with high-frequency closed-loop control. To address this problem,…

Robotics · Computer Science 2026-05-26 Lei Zheng , Peiqi Yu , Zengqi Peng , Changliu Liu , Armin Lederer

We propose a new scheme for the long time approximation of a diffusion when the drift vector field is not globally Lipschitz. Under this assumption, regular explicit Euler scheme --with constant or decreasing step-- may explode and implicit…

Probability · Mathematics 2018-02-20 Vincent Lemaire

Diffusion models have demonstrated excellent potential for generating diverse images. However, their performance often suffers from slow generation due to iterative denoising. Knowledge distillation has been recently proposed as a remedy…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Jiatao Gu , Shuangfei Zhai , Yizhe Zhang , Lingjie Liu , Josh Susskind

We evaluate the significance of a recently proposed bivariate jump-diffusion model for a data-driven characterization of interactions between complex dynamical systems. For various coupled and non-coupled jump-diffusion processes, we find…

Data Analysis, Statistics and Probability · Physics 2021-05-26 Esra Aslim , Thorsten Rings , Lina Zabawa , Klaus Lehnertz

We introduce the Discrete Inverse Continuity Equation (DICE) method, a generative modeling approach that learns the evolution of a stochastic process from given sample populations at a finite number of time points. Models learned with DICE…

Machine Learning · Computer Science 2025-07-08 Tobias Blickhan , Jules Berman , Andrew Stuart , Benjamin Peherstorfer

Diffusion probabilistic models (DPMs) have become a popular approach to conditional generation, due to their promising results and support for cross-modal synthesis. A key desideratum in conditional synthesis is to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Ye Zhu , Yu Wu , Kyle Olszewski , Jian Ren , Sergey Tulyakov , Yan Yan

We derive expressions for the first three moments of the decision time (DT) distribution produced via first threshold crossings by sample paths of a drift-diffusion equation. The "pure" and "extended" diffusion processes are widely used to…

Neurons and Cognition · Quantitative Biology 2016-01-26 Vaibhav Srivastava , Philip Holmes , Patrick Simen

Learning dynamical systems from incomplete or noisy data is inherently ill-posed, as a single observation may correspond to multiple plausible futures. While physics-based ensemble forecasting relies on perturbing initial states to capture…

Machine Learning · Computer Science 2026-02-27 Siddharth Rout , Eldad Haber , Stephane Gaudreault

In this paper we consider a diffusion process obtained as a small random perturbation of a dynamical system attracted to a stable equilibrium point. The drift and the diffusive perturbation are assumed to evolve slowly in time. We describe…

Probability · Mathematics 2016-10-23 Mark Freidlin , Leonid Koralov

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

Chance-constrained motion planning requires uncertainty in dynamics to be propagated into uncertainty in state. When nonlinear models are used, Gaussian assumptions on the state distribution do not necessarily apply since almost all random…

Systems and Control · Electrical Eng. & Systems 2020-03-31 Allen Wang , Ashkan Jasour , Brian Williams