English
Related papers

Related papers: On Forgetting and Stability of Score-based Generat…

200 papers

This paper shows that generative diffusion processes converge to associative memory systems at vanishing noise levels and characterizes the stability, robustness, memorization, and generation dynamics of both model classes. Morse-Smale…

Machine Learning · Computer Science 2025-11-18 Joshua Hess , Quaid Morris

We present a stochastic method for reconstructing missing spatial and velocity data along the trajectories of small objects passively advected by turbulent flows with a wide range of temporal or spatial scales, such as small balloons in the…

Fluid Dynamics · Physics 2024-11-14 Tianyi Li , Luca Biferale , Fabio Bonaccorso , Michele Buzzicotti , Luca Centurioni

This study in centered on models accounting for stochastic deformations of sample paths of random walks, embedded either in $\mathbb{Z}^2$ or in $\mathbb{Z}^3$. These models are immersed in multi-type particle systems with exclusion.…

Statistical Mechanics · Physics 2007-05-23 Guy Fayolle , Cyril Furtlehner

We introduce a novel approach based on stochastic optimization to find the optimal sampling distribution for the data-driven stability analysis of switched linear systems. Our goal is to address limitations of existing approaches, in…

Optimization and Control · Mathematics 2025-09-01 Alexis Vuille , Guillaume O. Berger , Raphaël M. Jungers

This paper aims to provide a simple modelling of speculative bubbles and derive some quantitative properties of its dynamical evolution. Starting from a description of individual speculative behaviours, we build and study a second order…

Probability · Mathematics 2013-09-25 Sébastien Gadat , Laurent Miclo , Fabien Panloup

In contexts where data samples represent a physically stable state, it is often assumed that the data points represent the local minima of an energy landscape. In control theory, it is well-known that energy can serve as an effective…

Machine Learning · Computer Science 2024-02-09 Christopher Iliffe Sprague , Arne Elofsson , Hossein Azizpour

Deep networks are commonly used to model dynamical systems, predicting how the state of a system will evolve over time (either autonomously or in response to control inputs). Despite the predictive power of these systems, it has been…

Machine Learning · Computer Science 2020-01-20 Gaurav Manek , J. Zico Kolter

Score-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization. However, existing training procedures are limited to images of low resolution (typically below 32x32), and…

Machine Learning · Computer Science 2020-10-27 Yang Song , Stefano Ermon

Discrete diffusion models, like continuous diffusion models, generate high-quality samples by gradually undoing noise applied to datapoints with a Markov process. Gradual generation in theory comes with many conceptual benefits; for…

Machine Learning · Computer Science 2025-09-30 Alan N. Amin , Nate Gruver , Andrew Gordon Wilson

This paper studies the problem of ergodicity of transition probability matrices in Markovian models, such as hidden Markov models (HMMs), and how it makes very difficult the task of learning to represent long-term context for sequential…

Artificial Intelligence · Computer Science 2014-11-17 Y. Bengio , P. Frasconi

We consider stability analysis of constrained switching linear systems in which the dynamics is unknown and whose switching signal is constrained by an automaton. We propose a data-driven Lyapunov framework for providing probabilistic…

Systems and Control · Electrical Eng. & Systems 2022-07-15 Adrien Banse , Zheming Wang , Raphaël M. Jungers

This study presents a sampling-based method to guarantee robust stability of general control systems with uncertainty. The method allows the system dynamics and controllers to be represented by various data-driven models, such as Gaussian…

Optimization and Control · Mathematics 2025-04-11 Yuji Ito , Kenji Fujimoto

We are interested in understanding stability (almost sure boundedness) of stochastic approximation algorithms (SAs) driven by a `controlled Markov' process. Analyzing this class of algorithms is important, since many reinforcement learning…

Systems and Control · Computer Science 2018-05-18 Arunselvan Ramaswamy , Shalabh Bhatnagar

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their sampling process is slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hengyuan Ma , Xiatian Zhu , Jianfeng Feng , Li Zhang

Inverse problems describe the process of estimating the causal factors from a set of measurements or data. Mapping of often incomplete or degraded data to parameters is ill-posed, thus data-driven iterative solutions are required, for…

Artificial Intelligence · Computer Science 2024-06-21 Weitong Zhang , Chengqi Zang , Liu Li , Sarah Cechnicka , Cheng Ouyang , Bernhard Kainz

Recently, diffusion probabilistic models (DPMs) have achieved promising results in diverse generative tasks. A typical DPM framework includes a forward process that gradually diffuses the data distribution and a reverse process that…

Machine Learning · Computer Science 2023-10-31 Tianyu Pang , Cheng Lu , Chao Du , Min Lin , Shuicheng Yan , Zhijie Deng

High-dimensional dynamical systems projected onto a reduced-order model cease to be deterministic and are best described by probability distributions in state space. Their equations of motion map onto an evolution operator with a…

Fluid Dynamics · Physics 2024-11-20 Javier Jiménez

Many chemical reactions and molecular processes occur on timescales that are significantly longer than those accessible by direct simulation. One successful approach to estimating dynamical statistics for such processes is to use many short…

Computational Physics · Physics 2024-10-03 Chatipat Lorpaiboon , Spencer C. Guo , John Strahan , Jonathan Weare , Aaron R. Dinner

Learning a categorical distribution comes with its own set of challenges. A successful approach taken by state-of-the-art works is to cast the problem in a continuous domain to take advantage of the impressive performance of the generative…

Machine Learning · Computer Science 2023-03-09 Florence Regol , Mark Coates

Modern generative modeling is dominated by transport from a noise prior to data. We propose an alternative paradigm in which generation is performed by a discrete stochastic dynamics that leaves the data distribution invariant, initialized…

Machine Learning · Computer Science 2026-05-11 Eshed Gal , Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber
‹ Prev 1 8 9 10 Next ›