English
Related papers

Related papers: Port--Hamiltonian Diffusion Models: A Control-Theo…

200 papers

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

Generative AI has achieved remarkable empirical success, but from the perspective of statistics it often remains opaque: its predictions may be accurate, yet the underlying mechanism is difficult to interpret, analyze, and trust. This book…

Machine Learning · Statistics 2026-03-11 Shinto Eguchi

This paper investigates a distributed formation tracking control law for large-scale networks of mechanical systems. In particular, the formation network is represented by a directed communication graph with leaders and followers, where…

Systems and Control · Electrical Eng. & Systems 2022-03-18 N. Javanmardi , P. Borja , M. J. Yazdanpanah , J. M. A. Scherpen

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals --…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Chicago Y. Park , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

We study the theoretical foundations of composition in diffusion models, with a particular focus on out-of-distribution extrapolation and length-generalization. Prior work has shown that composing distributions via linear score combination…

Machine Learning · Computer Science 2025-09-29 Arwen Bradley , Preetum Nakkiran , David Berthelot , James Thornton , Joshua M. Susskind

Compositional generalization requires models to produce novel configurations from familiar parts. In diffusion models, prior compositional generation methods typically assume that the relevant concepts or conditioning signals are already…

Machine Learning · Computer Science 2026-05-11 Zekun Wang , Anant Gupta , Tianyi Zhu , Christopher J. MacLellan

Diffusion models are loosely modelled based on non-equilibrium thermodynamics, where \textit{diffusion} refers to particles flowing from high-concentration regions towards low-concentration regions. In statistics, the meaning is quite…

Machine Learning · Computer Science 2023-12-19 Inga Strümke , Helge Langseth

A model of sensory information processing is presented. The model assumes that learning of internal (hidden) generative models, which can predict the future and evaluate the precision of that prediction, is of central importance for…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Andras Lorincz

This paper proposes a passivity-based port-Hamiltonian (pH) framework for multi-agent displacement-based and rigid formation control and velocity tracking. The control law consists of two parts, where the internal feedback is to track the…

Systems and Control · Electrical Eng. & Systems 2023-05-18 Ningbo Li , Zhiyong Sun , Arjan van der Schaft , Jacquelien M. A. Scherpen

Control theory often takes the mathematical model of the to-be-control-led system for granted. In contrast, port-Hamiltonian systems theory bridges the gap between modelling and control for physical systems. It provides a unified framework…

Optimization and Control · Mathematics 2024-12-30 Arjan van der Schaft

Score-based diffusion models have emerged as powerful techniques for generating samples from high-dimensional data distributions. These models involve a two-phase process: first, injecting noise to transform the data distribution into a…

Machine Learning · Computer Science 2024-10-21 Runjia Li , Qiwei Di , Quanquan Gu

We establish a connection between stochastic optimal control and generative models based on stochastic differential equations (SDEs), such as recently developed diffusion probabilistic models. In particular, we derive a…

Machine Learning · Computer Science 2024-03-27 Julius Berner , Lorenz Richter , Karen Ullrich

The port-Hamiltonian formulation is a powerful method for modeling and interconnecting systems of different natures. In this paper, the port-Hamiltonian formulation in tensorial form of a thick plate described by the Mindlin-Reissner model…

Analysis of PDEs · Mathematics 2020-10-07 Andrea Brugnoli , Daniel Alazard , Valérie Pommier-Budinger , Denis Matignon

The scope of this paper is generative modeling through diffusion processes. An approach falling within this paradigm is the work of Song et al. (2021), which relies on a time-reversal argument to construct a diffusion process targeting the…

Machine Learning · Computer Science 2023-12-25 Stefano Peluchetti

Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability distribution to the…

Machine Learning · Statistics 2025-11-12 Ehsan Mirafzali , Frank Proske , Utkarsh Gupta , Daniele Venturi , Razvan Marinescu

Diffusion models represent a class of generative models that produce data by denoising a sample corrupted by white noise. Despite the success of diffusion models in computer vision, audio synthesis, and point cloud generation, so far they…

Statistical Mechanics · Physics 2025-01-17 Kanta Masuki , Yuto Ashida

Diffusion models have become a popular choice for representing actor policies in behavior cloning and offline reinforcement learning. This is due to their natural ability to optimize an expressive class of distributions over a continuous…

Machine Learning · Computer Science 2025-02-17 Michael Psenka , Alejandro Escontrela , Pieter Abbeel , Yi Ma

Score-based generative models (SGMs) have revolutionized the field of generative modeling, achieving unprecedented success in generating realistic and diverse content. Despite empirical advances, the theoretical basis for why optimizing the…

Machine Learning · Computer Science 2024-08-30 Gen Li , Yuling Yan

This paper provides a first contribution to port-Hamiltonian modeling of district heating networks. By introducing a model hierarchy of flow equations on the network, this work aims at a thermodynamically consistent port-Hamiltonian…

In our contemporary academic inquiry, we present "Diffusion-C," a foundational methodology to analyze the generative restrictions of Diffusion Models, particularly those akin to GANs, DDPM, and DDIM. By employing input visual data that has…

Machine Learning · Computer Science 2023-12-15 Keywoong Bae , Suan Lee , Wookey Lee