English
Related papers

Related papers: Schr\"odinger bridge for generative AI: Soft-const…

200 papers

Generative diffusion models use time-forward and backward stochastic differential equations to connect the data and prior distributions. While conventional diffusion models (e.g., score-based models) only learn the backward process, more…

Machine Learning · Computer Science 2024-12-25 Kentaro Kaba , Reo Shimizu , Masayuki Ohzeki , Yuki Sughiyama

Leveraging connections between diffusion-based sampling, optimal transport, and stochastic optimal control through their shared links to the Schr\"odinger bridge problem, we propose novel objective functions that can be used to transport…

Machine Learning · Statistics 2024-10-11 Qijia Jiang , David Nabergoj

We establish the stability of solutions to the entropically regularized optimal transport problem with respect to the marginals and the cost function. The result is based on the geometric notion of cyclical invariance and inspired by the…

Optimization and Control · Mathematics 2022-07-07 Promit Ghosal , Marcel Nutz , Espen Bernton

We consider the problem of sampling from an unknown distribution for which only a sufficiently large number of training samples are available. In this paper, we build on previous work combining Schr\"odinger bridges and plug & play Langevin…

Machine Learning · Statistics 2024-11-19 Georg A. Gottwald , Sebastian Reich

We propose a new framework for generative modeling based on a discrete-time stochastic control formulation of measure transport. Adapting classic results from control theory, we formulate our problem as a linear program whose dual variables…

Machine Learning · Computer Science 2026-05-22 Pablo Moreno-Muñoz , Adrian Müller , Gergely Neu

Solutions to the Schr\"{o}dinger bridge problem and its generalizations yield feedback control policies for optimal density steering over a controlled diffusion. To numerically compute the same, the dynamic Sinkhorn recursion has become a…

Optimization and Control · Mathematics 2026-04-28 Georgiy A. Bondar , Asmaa Eldesoukey , Yongxin Chen , Abhishek Halder

We consider an entropy-regularized version of optimal density control of deterministic discrete-time linear systems. Entropy regularization, or a maximum entropy (MaxEnt) method for optimal control has attracted much attention especially in…

Optimization and Control · Mathematics 2023-08-15 Kaito Ito , Kenji Kashima

We consider the problem of steering a linear stochastic system between two end-point degenerate Gaussian distributions in finite time. This accounts for those situations in which some but not all of the state entries are uncertain at the…

Optimization and Control · Mathematics 2020-06-18 Valentina Ciccone , Yongxin Chen , Tryphon T. Georgiou , Michele Pavon

A Schr\"odinger bridge is the most probable time-dependent probability distribution that connects an initial probability distribution $w_{i}$ to a final one $w_{f}$. The problem has been solved and widely used for the case of simple…

Statistical Mechanics · Physics 2025-07-02 Henri Orland

The Schr\"{o}dinger bridge (SB) has evolved into a universal class of probabilistic generative models. In practice, however, estimated learning signals are innately uncertain, and the reliability promised by existing methods is often based…

Machine Learning · Computer Science 2025-12-23 Dong-Sig Han , Jaein Kim , Hee Bin Yoo , Byoung-Tak Zhang

Metasurface inverse design is challenged by the intricate relationship between structural parameters and electromagnetic responses, as well as the high dimensionality of the optimization space. Local models, while commonly employed, quickly…

The sum-product or belief propagation (BP) algorithm is a widely-used message-passing algorithm for computing marginal distributions in graphical models with discrete variables. At the core of the BP message updates, when applied to a…

Information Theory · Computer Science 2012-05-28 Nima Noorshams , Martin J. Wainwright

Entropic optimal transport problems are regularized versions of optimal transport problems. These models play an increasingly important role in machine learning and generative modelling. For finite spaces, these problems are commonly solved…

Machine Learning · Statistics 2025-12-30 O. Deniz Akyildiz , Pierre Del Moral , Joaquín Miguez

Deep graph neural networks (GNNs) often suffer from oversmoothing, where node representations become overly homogeneous with increasing depth. While techniques like normalization, residual connections, and edge dropout have been proposed to…

Machine Learning · Computer Science 2025-05-30 Jiaqi Wang , Xinyi Wu , James Cheng , Yifei Wang

Recent advances have significantly improved our understanding of the sample complexity of learning in average-reward Markov decision processes (AMDPs) under the generative model. However, much less is known about the constrained…

Machine Learning · Computer Science 2025-09-23 Yukuan Wei , Xudong Li , Lin F. Yang

Recently, a series of papers proposed deep learning-based approaches to sample from target distributions using controlled diffusion processes, being trained only on the unnormalized target densities without access to samples. Building on…

Machine Learning · Computer Science 2024-05-24 Lorenz Richter , Julius Berner

Entropic optimal transport problems play an increasingly important role in machine learning and generative modelling. In contrast with optimal transport maps which often have limited applicability in high dimensions, Schrodinger bridges can…

Probability · Mathematics 2026-01-21 Pierre Del Moral , Ajay Jasra

Complex systems can be effectively modeled via graphs that encode networked interactions, where relations between entities or nodes are often quantified by signed edge weights, e.g., promotion/inhibition in gene regulatory networks, or…

Optimization and Control · Mathematics 2024-04-05 Anqi Dong , Can Chen , Tryphon T. Georgiou

Score-based diffusion models are frequently employed as structural priors in inverse problems. However, their iterative denoising process, initiated from Gaussian noise, often results in slow inference speeds. The Image-to-Image…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Yuang Wang , Pengfei Jin , Siyeop Yoon , Matthew Tivnan , Quanzheng Li , Li Zhang , Dufan Wu

As a foundational architecture of artificial intelligence models, Transformer has been recently adapted to spiking neural networks with promising performance across various tasks. However, existing spiking Transformer(ST)-based models…

Machine Learning · Computer Science 2026-01-06 Hongze Sun , Wuque Cai , Duo Chen , Quan Tang , Shifeng Mao , Jiayi He , Zhenxing Wang , Yan Cui , Dezhong Yao , Daqing Guo