English
Related papers

Related papers: Learning from Samples: Inverse Problems over measu…

200 papers

We consider the problem of optimising the expected value of a loss functional over a nonlinear model class of functions, assuming that we have only access to realisations of the gradient of the loss. This is a classical task in statistics,…

Optimization and Control · Mathematics 2026-02-02 Robert Gruhlke , Anthony Nouy , Philipp Trunschke

The paper proposes a general framework to analyze control problems for conservation law models on a network. Namely we consider a general class of junction distribution controls and inflow controls and we establish the compactness in $L^1$…

Analysis of PDEs · Mathematics 2018-07-24 Fabio Ancona , Annalisa Cesaroni , Giuseppe Maria Coclite , Mauro Garavello

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

Probability · Mathematics 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

An adaptive, adversarial methodology is developed for the optimal transport problem between two distributions $\mu$ and $\nu$, known only through a finite set of independent samples $(x_i)_{i=1..N}$ and $(y_j)_{j=1..M}$. The methodology…

Optimization and Control · Mathematics 2019-02-20 Montacer Essid , Debra Laefer , Esteban G. Tabak

Rectified flow (Liu et al., 2022; Liu, 2022; Wu et al., 2023) is a method for defining a transport map between two distributions, and enjoys popularity in machine learning, although theoretical results supporting the validity of these…

Statistics Theory · Mathematics 2025-12-11 Gonzalo Mena , Arun Kumar Kuchibhotla , Larry Wasserman

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce…

Optimization and Control · Mathematics 2019-07-15 Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

Finding a transformation between two unknown probability distributions from finite samples is crucial for modeling complex data distributions and performing tasks such as sample generation, domain adaptation and statistical inference. One…

Machine Learning · Computer Science 2024-07-11 Zhe Xiong , Qiaoqiao Ding , Xiaoqun Zhang

Many numerical and learning algorithms rely on the solution of the Monge-Kantorovich problem and Wasserstein distances, which provide appropriate distributional metrics. While the natural approach is to treat the problem as an…

Optimization and Control · Mathematics 2025-12-11 Mohsen Sadr , Peyman Mohajerin Esfahani , Hossein Gorji

Statistical decision problems lie at the heart of statistical machine learning. The simplest problems are binary and multiclass classification and class probability estimation. Central to their definition is the choice of loss function,…

Machine Learning · Computer Science 2023-08-21 Robert C. Williamson , Zac Cranko

We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems. Our approach leverages the theory of kernel distribution embeddings, which allows…

Systems and Control · Electrical Eng. & Systems 2022-02-10 Adam J. Thorpe , Thomas Lew , Meeko M. K. Oishi , Marco Pavone

We consider a general optimization problem of minimizing a composite objective functional defined over a class of probability distributions. The objective is composed of two functionals: one is assumed to possess the variational…

Machine Learning · Computer Science 2024-08-20 Dai Hai Nguyen , Tetsuya Sakurai

We study the distributed stochastic compositional optimization problems over directed communication networks in which agents privately own a stochastic compositional objective function and collaborate to minimize the sum of all objective…

Optimization and Control · Mathematics 2022-03-22 Shengchao Zhao , Yongchao Liu

We consider supervised learning problems in which set predictions provide explicit uncertainty estimates. Using Choquet integrals (a.k.a. Lov{\'a}sz extensions), we propose a convex loss function for nondecreasing subset-valued functions…

Machine Learning · Computer Science 2025-12-23 Francis Bach

Numerous problems of both theoretical and practical interest are related to finding shortest (or otherwise optimal) paths in networks, frequently in the presence of some obstacles or constraints. A somewhat related class of problems focuses…

Statistical Mechanics · Physics 2021-03-01 Ricardo Gutiérrez , Carlos Pérez-Espigares

We propose a \textbf{uni}fied \textbf{f}ramework for \textbf{i}mplicit \textbf{ge}nerative \textbf{m}odeling (UnifiGem) with theoretical guarantees by integrating approaches from optimal transport, numerical ODE, density-ratio…

Machine Learning · Computer Science 2020-02-18 Yuan Gao , Jian Huang , Yuling Jiao , Jin Liu

Minimizing functionals in the space of probability distributions can be done with Wasserstein gradient flows. To solve them numerically, a possible approach is to rely on the Jordan-Kinderlehrer-Otto (JKO) scheme which is analogous to the…

Machine Learning · Computer Science 2022-11-16 Clément Bonet , Nicolas Courty , François Septier , Lucas Drumetz

We study an inverse design problem for the linear multiple fragmentation equation arising in particle dynamics. Our objective is to reconstruct an unknown initial size distribution that evolves, under a prescribed fragmentation law, into a…

Optimization and Control · Mathematics 2026-02-20 Arijit Das

The inverse approach is computationally efficient in aerodynamic design as the desired target performance distribution is prespecified. However, it has some significant limitations that prevent it from achieving full efficiency. First, the…

Machine Learning · Computer Science 2022-03-10 Sunwoong Yang , Sanga Lee , Kwanjung Yee

The recent developments of basis pursuit and compressed sensing seek to extract information from as few samples as possible. In such applications, since the number of samples is restricted, one should deploy the sampling points wisely. We…

Information Theory · Computer Science 2012-07-26 Rui Wang , Haizhang Zhang

In this work, we propose a novel methodology for robustly estimating particle size distributions from optical scattering measurements using constrained Gaussian process regression. The estimation of particle size distributions is commonly…

Machine Learning · Statistics 2025-07-08 Fahime Seyedheydari , Mahdi Nasiri , Marcin Mińkowski , Simo Särkkä