English
Related papers

Related papers: Explicit solution of relative entropy weighted con…

200 papers

The method of Maximum (relative) Entropy (ME) is used to translate the information contained in the known form of the likelihood into a prior distribution for Bayesian inference. The argument is guided by intuition gained from the…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

In this article, we derive first-order necessary optimality conditions for a constrained optimal control problem formulated in the Wasserstein space of probability measures. To this end, we introduce a new notion of localised metric…

Optimization and Control · Mathematics 2021-04-28 Benoît Bonnet , Hélène Frankowska

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…

Optimization and Control · Mathematics 2011-07-07 Eugenio Cinquemani , Mayank Agarwal , Debasish Chatterjee , John Lygeros

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

The quantization problem aims to find the best possible approximation of probability measures on ${\mathbb{R}}^d$ using finite, discrete measures. The Wasserstein distance is a typical choice to measure the quality of the approximation.…

Probability · Mathematics 2023-09-11 Rajmadan Lakshmanan , Alois Pichler

We show how to determine the maximum and minimum possible values of one measure of entropy for a given value of another measure of entropy. These maximum and minimum values are obtained for two standard forms of probability distribution (or…

Quantum Physics · Physics 2007-05-23 Dominic W. Berry , Barry C. Sanders

We consider the optimal control of a PDE with random source term subject to probabilistic or almost sure state constraints. In the main theoretical result, we provide an exact formula for the Clarke subdifferential of the probability…

Optimization and Control · Mathematics 2023-11-28 Caroline Geiersbach , René Henrion , Pedro Pérez-Aros

Given a Wiener process with unknown and unobservable drift, we try to estimate this drift as effectively but also as quickly as possible, in the presence of a quadratic penalty for the estimation error and of a fixed, positive cost per unit…

Statistics Theory · Mathematics 2019-05-24 Erik Ekström , Ioannis Karatzas , Juozas Vaicenavicius

We discretize a risk-neutral optimal control problem governed by a linear elliptic partial differential equation with random inputs using a Monte Carlo sample-based approximation and a finite element discretization, yielding finite…

Optimization and Control · Mathematics 2023-11-10 Johannes Milz

Risk-sensitive planning aims to identify policies maximizing some tail-focused metrics in Markov Decision Processes (MDPs). Such an optimization task can be very costly for the most widely used and interpretable metrics such as threshold…

Machine Learning · Statistics 2025-07-09 Alexandre Marthe , Samuel Bounan , Aurélien Garivier , Claire Vernade

We address the problem of optimizing a Brownian motion. We consider a (random) realization $W$ of a Brownian motion with input space in $[0,1]$. Given $W$, our goal is to return an $\epsilon$-approximation of its maximum using the smallest…

Machine Learning · Statistics 2019-01-16 Jean-Bastien Grill , Michal Valko , Rémi Munos

For probability measures on countable spaces we derive distributional limits for empirical entropic optimal transport quantities. More precisely, we show that the empirical optimal transport plan weakly converges to a centered Gaussian…

Probability · Mathematics 2022-12-27 Shayan Hundrieser , Marcel Klatt , Axel Munk

In this paper we give a solution to the quickest drift change detection problem for a multivariate L\'evy process consisting of both continuous (Gaussian) and jump components in the Bayesian approach. We do it for a general 0-modified…

Probability · Mathematics 2022-04-22 Michał Krawiec , Zbigniew Palmowski

In this paper we present new theoretical results on optimal estimation of certain random quantities based on high frequency observations of a L\'evy process. More specifically, we investigate the asymptotic theory for the conditional mean…

Probability · Mathematics 2020-01-09 Jevgenijs Ivanovs , Mark Podolskij

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

We develop the method of Maximum Entropy (ME) as a technique to generate approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a…

Statistical Mechanics · Physics 2007-07-24 Chih-Yuan Tseng , Ariel Caticha

An optimal control problem for the linear wave equation with control cost chosen as the BV semi-norm in time is analyzed. This formulation enhances piecewise constant optimal controls and penalizes the number of jumps. Existence of optimal…

Optimization and Control · Mathematics 2018-09-11 Sebastian Engel , Karl Kunisch

On a connected finite graph, we propose an evolution of weights including Ollivier's Ricci flow as a special case. During the evolution process, on each edge, the speed of change of weight is exactly the difference between the Wasserstein…

Classical Analysis and ODEs · Mathematics 2025-04-30 Jicheng Ma , Yunyan Yang

We solve two stochastic control problems in which a player tries to minimize or maximize the exit time from an interval of a Brownian particle, by controlling its drift. The player can change from one drift to another but is subject to a…

Probability · Mathematics 2014-08-19 Robert C. Dalang , Laura Vinckenbosch