English
Related papers

Related papers: A Monotone Limit Approach to Entropy-Regularized A…

200 papers

We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically that the method…

Optimization and Control · Mathematics 2018-02-12 Christoph Brauer , Christian Clason , Dirk Lorenz , Benedikt Wirth

Sample-based trajectory optimisers are a promising tool for the control of robotics with non-differentiable dynamics and cost functions. Contemporary approaches derive from a restricted subclass of stochastic optimal control where the…

Robotics · Computer Science 2021-10-07 Tom Lefebvre , Guillaume Crevecoeur

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel…

Optimization and Control · Mathematics 2019-10-22 Tobias Sutter , David Sutter , Peyman Mohajerin Esfahani , John Lygeros

The maximum-entropy remote sampling problem (MERSP) is to select a subset of s random variables from a set of n random variables, so as to maximize the information concerning a set of target random variables that are not directly…

Optimization and Control · Mathematics 2026-02-03 Gabriel Ponte , Marcia Fampa , Jon Lee

In this paper, we present a novel maximum entropy formulation of the Differential Dynamic Programming algorithm and derive two variants using unimodal and multimodal value functions parameterizations. By combining the maximum entropy…

Optimization and Control · Mathematics 2022-03-01 Oswin So , Ziyi Wang , Evangelos A. Theodorou

We study a specific class of finite-horizon mean field optimal stopping problems by means of the dynamic programming approach. In particular, we consider problems where the state process is not affected by the stopping time. Such problems…

Optimization and Control · Mathematics 2025-03-07 Andrea Cosso , Laura Perelli

The analysis of structure-preserving numerical methods for the Poisson--Nernst--Planck (PNP) system has attracted growing interests in recent years. In this work, we provide an optimal rate convergence analysis and error estimate for finite…

Numerical Analysis · Mathematics 2022-02-23 Jie Ding , Cheng Wang , Shenggao Zhou

We propose a new approach to solve optimal stopping problems via simulation. Working within the backward dynamic programming/Snell envelope framework, we augment the methodology of Longstaff-Schwartz that focuses on approximating the…

Computational Finance · Quantitative Finance 2015-09-04 Robert B. Gramacy , Mike Ludkovski

We analyze the Snell envelope with path dependent multiplicative optimality criteria. Especially for this case, we propose a variation of the Snell envelope backward recursion which allows to extend some classical approxima- tion schemes to…

Numerical Analysis · Mathematics 2010-08-19 Pierre Del Moral , Peng Hu , Nadia Oudjane

Classical entropy regularization is poorly suited to continuous-time martingale transport, since relative entropy between diffusion laws typically forces their volatility characteristics to coincide. We introduce a specific-entropy…

Probability · Mathematics 2026-05-22 Francois Buet-Golfouse , Anaïs Després , Zhenjie Ren , Xin Zhang

In this paper we establish the convergence of a numerical scheme based, on the Finite Element Method, for a time-independent problem modelling the deformation of a linearly elastic elliptic membrane shell subjected to remaining confined in…

Analysis of PDEs · Mathematics 2023-10-25 Aaron Meixner , Paolo Piersanti

Let $G$ be a semimartingale, and $S$ its Snell envelope. Under the assumption that $G\in\mathcal{H}^1$, we show that the finite-variation part of $S$ is absolutely continuous with respect to the decreasing part of the finite-variation part…

Probability · Mathematics 2018-12-04 Saul D. Jacka , Dominykas Norgilas

Recent contributions have framed linear system identification as a nonparametric regularized inverse problem. Relying on $\ell_2$-type regularization which accounts for the stability and smoothness of the impulse response to be estimated,…

Systems and Control · Computer Science 2016-09-30 Giulia Prando , Gianluigi Pillonetto , Alessandro Chiuso

The standard implementation of the Maximum Entropy Method (MEM) follows Bryan and deploys a Singular Value Decomposition (SVD) to limit the dimensionality of the underlying solution space apriori. Here we present arguments based on the…

Computational Physics · Physics 2013-01-08 Alexander Rothkopf

In this paper, we consider a class of stochastic optimal control problems with risk constraints that are expressed as bounded probabilities of failure for particular initial states. We present here a martingale approach that diffuses a risk…

Systems and Control · Computer Science 2015-07-09 Vu Anh Huynh , Leonid Kogan , Emilio Frazzoli

This paper considers stochastic optimization problems with weakly convex objective and constraint functions. We propose Prox-PEP, a proximal method equipped with quadratic subproblems. To handle nonlinear equality constraints, we employ an…

Optimization and Control · Mathematics 2026-05-11 Lixin Tang , Xingyu Wang , Liwei Zhang

Stochastic Optimal Control provides a unified mathematical framework for solving complex decision-making problems, encompassing paradigms such as maximum entropy reinforcement learning(RL) and imitation learning(IL). However, conventional…

Machine Learning · Computer Science 2026-02-23 Hang Liu , Sangli Teng , Maani Ghaffari

We study the problem of optimal portfolio selection under stochastic volatility within a continuous time reinforcement learning framework with portfolio constraints. Exploration is modeled through entropy-regularized relaxed controls, where…

Mathematical Finance · Quantitative Finance 2026-04-27 Thai Nguyen , Pertiny Nkuize

As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a stochastic maximal inequality derived by using the Taylor expansion, is…

Probability · Mathematics 2020-08-03 Yoichi Nishiyama

We propose a method to derive the stationary size distributions of a system, and the degree distributions of networks, using maximisation of the Gibbs-Shannon entropy. We apply this to a preferential attachment-type algorithm for systems of…

Physics and Society · Physics 2020-03-17 Cornelia Metzig , Caroline Colijn