English
Related papers

Related papers: Martingale Methods for Sequential Estimation of Co…

200 papers

The diffeomorphic registration framework enables to define an optimal matching function between two probability measures with respect to a data-fidelity loss function. The non convexity of the optimization problem renders the choice of this…

Statistics Theory · Mathematics 2022-11-24 Lucas de Lara , Alberto González-Sanz , Jean-Michel Loubes

We introduce a novel kernel-based framework for learning differential equations and their solution maps that is efficient in data requirements, in terms of solution examples and amount of measurements from each example, and computational…

Machine Learning · Statistics 2025-04-07 Yasamin Jalalian , Juan Felipe Osorio Ramirez , Alexander Hsu , Bamdad Hosseini , Houman Owhadi

Many machine learning problems can be framed in the context of estimating functions, and often these are time-dependent functions that are estimated in real-time as observations arrive. Gaussian processes (GPs) are an attractive choice for…

Machine Learning · Statistics 2023-05-09 Michael Minyi Zhang , Bianca Dumitrascu , Sinead A. Williamson , Barbara E. Engelhardt

Coupling arguments are a central tool for bounding the deviation between two stochastic processes, but traditionally have been limited to Wasserstein metrics. In this paper, we apply the shifted composition rule--an information-theoretic…

Statistics Theory · Mathematics 2024-12-25 Jason M. Altschuler , Sinho Chewi

Variational inference has become an increasingly attractive fast alternative to Markov chain Monte Carlo methods for approximate Bayesian inference. However, a major obstacle to the widespread use of variational methods is the lack of…

Machine Learning · Statistics 2020-03-03 Jonathan H. Huggins , Mikołaj Kasprzak , Trevor Campbell , Tamara Broderick

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, it seems to be a considerable restriction when the potentials are often required to be smooth (gradient Lipschitz). This paper…

Computation · Statistics 2022-02-23 Dao Nguyen

In this paper, we compare the performance of two methods for estimating Bayesian networks from data containing exogenous variables and random effects. The first method is fully Bayesian in which a prior distribution is placed on the…

Methodology · Statistics 2011-12-02 Jessica Kasza , Patty Solomon

We introduce scalable algorithms for online learning of neural network parameters and Bayesian sequential decision making. Unlike classical Bayesian neural networks, which induce predictive uncertainty through a posterior over model…

Machine Learning · Computer Science 2025-10-10 Gerardo Duran-Martin , Leandro Sánchez-Betancourt , Álvaro Cartea , Kevin Murphy

We present a distribution optimization framework that significantly improves confidence bounds for various risk measures compared to previous methods. Our framework encompasses popular risk measures such as the entropic risk measure,…

Machine Learning · Computer Science 2023-06-13 Hao Liang , Zhi-quan Luo

This paper presents a new approach for assessing uncertainty in machine translation by simultaneously evaluating translation quality and providing a reliable confidence score. Our approach utilizes conformal predictive distributions to…

Computation and Language · Computer Science 2023-06-05 Patrizio Giovannotti

Limit distributions for the greatest convex minorant and its derivative are considered for a general class of stochastic processes including partial sum processes and empirical processes, for independent, weakly dependent and long range…

Statistics Theory · Mathematics 2016-08-16 D. Anevski , O. Hössjer

With a view on bilevel and PDE-constrained optimisation, we develop iterative estimates $\widetilde{F'}(x^k)$ of $F'(x^k)$ for composite functions $F :=J \circ S$, where $S$ is the solution mapping of the inner optimisation problem or PDE.…

Optimization and Control · Mathematics 2026-04-02 Neil Dizon , Tuomo Valkonen

Spaces of convex and concave functions appear naturally in theory and applications. For example, convex regression and log-concave density estimation are important topics in nonparametric statistics. In stochastic portfolio theory, concave…

Probability · Mathematics 2021-05-25 Peter Baxendale , Ting-Kam Leonard Wong

Accelerated algorithms for maximum likelihood image reconstruction are essential for emerging applications such as 3D tomography, dynamic tomographic imaging, and other high dimensional inverse problems. In this paper, we introduce and…

Computation · Statistics 2012-01-31 Stéphane Chrétien , Alfred O. Hero

The nested distance builds on the Wasserstein distance to quantify the difference of stochastic processes, including also the information modelled by filtrations. The Sinkhorn divergence is a relaxation of the Wasserstein distance, which…

Optimization and Control · Mathematics 2021-02-11 Alois Pichler , Michael Weinhardt

We present an algorithm to approximate the solutions to variational problems where set of admissible functions consists of convex functions. The main motivator behind this numerical method is estimating solutions to Adverse Selection…

Optimization and Control · Mathematics 2008-03-07 Ivar Ekeland , Santiago Moreno

This paper studies the estimation of low-rank Markov chains from empirical trajectories. We propose a non-convex estimator based on rank-constrained likelihood maximization. Statistical upper bounds are provided for the Kullback-Leiber…

Machine Learning · Statistics 2018-07-20 Xudong Li , Mengdi Wang , Anru Zhang

We present a unified framework for solving trajectory optimization problems in a derivative-free manner through the use of sequential convex programming. Traditionally, nonconvex optimization problems are solved by forming and solving a…

Optimization and Control · Mathematics 2025-10-01 Kevin Tracy , John Z. Zhang , Jon Arrizabalaga , Stefan Schaal , Yuval Tassa , Tom Erez , Zachary Manchester

This work explores the use of a forward-backward martingale method together with a decoupling argument and entropic estimates between the conditional and averaged measures to prove a strong averaging principle for stochastic differential…

Probability · Mathematics 2017-09-18 Bob Pepin