English
Related papers

Related papers: Optimality of Maximum Likelihood for Log-Concave D…

200 papers

In this paper we generalize the estimation-control duality that exists in the linear-quadratic-Gaussian setting. We extend this duality to maximum a posteriori estimation of the system's state, where the measurement and dynamical system…

Optimization and Control · Mathematics 2016-07-12 Robert Bassett , Michael Casey , Roger J-B Wets

We propose a new discretization of the mirror-Langevin diffusion and give a crisp proof of its convergence. Our analysis uses relative convexity/smoothness and self-concordance, ideas which originated in convex optimization, together with a…

Statistics Theory · Mathematics 2021-10-26 Kwangjun Ahn , Sinho Chewi

Statistical inference based on optimal transport offers a different perspective from that of maximum likelihood, and has increasingly gained attention in recent years. In this paper, we study univariate nonparametric shape-constrained…

Statistics Theory · Mathematics 2026-04-13 Takeru Matsuda , Ting-Kam Leonard Wong

Worst-case bounds on the expected shortfall risk given only limited information on the distribution of the random variables has been studied extensively in the literature. In this paper, we develop a new worst-case bound on the expected…

Risk Management · Quantitative Finance 2017-02-12 Anulekha Dhara , Bikramjit Das , Karthik Natarajan

This paper studies distributionally robust optimization for a rich class of risk measures with ambiguity sets defined by $\phi$-divergences. The risk measures are allowed to be non-linear in probabilities, are represented by Choquet…

Optimization and Control · Mathematics 2025-04-15 Guanyu Jin , Roger J. A. Laeven , Dick den Hertog

We establish two-sided bounds for expectations of order statistics ($k$-th maxima) of moduli of coordinates of centered log-concave random vectors with uncorrelated coordinates. Our bounds are exact up to multiplicative universal constants…

Probability · Mathematics 2020-10-27 Rafał Latała , Marta Strzelecka

We investigate the equilibrium behavior for the decentralized cheap talk problem for real random variables and quadratic cost criteria in which an encoder and a decoder have misaligned objective functions. In prior work, it has been shown…

Information Theory · Computer Science 2021-11-16 Ertan Kazıklı , Serkan Sarıtaş , Sinan Gezici , Tamás Linder , Serdar Yüksel

We consider the problem of optimizing an approximately convex function over a bounded convex set in $\mathbb{R}^n$ using only function evaluations. The problem is reduced to sampling from an \emph{approximately} log-concave distribution…

Numerical Analysis · Computer Science 2020-07-27 Alexandre Belloni , Tengyuan Liang , Hariharan Narayanan , Alexander Rakhlin

Convex sample approximations of chance-constrained optimization problems are considered, in which chance constraints are replaced by sets of sampled constraints. We propose a randomized sample selection strategy that allows tight bounds to…

Optimization and Control · Mathematics 2018-05-22 Mark Cannon

We study the dimensional Brunn-Minkowski inequality for even log-concave probability measures $\mu$ on $\mathbb{R}^n$ via an analytic approach based on diffusion operators and gradient estimates. Our main result asserts that for every pair…

Metric Geometry · Mathematics 2026-05-05 Alexandros Eskenazis , Apostolos Giannopoulos , Natalia Tziotziou

In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our…

Computation · Statistics 2024-06-11 O. Deniz Akyildiz , Michela Ottobre , Iain Souttar

This manuscript studies statistical properties of linear classifiers obtained through minimization of an unregularized convex risk over a finite sample. Although the results are explicitly finite-dimensional, inputs may be passed through…

Machine Learning · Computer Science 2012-06-15 Matus Telgarsky

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

Given i.i.d. observations of a random vector $X \in \mathbb{R}^p$, we study the problem of estimating both its covariance matrix $\Sigma^*$, and its inverse covariance or concentration matrix {$\Theta^* = (\Sigma^*)^{-1}$.} We estimate…

Machine Learning · Statistics 2008-11-24 Pradeep Ravikumar , Martin J. Wainwright , Garvesh Raskutti , Bin Yu

We consider the problem of robust mean and location estimation w.r.t. any pseudo-norm of the form $x\in\mathbb{R}^d\to ||x||_S = \sup_{v\in S}<v,x>$ where $S$ is any symmetric subset of $\mathbb{R}^d$. We show that the deviation-optimal…

Statistics Theory · Mathematics 2021-02-02 Jules Depersin , Guillaume Lecué

In this article we consider sampling from log concave distributions in Hamiltonian setting, without assuming that the objective gradient is globally Lipschitz. We propose two algorithms based on monotone polygonal (tamed) Euler schemes, to…

Probability · Mathematics 2023-01-20 Tim Johnston , Iosif Lytras , Sotirios Sabanis

Deep neural network is a state-of-art method in modern science and technology. Much statistical literature have been devoted to understanding its performance in nonparametric estimation, whereas the results are suboptimal due to a redundant…

Machine Learning · Computer Science 2021-08-18 Ruiqi Liu , Ben Boukai , Zuofeng Shang

In this paper we develop tools for studying limit theorems by means of convexity. We establish bounds for the discrepancy in total variation between probability measures $\mu$ and $\nu$ such that $\nu$ is log-concave with respect to $\mu$.…

Probability · Mathematics 2022-10-24 Arturo Jaramillo , James Melbourne

We present a framework for the theoretical analysis of ensembles of low-complexity empirical risk minimisers trained on independent random compressions of high-dimensional data. First we introduce a general distribution-dependent…

Machine Learning · Computer Science 2021-06-03 Henry W. J. Reeve , Ata Kaban

We study and develop multilevel methods for the numerical approximation of a log-concave probability $\pi$ on $\mathbb{R}^d$, based on (over-damped) Langevin diffusion. In the continuity of \cite{art:egeapanloup2021multilevel} concentrated…

Numerical Analysis · Mathematics 2023-01-24 Maxime Egéa