English
Related papers

Related papers: The augmented van Trees inequality

200 papers

We study nonparametric estimation of the diffusion coefficient from discrete data, when the observations are blurred by additional noise. Such issues have been developed over the last 10 years in several application fields and in particular…

Statistics Theory · Mathematics 2011-12-30 Marc Hoffmann , Axel Munk , Johannes Schmidt-Hieber

We analyse the convergence of an approximate, fully inexact, ADMM algorithm under additive, deterministic and probabilistic error models. We consider the generalized ADMM scheme that is derived from generalized Lagrangian penalty with…

Optimization and Control · Mathematics 2022-10-06 Anis Hamadouche , Yun Wu , Andrew M. Wallace , Joao F. C. Mota

If uncorrelated random variables have a common expected value and decreasing variances then the variance of a sample mean is decreasing with the number of observations. Unfortunately, this natural and desirable Variance Reduction Property…

Statistics Theory · Mathematics 2013-04-11 Andrzej S. Kozek , Brian Jersky

We establish higher-order nonasymptotic expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean…

Statistics Theory · Mathematics 2022-11-30 Mayya Zhilova

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

For statistical decision problems with finite parameter space, it is well-known that the upper value (minimax value) agrees with the lower value (maximin value). Only under a generalized notion of prior does such an equivalence carry over…

Statistics Theory · Mathematics 2022-12-27 Haosui Duanmu , Daniel M. Roy , David Schrittesser

The use of cumulative incidence functions for characterizing the risk of one type of event in the presence of others has become increasingly popular over the past decade. The problems of modeling, estimation and inference have been treated…

Methodology · Statistics 2020-11-16 Youngjoo Cho , Annette M. Molinaro , Chen Hu , Robert L. Strawderman

The approximation of probability measures on compact metric spaces and in particular on Riemannian manifoldsby atomic or empirical ones is a classical task in approximation and complexity theory with a wide range of applications. Instead of…

Optimization and Control · Mathematics 2021-01-12 Martin Ehler , Manuel Gräf , Sebastian Neumayer , Gabriele Steidl

In a recent paper, Gaunt 2020 extended Stein's method to limit distributions that can be represented as a function $g:\mathbb{R}^d\rightarrow\mathbb{R}$ of a centered multivariate normal random vector $\Sigma^{1/2}\mathbf{Z}$ with…

Probability · Mathematics 2022-09-21 Robert E. Gaunt , Heather Sutcliffe

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

Rerandomization systematically reduces chance imbalance and can improve the efficiency of the average treatment effect estimator in randomized experiments. While the asymptotic properties of finite-dimensional M-estimators under…

Methodology · Statistics 2026-04-28 Xinyuan Chen , Fan Li

We present new M-estimators of the mean and variance of real valued random variables, based on PAC-Bayes bounds. We analyze the non-asymptotic minimax properties of the deviations of those estimators for sample distributions having either a…

Statistics Theory · Mathematics 2011-08-15 Olivier Catoni

We revisit the classical dual ascent algorithm for minimization of convex functionals in the presence of linear constraints, and give convergence results which apply even for non-convex functionals. We describe limit points in terms of the…

Optimization and Control · Mathematics 2016-09-22 Fredrik Andersson , Marcus Carlsson , Carl Olsson

Vector autoregressive (VAR) models assume linearity between the endogenous variables and their lags. This assumption might be overly restrictive and could have a deleterious impact on forecasting accuracy. As a solution, we propose…

Econometrics · Economics 2021-03-10 Florian Huber , Luca Rossini

We propose methods to improve the forecasts from generalized autoregressive score (GAS) models (Creal et. al, 2013; Harvey, 2013) by localizing their parameters using decision trees and random forests. These methods avoid the curse of…

Econometrics · Economics 2023-05-31 Andrew J. Patton , Yasin Simsek

We give curvature-dependant convergence rates for the optimization of weakly convex functions defined on a manifold of 1-bounded geometry via Riemannian gradient descent and via the dynamic trivialization algorithm. In order to do this, we…

Optimization and Control · Mathematics 2020-08-07 Mario Lezcano-Casado

Regression is fundamental in computer vision and is widely used in various tasks including age estimation, depth estimation, target localization, \etc However, real-world data often exhibits imbalanced distribution, making regression models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yahao Liu , Qin Wang , Lixin Duan , Wen Li

We study the unweighted Tree Augmentation Problem (TAP) via the Lasserre (Sum of Squares) system. We prove an approximation guarantee of ($1.8+\epsilon$) relative to an SDP relaxation, which matches the combinatorial approximation guarantee…

Data Structures and Algorithms · Computer Science 2016-04-05 Joe Cheriyan , Zhihan Gao

We introduce a modified version of the excess risk, which can be used to obtain tighter, fast-rate PAC-Bayesian generalisation bounds. This modified excess risk leverages information about the relative hardness of data examples to reduce…

Machine Learning · Computer Science 2023-01-25 Felix Biggs , Benjamin Guedj

We consider the minimization of composite objective functions composed of the expectation of quadratic functions and an arbitrary convex function. We study the stochastic dual averaging algorithm with a constant step-size, showing that it…

Optimization and Control · Mathematics 2017-02-22 Nicolas Flammarion , Francis Bach