中文
相关论文

相关论文: Anti-concentration and honest, adaptive confidence…

200 篇论文

This paper investigates the approximation of Gaussian random variables in Banach spaces, focusing on the high-probability bounds for the approximation of Gaussian random variables using finitely many observations. We derive non-asymptotic…

统计理论 · 数学 2025-08-28 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

In this work, we describe a generic approach to show convergence with high probability for both stochastic convex and non-convex optimization with sub-Gaussian noise. In previous works for convex optimization, either the convergence is only…

最优化与控制 · 数学 2023-03-01 Zijian Liu , Ta Duy Nguyen , Thien Hang Nguyen , Alina Ene , Huy Lê Nguyen

Gaussian distributions are widely used in Bayesian variational inference to approximate intractable posterior densities, but the ability to accommodate skewness can improve approximation accuracy significantly, when data or prior…

统计方法学 · 统计学 2025-02-05 Linda S. L. Tan , Aoxiang Chen

Consider the sequential optimization of an expensive to evaluate and possibly non-convex objective function $f$ from noisy feedback, that can be considered as a continuum-armed bandit problem. Upper bounds on the regret performance of…

机器学习 · 统计学 2021-03-11 Sattar Vakili , Kia Khezeli , Victor Picheny

Given a sample from some unknown continuous density $f:\mathbb{R}\to\mathbb{R}$, we construct adaptive confidence bands that are honest for all densities in a "generic" subset of the union of $t$-H\"older balls, $0<t\le r$, where $r$ is a…

统计理论 · 数学 2010-02-26 Evarist Giné , Richard Nickl

We introduce a procedure for conditional density estimation under logarithmic loss, which we call SMP (Sample Minmax Predictor). This estimator minimizes a new general excess risk bound for statistical learning. On standard examples, this…

统计理论 · 数学 2021-12-10 Jaouad Mourtada , Stéphane Gaïffas

We develop a novel procedure for constructing confidence bands for components of a sparse additive model. Our procedure is based on a new kernel-sieve hybrid estimator that combines two most popular nonparametric estimation methods in the…

机器学习 · 统计学 2018-02-14 Junwei Lu , Mladen Kolar , Han Liu

This paper studies quasi Bayesian estimation and uncertainty quantification for an unknown function that is identified by a nonparametric conditional moment restriction. We derive contraction rates for a class of Gaussian process priors.…

计量经济学 · 经济学 2023-11-08 Sid Kankanala

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are batch methods designed mainly based on the convex optimization, say, the…

机器学习 · 统计学 2018-02-01 Ke Ma , Jinshan Zeng , Jiechao Xiong , Qianqian Xu , Xiaochun Cao , Wei Liu , Yuan Yao

Considering a general framework of bootstrap with exchangeable weights, we show some concentration inequalities for the supremum of the bootstrap empirical process. On the one hand, we discuss the concentration of the bootstrap empirical…

统计理论 · 数学 2026-04-06 Guillaume Maillard , Adrien Saumard

Recently, robust transmit beamforming has drawn considerable attention because it can provide guaranteed receiver performance in the presence of channel state information (CSI) errors. Assuming complex Gaussian distributed CSI errors, this…

信息论 · 计算机科学 2010-11-11 Kun-Yu Wang , Tsung-Hui Chang , Wing-Kin Ma , Anthony Man-Cho So , Chong-Yung Chi

We consider the problem of adaptive estimation of the regression function in a framework where we replace ergodicity assumptions (such as independence or mixing) by another structural assumption on the model. Namely, we propose adaptive…

统计理论 · 数学 2010-11-03 Sylvain Delattre , Stéphane Gaïffas

With the ubiquitous availability of unstructured data, growing attention is paid as how to adjust for selection bias in such non-probability samples. The majority of the robust estimators proposed by prior literature are either fully or…

统计方法学 · 统计学 2022-04-08 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

Non-conforming numerical approximations offer increased flexibility for applications that require high resolution in a localized area of the computational domain or near complex geometries. Two key properties for non-conforming methods to…

This paper studies the interpretability of neural network features from a Bayesian Gaussian view, where optimizing a cost is reaching a probabilistic bound; learning a model approximates a density that makes the bound tight and the cost…

机器学习 · 计算机科学 2025-11-18 Bo Hu , Jose C. Principe

We establish fundamental limits on estimation accuracy for the noisy 20 questions problem with measurement-dependent noise and introduce optimal non-adaptive procedures that achieve these limits. The minimal achievable resolution is defined…

信息论 · 计算机科学 2021-01-12 Lin Zhou , Alfred Hero

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

机器学习 · 计算机科学 2025-12-05 Junyi Liu , Stanley Kok

The goal of standard 1-bit compressive sensing is to accurately recover an unknown sparse vector from binary-valued measurements, each indicating the sign of a linear function of the vector. Motivated by recent advances in compressive…

机器学习 · 统计学 2020-06-23 Zhaoqiang Liu , Selwyn Gomes , Avtansh Tiwari , Jonathan Scarlett

We consider Bayesian nonparametric density estimation using a Pitman-Yor or a normalized inverse-Gaussian process kernel mixture as the prior distribution for a density. The procedure is studied from a frequentist perspective. Using the…

统计理论 · 数学 2013-02-15 Catia Scricciolo

Motivated by the construction of tractable robust estimators via convex relaxations, we present conditions on the sample size which guarantee an augmented notion of Restricted Eigenvalue-type condition for Gaussian designs. Such a notion is…

统计理论 · 数学 2018-12-04 Philip Thompson , Arnak S. Dalalyan