English
Related papers

Related papers: Robust oracle estimation and uncertainty quantific…

200 papers

The explicit regularization and optimality of deep neural networks estimators from independent data have made considerable progress recently. The study of such properties on dependent data is still a challenge. In this paper, we carry out…

Machine Learning · Statistics 2025-07-09 William Kengne , Modou Wade

We consider a finite mixture of Gaussian regression model for high- dimensional data, where the number of covariates may be much larger than the sample size. We propose to estimate the unknown conditional mixture density by a maximum…

Statistics Theory · Mathematics 2014-09-05 Emilie Devijver

In this paper we consider regression problems subject to arbitrary noise in the operator or design matrix. This characterization appropriately models many physical phenomena with uncertainty in the regressors. Although the problem has been…

Computation · Statistics 2021-04-08 Richard J Clancy , Stephen Becker

We consider the nonparametric regression and the classification problems for $\psi$-weakly dependent processes. This weak dependence structure is more general than conditions such as, mixing, association, $\ldots$. A penalized estimation…

Machine Learning · Statistics 2023-03-03 William Kengne , Modou Wade

The problem of monotone submodular maximization has been studied extensively due to its wide range of applications. However, there are cases where one can only access the objective function in a distorted or noisy form because of the…

Data Structures and Algorithms · Computer Science 2022-10-24 Lingxiao Huang , Yuyi Wang , Chunxue Yang , Huanjian Zhou

Models defined by moment conditions are at the center of structural econometric estimation, but economic theory is mostly agnostic about moment selection. While a large pool of valid moments can potentially improve estimation efficiency, in…

Econometrics · Economics 2023-11-15 Jinyuan Chang , Zhentao Shi , Jia Zhang

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena

Folded concave penalization methods have been shown to enjoy the strong oracle property for high-dimensional sparse estimation. However, a folded concave penalization problem usually has multiple local solutions and the oracle property is…

Statistics Theory · Mathematics 2015-04-03 Jianqing Fan , Lingzhou Xue , Hui Zou

Noisy pairwise comparison feedback has been incorporated to improve the overall query complexity of interactively learning binary classifiers. The \textit{positivity comparison oracle} is used to provide feedback on which is more likely to…

Machine Learning · Computer Science 2020-10-29 Zhenghang Cui , Issei Sato

We study contextual linear bandit problems under feature uncertainty, where the features are noisy and have missing entries. To address the challenges posed by this noise, we analyze Bayesian oracles given the observed noisy features. Our…

Artificial Intelligence · Computer Science 2024-10-11 Jung-hun Kim , Se-Young Yun , Minchan Jeong , Jun Hyun Nam , Jinwoo Shin , Richard Combes

Consider a regression model with fixed design and Gaussian noise where the regression function can potentially be well approximated by a function that admits a sparse representation in a given dictionary. This paper resorts to exponential…

Statistics Theory · Mathematics 2013-01-08 Philippe Rigollet , Alexandre B. Tsybakov

Quantum machine learning models have the potential to offer speedups and better predictive accuracy compared to their classical counterparts. However, these quantum algorithms, like their classical counterparts, have been shown to also be…

Quantum Physics · Physics 2021-05-27 Maurice Weber , Nana Liu , Bo Li , Ce Zhang , Zhikuan Zhao

The goal of this paper is to characterize the best achievable performance for the problem of estimating an unknown parameter having a sparse representation. Specifically, we consider the setting in which a sparsely representable…

Statistics Theory · Mathematics 2009-09-29 Zvika Ben-Haim , Yonina C. Eldar

An adaptive nonparametric estimation procedure is constructed for heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (oracle inequality) is obtained

Statistics Theory · Mathematics 2010-02-09 Leonid Galtchouk , Serguei Pergamenchtchikov

Flexible estimation of heterogeneous treatment effects lies at the heart of many statistical challenges, such as personalized medicine and optimal resource allocation. In this paper, we develop a general class of two-step algorithms for…

Machine Learning · Statistics 2020-08-07 Xinkun Nie , Stefan Wager

In this work, we consider a class of linear ill-posed problems with operators that map from the sequence space $ \ell_r $ ($r \ge 1$) into a Banach space and in addition satisfy a conditional stability estimate in the scale of sequence…

Numerical Analysis · Mathematics 2025-10-21 Robert Plato , Bernd Hofmann

We study the problem of estimating the one-point specification probabilities in non-necessary finite discrete random fields from partially observed independent samples. Our procedures are based on model selection by minimization of a…

Statistics Theory · Mathematics 2016-01-18 Matthieu Lerasle , Daniel Y. Takahashi

Penalized least squares estimation is a popular technique in high-dimensional statistics. It includes such methods as the LASSO, the group LASSO, and the nuclear norm penalized least squares. The existing theory of these methods is not…

Statistics Theory · Mathematics 2017-07-10 Pierre C. Bellec , Guillaume Lecué , Alexandre B. Tsybakov

We establish theoretical guarantees for the expected prediction error of the exponential weighting aggregate in the case of multivariate regression that is when the label vector is multidimensional. We consider the regression model with…

Statistics Theory · Mathematics 2018-06-26 Arnak S. Dalalyan

While variable selection has received extensive attention in the literature, its exploration in the presence of response measurement error remains underexplored. In this paper, we investigate this important problem within the context of…

Methodology · Statistics 2026-03-17 Hui Guo , Grace Y. Yi , Boyu Wang