English
Related papers

Related papers: Optimal rates of aggregation in classification und…

200 papers

We introduce a detailed analysis of the convergence of first-order methods with composite noise (sum of relative and absolute) in gradient for convex and smooth function minimization. This paper illustrates instances of practical problems…

Optimization and Control · Mathematics 2026-03-16 Artem Vasin , Alexander Gasnikov

Risk aggregation is a popular method used to estimate the sum of a collection of financial assets or events, where each asset or event is modelled as a random variable. Applications, in the financial services industry, include insurance,…

Artificial Intelligence · Computer Science 2015-06-04 Peng Lin

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij

We consider the problem of adaptation to the margin in binary classification. We suggest a penalized empirical risk minimization classifier that adaptively attains, up to a logarithmic factor, fast optimal rates of convergence for the…

Statistics Theory · Mathematics 2007-06-13 A. B. Tsybakov , S. A. van de Geer

Given a dictionary of $M_n$ initial estimates of the unknown true regression function, we aim to construct linearly aggregated estimators that target the best performance among all the linear combinations under a sparse $q$-norm ($0 \leq q…

Statistics Theory · Mathematics 2012-01-16 Zhan Wang , Sandra Paterlini , Frank Gao , Yuhong Yang

In this paper, we study the accuracy of values aggregated over classes predicted by a classification algorithm. The problem is that the resulting aggregates (e.g., sums of a variable) are known to be biased. The bias can be large even for…

Machine Learning · Statistics 2019-12-02 Q. A. Meertens , C. G. H. Diks , H. J. van den Herik , F W Takes

We study the problem of aggregation under the squared loss in the model of regression with deterministic design. We obtain sharp PAC-Bayesian risk bounds for aggregates defined via exponential weights, under general assumptions on the…

Statistics Theory · Mathematics 2013-03-25 Arnak Dalalyan , Alexandre Tsybakov

This paper explores a class of empirical Bayes methods for level-dependent threshold selection in wavelet shrinkage. The prior considered for each wavelet coefficient is a mixture of an atom of probability at zero and a heavy-tailed…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

In the pivotal variable selection problem, we derive the exact non-asymptotic minimax selector over the class of all $s$-sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in…

Statistics Theory · Mathematics 2022-01-03 Cristina Butucea , Enno Mammen , Mohamed Ndaoud , Alexandre B. Tsybakov

We consider the problem of chance constrained optimization where it is sought to optimize a function and satisfy constraints, both of which are affected by uncertainties. The real world declinations of this problem are particularly…

Composite likelihood provides approximate inference when the full likelihood is intractable and sub-likelihood functions of marginal events can be evaluated relatively easily. It has been successfully applied for many complex models.…

Methodology · Statistics 2024-09-05 Wentao Li , Rosabeth White , Dennis Prangle

We consider the matrix completion problem under a form of row/column weighted entrywise sampling, including the case of uniform entrywise sampling as a special case. We analyze the associated random observation operator, and prove that with…

Information Theory · Computer Science 2011-05-17 Sahand Negahban , Martin J. Wainwright

We discuss the approach to estimate aggregation and adaptive estimation based upon (nearly optimal) testing of convex hypotheses. We show that in the situation where the observations stem from {\em simple observation schemes} and where set…

Statistics Theory · Mathematics 2021-07-19 Anatoli Juditsky , Arkadi Nemirovski

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

Methodology · Statistics 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

This paper considers a distributionally robust chance constraint model with a general ambiguity set. We show that a sample based approximation of this model converges under suitable sufficient conditions. We also show that upper and lower…

Optimization and Control · Mathematics 2025-01-17 Jiaqi Lei , Sanjay Mehrotra

Clustering is a pivotal challenge in unsupervised machine learning and is often investigated through the lens of mixture models. The optimal error rate for recovering cluster labels in Gaussian and sub-Gaussian mixture models involves ad…

Statistics Theory · Mathematics 2024-07-18 Maximilien Dreveton , Alperen Gözeten , Matthias Grossglauser , Patrick Thiran

In mixture model-based clustering applications, it is common to fit several models from a family and report clustering results from only the `best' one. In such circumstances, selection of this best model is achieved using a model selection…

Methodology · Statistics 2017-10-09 Yuhong Wei , Paul D. McNicholas

In this paper, we study the binary classification problem on $[0,1]^d$ under the Tsybakov noise condition (with exponent $s \in [0,\infty]$) and the compositional assumption. This assumption requires the conditional class probability…

Machine Learning · Statistics 2025-11-24 Zihan Zhang , Lei Shi , Ding-Xuan Zhou

It is common in nonparametric estimation problems to impose a certain low-dimensional structure on the unknown parameter to avoid the curse of dimensionality. This paper considers a nonparametric distribution estimation problem with a…

Statistics Theory · Mathematics 2025-02-28 Jeyong Lee , Hyeok Kyu Kwon , Minwoo Chae

Sensing and aggregation of noisy observations should not be considered as separate issues. The quality of collective estimation involves a difficult tradeoff between sensing quality which increases by increasing the number of sensors, and…

Information Theory · Computer Science 2011-02-16 Tatsuto Murayama , Peter Davis