English
Related papers

Related papers: Fast learning rates for plug-in classifiers under …

200 papers

It has been recently shown that, under the margin (or low noise) assumption, there exist classifiers attaining fast rates of convergence of the excess Bayes risk, that is, rates faster than $n^{-1/2}$. The work on this subject has suggested…

Statistics Theory · Mathematics 2009-09-29 Jean-Yves Audibert , Alexandre B. Tsybakov

The recent success of neural networks in pattern recognition and classification problems suggests that neural networks possess qualities distinct from other more classical classifiers such as SVMs or boosting classifiers. This paper studies…

Machine Learning · Statistics 2023-09-27 Hyunouk Ko , Namjoon Suh , Xiaoming Huo

We prove new fast learning rates for the one-vs-all multiclass plug-in classifiers trained either from exponentially strongly mixing data or from data generated by a converging drifting distribution. These are two typical scenarios where…

Machine Learning · Statistics 2015-01-27 Vu Dinh , Lam Si Tung Ho , Nguyen Viet Cuong , Duy Nguyen , Binh T. Nguyen

We consider the classical problem of learning rates for classes with finite VC dimension. It is well known that fast learning rates up to $O\left(\frac{d}{n}\right)$ are achievable by the empirical risk minimization algorithm (ERM) if low…

Machine Learning · Computer Science 2020-10-27 Olivier Bousquet , Nikita Zhivotovskiy

We construct a classifier which attains the rate of convergence $\log n/n$ under sparsity and margin assumptions. An approach close to the one met in approximation theory for the estimation of function is used to obtain this result. The…

Statistics Theory · Mathematics 2016-08-16 Guillaume Lecué

We study the rates of convergence in generalization error achievable by active learning under various types of label noise. Additionally, we study the general problem of model selection for active learning with a nested hierarchy of…

Statistics Theory · Mathematics 2011-03-10 Steve Hanneke

We establish optimal convergence rates up to a log-factor for a class of deep neural networks in a classification setting under a restraint sometimes referred to as the Tsybakov noise condition. We construct classifiers in a general setting…

Statistics Theory · Mathematics 2022-07-26 Joseph T. Meyer

In the context of density level set estimation, we study the convergence of general plug-in methods under two main assumptions on the density for a given level $\lambda$. More precisely, it is assumed that the density (i) is smooth in a…

Statistics Theory · Mathematics 2016-09-07 Philippe Rigollet , Régis Vert

This article improves the existing proven rates of regret decay in optimal policy estimation. We give a margin-free result showing that the regret decay for estimating a within-class optimal policy is second-order for empirical risk…

Statistics Theory · Mathematics 2017-04-24 Alexander Luedtke , Antoine Chambaz

We consider the problem of binary classification with abstention in the relatively less studied \emph{bounded-rate} setting. We begin by obtaining a characterization of the Bayes optimal classifier for an arbitrary input-label distribution…

Machine Learning · Computer Science 2019-05-24 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

In the context of binary classification of trajectories generated by time-homogeneous stochastic differential equations, we consider a mixture of two diffusion processes characterized by a stochastic differential equation (SDE) whose drift…

Statistics Theory · Mathematics 2026-03-17 Eddy Michel Ella Mintsa

The study of minimax convergence rates for classification procedures adapted to SDE paths is rarely addressed in the literature. Only one paper established optimal convergence rates for a binary classifier for SDE paths constructed from the…

Statistics Theory · Mathematics 2026-03-10 Eddy Michel Ella-Mintsa

Incorporating side observations in decision making can reduce uncertainty and boost performance, but it also requires we tackle a potentially complex predictive relationship. While one may use off-the-shelf machine learning methods to…

Machine Learning · Statistics 2021-09-01 Yichun Hu , Nathan Kallus , Xiaojie Mao

We study classification problems using binary estimators where the decision boundary is described by horizon functions and where the data distribution satisfies a geometric margin condition. A key novelty of our work is the derivation of…

Machine Learning · Statistics 2026-03-16 Jonathan García , Philipp Petersen

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set $\mathcal{G}$ up to the smallest possible additive term, called the convergence rate. When the…

Statistics Theory · Mathematics 2009-09-09 Jean-Yves Audibert

We address the problem of classification when data are collected from two samples with measurement errors. This problem turns to be an inverse problem and requires a specific treatment. In this context, we investigate the minimax rates of…

Statistics Theory · Mathematics 2013-07-15 Sébastien Loustau , Clément Marteau

In this article, we study rates of convergence of the generalization error of multi-class margin classifiers. In particular, we develop an upper bound theory quantifying the generalization error of various large margin classifiers. The…

Statistics Theory · Mathematics 2011-11-10 Xiaotong Shen , Lifeng Wang

We study the behavior of error bounds for multiclass classification under suitable margin conditions. For a wide variety of methods we prove that the classification error under a hard-margin condition decreases exponentially fast without…

Machine Learning · Statistics 2022-02-04 Stefano Vigogna , Giacomo Meanti , Ernesto De Vito , Lorenzo Rosasco

We consider classification in the presence of class-dependent asymmetric label noise with unknown noise probabilities. In this setting, identifiability conditions are known, but additional assumptions were shown to be required for finite…

Machine Learning · Computer Science 2019-06-12 Henry W. J. Reeve , Ata Kaban
‹ Prev 1 2 3 10 Next ›