English
Related papers

Related papers: A Fully Polynomial-Time Algorithm for Robustly Lea…

200 papers

Semi-supervised learning aims to leverage a large amount of unlabeled data for performance boosting. Existing works primarily focus on image classification. In this paper, we delve into semi-supervised learning for object detection, where…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zhenyu Wang , Yali Li , Ye Guo , Shengjin Wang

We study the {\em robust proper learning} of univariate log-concave distributions (over continuous and discrete domains). Given a set of samples drawn from an unknown target distribution, we want to compute a log-concave hypothesis…

Data Structures and Algorithms · Computer Science 2016-06-10 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

In modern scientific applications, large volumes of covariate data are readily available, while outcome labels are costly, sparse, and often subject to distribution shift. This asymmetry has spurred interest in semi-supervised (SS)…

Statistics Theory · Mathematics 2026-05-12 Lorenzo Testa , Qi Xu , Jing Lei , Kathryn Roeder

Density modelling is the task of learning an unknown probability density function from samples, and is one of the central problems of unsupervised machine learning. In this work, we show that there exists a density modelling problem for…

Quantum Physics · Physics 2023-04-17 Niklas Pirnay , Ryan Sweke , Jens Eisert , Jean-Pierre Seifert

Model extraction attacks have renewed interest in the classic problem of learning neural networks from queries. In this work we give the first polynomial-time algorithm for learning arbitrary one hidden layer neural networks activations…

Machine Learning · Computer Science 2021-11-09 Sitan Chen , Adam R Klivans , Raghu Meka

We study the problem of learning halfspaces with Massart noise in the distribution-specific PAC model. We give the first computationally efficient algorithm for this problem with respect to a broad family of distributions, including…

Machine Learning · Computer Science 2020-02-14 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We study the complexity of smoothed agnostic learning, recently introduced by~\cite{CKKMS24}, in which the learner competes with the best classifier in a target class under slight Gaussian perturbations of the inputs. Specifically, we focus…

Machine Learning · Computer Science 2026-02-25 Ilias Diakonikolas , Daniel M. Kane

We present new differentially private algorithms for learning a large-margin halfspace. In contrast to previous algorithms, which are based on either differentially private simulations of the statistical query model or on private convex…

Machine Learning · Computer Science 2020-02-25 Huy L. Nguyen , Jonathan Ullman , Lydia Zakynthinou

This paper explores the challenges of PAC learning in semi-enclosed environments that face persistent disruptive noise and demonstrates the weaknesses of traditional learning models based on noise-free data. We present a novel algorithm…

Machine Learning · Computer Science 2024-11-05 Shirmohammad Tavangari , Zahra Shakarami , Aref Yelghi , Asef Yelghi

We resolve one of the major outstanding problems in robust statistics. In particular, if $X$ is an evenly weighted mixture of two arbitrary $d$-dimensional Gaussians, we devise a polynomial time algorithm that given access to samples from…

Data Structures and Algorithms · Computer Science 2020-07-14 Daniel M. Kane

The Forster transform is a method of regularizing a dataset by placing it in {\em radial isotropic position} while maintaining some of its essential properties. Forster transforms have played a key role in a diverse range of settings…

Data Structures and Algorithms · Computer Science 2022-12-07 Ilias Diakonikolas , Christos Tzamos , Daniel M. Kane

Reducing the amount of labels required to train convolutional neural networks without performance degradation is key to effectively reduce human annotation efforts. We propose Reliable Label Bootstrapping (ReLaB), an unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Paul Albert , Diego Ortego , Eric Arazo , Noel E. O'Connor , Kevin McGuinness

We study the problem of agnostically learning homogeneous halfspaces in the distribution-specific PAC model. For a broad family of structured distributions, including log-concave distributions, we show that non-convex SGD efficiently…

Machine Learning · Computer Science 2020-06-15 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

Mixtures of Gaussian (or normal) distributions arise in a variety of application areas. Many heuristics have been proposed for the task of finding the component Gaussians given samples from the mixture, such as the EM algorithm, a…

Probability · Mathematics 2007-05-23 Sanjeev Arora , Ravi Kannan

This article studies the achievable guarantees on the error rates of certain learning algorithms, with particular focus on refining logarithmic factors. Many of the results are based on a general technique for obtaining bounds on the error…

Machine Learning · Computer Science 2016-09-13 Steve Hanneke

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

Machine Learning · Computer Science 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox

Semi-supervised learning methods are motivated by the availability of large datasets with unlabeled features in addition to labeled data. Unlabeled data is, however, not guaranteed to improve classification performance and has in fact been…

Machine Learning · Statistics 2019-10-25 Xiuming Liu , Dave Zachariah , Johan Wågberg , Thomas B. Schön

Semi-supervised semantic segmentation requires the model to effectively propagate the label information from limited annotated images to unlabeled ones. A challenge for such a per-pixel prediction task is the large intra-class variation,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hai-Ming Xu , Lingqiao Liu , Qiuchen Bian , Zhen Yang

Label distribution learning can characterize the polysemy of an instance through label distributions. However, some noise and uncertainty may be introduced into the label space when processing label distribution data due to artificial or…

Machine Learning · Computer Science 2022-10-18 Qimeng Guo , Zhuoran Zheng , Xiuyi Jia , Liancheng Xu

We study the problem of computationally and label efficient PAC active learning $d$-dimensional halfspaces with Tsybakov Noise~\citep{tsybakov2004optimal} under structured unlabeled data distributions. Inspired…

Machine Learning · Computer Science 2024-07-23 Yinan Li , Chicheng Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›