English
Related papers

Related papers: Near-Optimal Bounds for Learning Gaussian Halfspac…

200 papers

We study the problem of learning Bayesian networks where an $\epsilon$-fraction of the samples are adversarially corrupted. We focus on the fully-observable case where the underlying graph structure is known. In this work, we present the…

Machine Learning · Computer Science 2021-05-13 Yu Cheng , Honghao Lin

Agnostic learning of Boolean halfspaces is a fundamental problem in computational learning theory, but it is known to be computationally hard even for weak learning. Recent work [CKKMK24] proposed smoothed analysis as a way to bypass such…

Machine Learning · Computer Science 2025-11-25 Yiwen Kou , Raghu Meka

The complexity of learning a concept class under Gaussian marginals in the difficult agnostic model is closely related to its $L_1$-approximability by low-degree polynomials. For any concept class with Gaussian surface area at most…

Machine Learning · Computer Science 2026-03-09 Lucas Pesenti , Lucas Slot , Manuel Wiedmer

We study the complexity of learning real-valued Multi-Index Models (MIMs) under the Gaussian distribution. A $K$-MIM is a function $f:\mathbb{R}^d\to \mathbb{R}$ that depends only on the projection of its input onto a $K$-dimensional…

Machine Learning · Computer Science 2025-05-28 Ilias Diakonikolas , Giannis Iakovidis , Daniel M. Kane , Lisheng Ren

We study the task of testable learning of general -- not necessarily homogeneous -- halfspaces with adversarial label noise with respect to the Gaussian distribution. In the testable learning framework, the goal is to develop a…

Machine Learning · Computer Science 2024-09-02 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Nikos Zarifis

We study the problem of estimating the mean of an identity covariance Gaussian in the truncated setting, in the regime when the truncation set comes from a low-complexity family $\mathcal{C}$ of sets. Specifically, for a fixed but unknown…

Data Structures and Algorithms · Computer Science 2024-03-05 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

We investigate Learning from Label Proportions (LLP), a partial information setting where examples in a training set are grouped into bags, and only aggregate label values in each bag are available. Despite the partial observability, the…

Machine Learning · Computer Science 2025-06-02 Robert Busa-Fekete , Travis Dick , Claudio Gentile , Haim Kaplan , Tomer Koren , Uri Stemmer

We pose a fundamental question in computational learning theory: can we efficiently test whether a training set satisfies the assumptions of a given noise model? This question has remained unaddressed despite decades of research on learning…

Machine Learning · Computer Science 2026-05-11 Surbhi Goel , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We study active learning of homogeneous $s$-sparse halfspaces in $\mathbb{R}^d$ under the setting where the unlabeled data distribution is isotropic log-concave and each label is flipped with probability at most $\eta$ for a parameter $\eta…

Machine Learning · Computer Science 2021-08-16 Chicheng Zhang , Jie Shen , Pranjal Awasthi

The population recovery problem is a basic problem in noisy unsupervised learning that has attracted significant research attention in recent years [WY12,DRWY12, MS13, BIMP13, LZ15,DST16]. A number of different variants of this problem have…

Data Structures and Algorithms · Computer Science 2017-03-07 Anindya De , Ryan O'Donnell , Rocco Servedio

Using quantum algorithms, we obtain, for accuracy $\epsilon>0$ and confidence $1-\delta,0<\delta<1,$ a new sample complexity upper bound of $O((\mbox{log}(\frac{1}{\delta}))/\epsilon)$ as $\epsilon,\delta\rightarrow 0$ for a general…

Quantum Physics · Physics 2024-04-22 Daniel Z. Zanger

A single-index model (SIM) is a function of the form $\sigma(\mathbf{w}^{\ast} \cdot \mathbf{x})$, where $\sigma: \mathbb{R} \to \mathbb{R}$ is a known link function and $\mathbf{w}^{\ast}$ is a hidden unit vector. We study the task of…

Machine Learning · Computer Science 2024-11-11 Puqian Wang , Nikos Zarifis , Ilias Diakonikolas , Jelena Diakonikolas

We study the complexity of PAC learning halfspaces in the presence of Massart noise. In this problem, we are given i.i.d. labeled examples $(\mathbf{x}, y) \in \mathbb{R}^N \times \{ \pm 1\}$, where the distribution of $\mathbf{x}$ is…

Machine Learning · Computer Science 2022-07-29 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi , Lisheng Ren

We study high-dimensional asymptotic performance limits of binary supervised classification problems where the class conditional densities are Gaussian with unknown means and covariances and the number of signal dimensions scales faster…

Machine Learning · Statistics 2016-11-17 Mohammad Hossein Rohban , Prakash Ishwar , Birant Orten , William C. Karl , Venkatesh Saligrama

Identification of a linear time-invariant dynamical system from partial observations is a fundamental problem in control theory. Particularly challenging are systems exhibiting long-term memory. A natural question is how learn such systems…

Machine Learning · Computer Science 2022-03-08 Holden Lee

We show strong (and surprisingly simple) lower bounds for weakly learning intersections of halfspaces in the improper setting. Strikingly little is known about this problem. For instance, it is not even known if there is a polynomial-time…

Computational Complexity · Computer Science 2026-05-06 Stefan Tiegel

We revisit the problem of distribution learning within the framework of learning-augmented algorithms. In this setting, we explore the scenario where a probability distribution is provided as potentially inaccurate advice on the true,…

Machine Learning · Computer Science 2025-02-03 Arnab Bhattacharyya , Davin Choo , Philips George John , Themis Gouleakis

Many popular learning algorithms (E.g. Regression, Fourier-Transform based algorithms, Kernel SVM and Kernel ridge regression) operate by reducing the problem to a convex optimization problem over a vector space of functions. These methods…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

We study learning in a noisy bisection model: specifically, Bayesian algorithms to learn a target value V given access only to noisy realizations of whether V is less than or greater than a threshold theta. At step t = 0, 1, 2, ..., the…

Machine Learning · Computer Science 2012-02-20 Mithun Chakraborty , Sanmay Das , Malik Magdon-Ismail

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

Machine Learning · Computer Science 2025-02-18 Jie Shen