English
Related papers

Related papers: Faster Algorithms for Agnostically Learning Disjun…

200 papers

Multi-distribution learning extends agnostic Probably Approximately Correct (PAC) learning to the setting in which a family of $k$ distributions, $\{D_i\}_{i\in[k]}$, is considered and a classifier's performance is measured by its error…

Machine Learning · Computer Science 2025-06-24 Chicheng Zhang , Yihan Zhou

The agnostic setting is the hardest generalization of the PAC model since it is akin to learning with adversarial noise. In this paper, we give a poly$(n,t,{\frac{1}{\varepsilon}})$ quantum algorithm for learning size $t$ decision trees…

Quantum Physics · Physics 2024-03-07 Sagnik Chatterjee , Tharrmashastha SAPV , Debajyoti Bera

We continue the study of doubly-efficient proof systems for verifying agnostic PAC learning, for which we obtain the following results. - We construct an interactive protocol for learning the $t$ largest Fourier characters of a given…

Computational Complexity · Computer Science 2024-04-15 Tom Gur , Mohammad Mahdi Jahanara , Mohammad Mahdi Khodabandeh , Ninad Rajgopal , Bahar Salamatian , Igor Shinkar

In this paper, we study the following variant of the junta learning problem. We are given oracle access to a Boolean function $f$ on $n$ variables that only depends on $k$ variables, and, when restricted to them, equals some predefined…

Quantum Physics · Physics 2014-10-29 Aleksandrs Belovs

We consider PAC learning of probability distributions (a.k.a. density estimation), where we are given an i.i.d. sample generated from an unknown target distribution, and want to output a distribution that is close to the target in total…

Machine Learning · Computer Science 2018-06-05 Hassan Ashtiani , Shai Ben-David , Abbas Mehrabian

Much of learning theory is concerned with the design and analysis of probably approximately correct (PAC) learners. The closely related transductive model of learning has recently seen more scrutiny, with its learners often used as…

Machine Learning · Statistics 2024-10-31 Shaddin Dughmi , Yusuf Kalayci , Grayson York

We give the first agnostic, efficient, proper learning algorithm for monotone Boolean functions. Given $2^{\tilde{O}(\sqrt{n}/\varepsilon)}$ uniformly random examples of an unknown function $f:\{\pm 1\}^n \rightarrow \{\pm 1\}$, our…

Data Structures and Algorithms · Computer Science 2023-05-25 Jane Lange , Arsen Vasilyan

In this article we develop quantum algorithms for learning and testing juntas, i.e. Boolean functions which depend only on an unknown set of k out of n input variables. Our aim is to develop efficient algorithms: - whose sample complexity…

Quantum Physics · Physics 2007-10-16 Alp Atici , Rocco A. Servedio

We study the task of Multiclass Linear Classification (MLC) in the distribution-free PAC model with Random Classification Noise (RCN). Specifically, the learner is given a set of labeled examples $(x, y)$, where $x$ is drawn from an unknown…

Machine Learning · Computer Science 2025-02-18 Ilias Diakonikolas , Mingchen Ma , Lisheng Ren , Christos Tzamos

We revisit the problem of distribution learning within the framework of learning-augmented algorithms. In this setting, we explore the scenario where a probability distribution is provided as potentially inaccurate advice on the true,…

Machine Learning · Computer Science 2025-02-03 Arnab Bhattacharyya , Davin Choo , Philips George John , Themis Gouleakis

We study the problem of agnostically learning halfspaces under the Gaussian distribution. Our main result is the {\em first proper} learning algorithm for this problem whose sample complexity and computational complexity qualitatively match…

Machine Learning · Computer Science 2021-02-11 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We study {\em online} active learning of homogeneous halfspaces in $\mathbb{R}^d$ with adversarial noise where the overall probability of a noisy label is constrained to be at most $\nu$. Our main contribution is a Perceptron-like online…

Machine Learning · Computer Science 2021-06-24 Jie Shen

The complexity of learning a concept class under Gaussian marginals in the difficult agnostic model is closely related to its $L_1$-approximability by low-degree polynomials. For any concept class with Gaussian surface area at most…

Machine Learning · Computer Science 2026-03-09 Lucas Pesenti , Lucas Slot , Manuel Wiedmer

We propose and analyze a new vantage point for the learning of mixtures of Gaussians: namely, the PAC-style model of learning probability distributions introduced by Kearns et al. Here the task is to construct a hypothesis mixture of…

Machine Learning · Computer Science 2007-05-23 Jon Feldman , Ryan O'Donnell , Rocco A. Servedio

We make progress on two important problems regarding attribute efficient learnability. First, we give an algorithm for learning decision lists of length $k$ over $n$ variables using $2^{\tilde{O}(k^{1/3})} \log n$ examples and time…

Machine Learning · Computer Science 2007-05-23 Adam R. Klivans , Rocco A. Servedio

We study the problem of learning junta distributions on $\{0, 1\}^n$, where a distribution is a $k$-junta if its probability mass function depends on a subset of at most $k$ variables. We make two main contributions: - We show that learning…

Machine Learning · Computer Science 2025-07-15 Lorenzo Beretta

An active learner is given a class of models, a large set of unlabeled examples, and the ability to interactively query labels of a subset of these examples; the goal of the learner is to learn a model in the class that fits the data well.…

Machine Learning · Computer Science 2015-06-09 Kamalika Chaudhuri , Sham Kakade , Praneeth Netrapalli , Sujay Sanghavi

We establish optimal Statistical Query (SQ) lower bounds for robustly learning certain families of discrete high-dimensional distributions. In particular, we show that no efficient SQ algorithm with access to an $\epsilon$-corrupted binary…

Data Structures and Algorithms · Computer Science 2022-06-10 Ilias Diakonikolas , Daniel M. Kane , Yuxin Sun

We consider the problem of learning a non-negative linear classifier with a $1$-norm of at most $k$, and a fixed threshold, under the hinge-loss. This problem generalizes the problem of learning a $k$-monotone disjunction. We prove that we…

Machine Learning · Statistics 2016-04-19 Sivan Sabato , Shai Shalev-Shwartz , Nathan Srebro , Daniel Hsu , Tong Zhang

We generalize the PAC (probably approximately correct) learning model to the quantum world by generalizing the concepts from classical functions to quantum processes, defining the problem of \emph{PAC learning quantum process}, and study…

Quantum Physics · Physics 2021-05-20 Kai-Min Chung , Han-Hsuan Lin