English
Related papers

Related papers: Learning DNFs under product distributions via {\mu…

200 papers

An interesting classical result due to Jackson allows polynomial-time learning of the function class DNF using membership queries. Since in most practical learning situations access to a membership oracle is unrealistic, this paper explores…

Quantum Physics · Physics 2007-05-23 Dan Ventura , Tony Martinez

We describe a quantum PAC learning algorithm for DNF formulae under the uniform distribution with a query complexity of $\tilde{O}(s^{3}/\epsilon + s^{2}/\epsilon^{2})$, where $s$ is the size of DNF formula and $\epsilon$ is the PAC error…

Quantum Physics · Physics 2011-10-11 Jeffrey C. Jackson , Christino Tamon , Tomoyuki Yamakami

We give two results on PAC learning DNF formulas using membership queries in the challenging "distribution-free" learning framework, where learning algorithms must succeed for an arbitrary and unknown distribution over $\{0,1\}^n$. (1) We…

Data Structures and Algorithms · Computer Science 2025-05-27 Josh Alman , Shivam Nadimpalli , Shyamal Patel , Rocco A. Servedio

The Fourier representation for the uniform distribution over the Boolean cube has found numerous applications in algorithms and complexity analysis. Notably, in learning theory, learnability of Disjunctive Normal Form (DNF) under uniform as…

Data Structures and Algorithms · Computer Science 2025-06-03 Mohsen Heidari , Roni Khardon

Since its introduction by Valiant in 1984, PAC learning of DNF expressions remains one of the central problems in learning theory. We consider this problem in the setting where the underlying distribution is uniform, or more generally, a…

Machine Learning · Computer Science 2015-03-20 Vitaly Feldman

We show how any PAC learning algorithm that works under the uniform distribution can be transformed, in a blackbox fashion, into one that works under an arbitrary and unknown distribution $\mathcal{D}$. The efficiency of our transformation…

Machine Learning · Statistics 2023-03-31 Guy Blanc , Jane Lange , Ali Malik , Li-Yang Tan

Computational learning theory states that many classes of boolean formulas are learnable in polynomial time. This paper addresses the understudied subject of how, in practice, such formulas can be learned by deep neural networks.…

Machine Learning · Computer Science 2025-09-17 Marcio Nicolau , Anderson R. Tavares , Zhiwei Zhang , Pedro Avelar , João M. Flach , Luis C. Lamb , Moshe Y. Vardi

We introduce a new model of membership query (MQ) learning, where the learning algorithm is restricted to query points that are \emph{close} to random examples drawn from the underlying distribution. The learning model is intermediate…

Machine Learning · Computer Science 2013-04-19 Pranjal Awasthi , Vitaly Feldman , Varun Kanade

In a recent breakthrough, [Bshouty et al., 2005] obtained the first passive-learning algorithm for DNFs under the uniform distribution. They showed that DNFs are learnable in the Random Walk and Noise Sensitivity models. We extend their…

Machine Learning · Computer Science 2011-09-07 S. Roch

In 1992 Blum and Rudich [BR92] gave an algorithm that uses membership and equivalence queries to learn $k$-term DNF formulas over $\{0,1\}^n$ in time $\textsf{poly}(n,2^k)$, improving on the naive $O(n^k)$ running time that can be achieved…

Data Structures and Algorithms · Computer Science 2025-07-29 Josh Alman , Shivam Nadimpalli , Shyamal Patel , Rocco Servedio

The model of learning with \emph{local membership queries} interpolates between the PAC model and the membership queries model by allowing the learner to query the label of any example that is similar to an example in the training set. This…

Machine Learning · Computer Science 2016-03-14 Galit Bary-Weisberg , Amit Daniely , Shai Shalev-Shwartz

The problem of learning Boolean linear functions from quantum examples w.r.t. the uniform distribution can be solved on a quantum computer using the Bernstein-Vazirani algorithm. A similar strategy can be applied in the case of noisy…

Quantum Physics · Physics 2020-04-22 Matthias C. Caro

Without large quantum computers to empirically evaluate performance, theoretical frameworks such as the quantum statistical query (QSQ) are a primary tool to study quantum algorithms for learning classical functions and search for quantum…

Quantum Physics · Physics 2026-02-11 Laura Lewis , Dar Gilboa , Jarrod R. McClean

A major problem in computational learning theory is whether the class of formulas in conjunctive normal form (CNF) is efficiently learnable. Although it is known that this class cannot be polynomially learned using either membership or…

Machine Learning · Computer Science 2016-09-13 Montserrat Hermo , Ana Ozaki

Koch, Strassle, and Tan [SODA 2023], show that, under the randomized exponential time hypothesis, there is no distribution-free PAC-learning algorithm that runs in time $n^{\tilde O(\log\log s)}$ for the classes of $n$-variable size-$s$…

Data Structures and Algorithms · Computer Science 2023-01-31 Nader H. Bshouty

Here we study the comparative power of classical and quantum learners for generative modelling within the Probably Approximately Correct (PAC) framework. More specifically we consider the following task: Given samples from some unknown…

Quantum Physics · Physics 2021-03-24 Ryan Sweke , Jean-Pierre Seifert , Dominik Hangleiter , Jens Eisert

We consider the problem of PAC-learning decision trees, i.e., learning a decision tree over the n-dimensional hypercube from independent random labeled examples. Despite significant effort, no polynomial-time algorithm is known for learning…

Machine Learning · Computer Science 2008-12-05 Adam Tauman Kalai , Shang-Hua Teng

We consider the problem of learning an unknown product distribution $X$ over $\{0,1\}^n$ using samples $f(X)$ where $f$ is a \emph{known} transformation function. Each choice of a transformation function $f$ specifies a learning problem in…

Machine Learning · Computer Science 2011-03-04 Constantinos Daskalakis , Ilias Diakonikolas , Rocco A. Servedio

We prove a new structural lemma for partial Boolean functions $f$, which we call the seed lemma for DNF. Using the lemma, we give the first subexponential algorithm for proper learning of DNF in Angluin's Equivalence Query (EQ) model. The…

Machine Learning · Computer Science 2011-11-07 Lisa Hellerstein , Devorah Kletenik , Linda Sellie , Rocco Servedio

We prove that any submodular function f: {0,1}^n -> {0,1,...,k} can be represented as a pseudo-Boolean 2k-DNF formula. Pseudo-Boolean DNFs are a natural generalization of DNF representation for functions with integer range. Each term in…

Machine Learning · Computer Science 2012-08-14 Sofya Raskhodnikova , Grigory Yaroslavtsev
‹ Prev 1 2 3 10 Next ›