English
Related papers

Related papers: DNF Learning via Locally Mixing Random Walks

200 papers

The model of learning with \emph{local membership queries} interpolates between the PAC model and the membership queries model by allowing the learner to query the label of any example that is similar to an example in the training set. This…

Machine Learning · Computer Science 2016-03-14 Galit Bary-Weisberg , Amit Daniely , Shai Shalev-Shwartz

We show that DNF formulae can be quantum PAC-learned in polynomial time under product distributions using a quantum example oracle. The best classical algorithm (without access to membership queries) runs in superpolynomial time. Our result…

Quantum Physics · Physics 2019-11-27 Varun Kanade , Andrea Rocchetto , Simone Severini

We introduce a new model of membership query (MQ) learning, where the learning algorithm is restricted to query points that are \emph{close} to random examples drawn from the underlying distribution. The learning model is intermediate…

Machine Learning · Computer Science 2013-04-19 Pranjal Awasthi , Vitaly Feldman , Varun Kanade

Since its introduction by Valiant in 1984, PAC learning of DNF expressions remains one of the central problems in learning theory. We consider this problem in the setting where the underlying distribution is uniform, or more generally, a…

Machine Learning · Computer Science 2015-03-20 Vitaly Feldman

In this paper, we study the problem of learning a monotone DNF with at most $s$ terms of size (number of variables in each term) at most $r$ ($s$ term $r$-MDNF) from membership queries. This problem is equivalent to the problem of learning…

Machine Learning · Computer Science 2014-05-06 Hasan Abasi , Nader H. Bshouty , Hanna Mazzawi

Recent work due to Goel et al. gave the first efficient algorithms for learning with distribution shift in the challenging PQ framework. In this setting, a learner receives labeled training examples, unlabeled test examples, and must make…

Data Structures and Algorithms · Computer Science 2026-05-19 Gautam Chandrasekaran , Georgios Gkrinias , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

In a recent breakthrough, [Bshouty et al., 2005] obtained the first passive-learning algorithm for DNFs under the uniform distribution. They showed that DNFs are learnable in the Random Walk and Noise Sensitivity models. We extend their…

Machine Learning · Computer Science 2011-09-07 S. Roch

We describe a quantum PAC learning algorithm for DNF formulae under the uniform distribution with a query complexity of $\tilde{O}(s^{3}/\epsilon + s^{2}/\epsilon^{2})$, where $s$ is the size of DNF formula and $\epsilon$ is the PAC error…

Quantum Physics · Physics 2011-10-11 Jeffrey C. Jackson , Christino Tamon , Tomoyuki Yamakami

Koch, Strassle, and Tan [SODA 2023], show that, under the randomized exponential time hypothesis, there is no distribution-free PAC-learning algorithm that runs in time $n^{\tilde O(\log\log s)}$ for the classes of $n$-variable size-$s$…

Data Structures and Algorithms · Computer Science 2023-01-31 Nader H. Bshouty

We give a polynomial time algorithm for the lossy population recovery problem. In this problem, the goal is to approximately learn an unknown distribution on binary strings of length $n$ from lossy samples: for some parameter $\mu$ each…

Data Structures and Algorithms · Computer Science 2013-07-11 Ankur Moitra , Michael Saks

We show how any PAC learning algorithm that works under the uniform distribution can be transformed, in a blackbox fashion, into one that works under an arbitrary and unknown distribution $\mathcal{D}$. The efficiency of our transformation…

Machine Learning · Statistics 2023-03-31 Guy Blanc , Jane Lange , Ali Malik , Li-Yang Tan

An interesting classical result due to Jackson allows polynomial-time learning of the function class DNF using membership queries. Since in most practical learning situations access to a membership oracle is unrealistic, this paper explores…

Quantum Physics · Physics 2007-05-23 Dan Ventura , Tony Martinez

In 1992 Blum and Rudich [BR92] gave an algorithm that uses membership and equivalence queries to learn $k$-term DNF formulas over $\{0,1\}^n$ in time $\textsf{poly}(n,2^k)$, improving on the naive $O(n^k)$ running time that can be achieved…

Data Structures and Algorithms · Computer Science 2025-07-29 Josh Alman , Shivam Nadimpalli , Shyamal Patel , Rocco Servedio

The Fourier representation for the uniform distribution over the Boolean cube has found numerous applications in algorithms and complexity analysis. Notably, in learning theory, learnability of Disjunctive Normal Form (DNF) under uniform as…

Data Structures and Algorithms · Computer Science 2025-06-03 Mohsen Heidari , Roni Khardon

We prove that any submodular function f: {0,1}^n -> {0,1,...,k} can be represented as a pseudo-Boolean 2k-DNF formula. Pseudo-Boolean DNFs are a natural generalization of DNF representation for functions with integer range. Each term in…

Machine Learning · Computer Science 2012-08-14 Sofya Raskhodnikova , Grigory Yaroslavtsev

We prove a new structural lemma for partial Boolean functions $f$, which we call the seed lemma for DNF. Using the lemma, we give the first subexponential algorithm for proper learning of DNF in Angluin's Equivalence Query (EQ) model. The…

Machine Learning · Computer Science 2011-11-07 Lisa Hellerstein , Devorah Kletenik , Linda Sellie , Rocco Servedio

We consider principled alternatives to unsupervised learning in data mining by situating the learning task in the context of the subsequent analysis task. Specifically, we consider a query-answering (hypothesis-testing) task: In the…

Data Structures and Algorithms · Computer Science 2013-04-18 Brendan Juba

We consider the distribution of the binomial probability mass function (pmf) among arithmetic progressions and obtain an average-type theorem. As applications, we consider the possible visits to a kind of sieved sets of integers or lattice…

Number Theory · Mathematics 2023-07-07 Jun Hong , Xiaosheng Wu , Shixin Zhu

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

Data Structures and Algorithms · Computer Science 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

We consider the problem of PAC-learning decision trees, i.e., learning a decision tree over the n-dimensional hypercube from independent random labeled examples. Despite significant effort, no polynomial-time algorithm is known for learning…

Machine Learning · Computer Science 2008-12-05 Adam Tauman Kalai , Shang-Hua Teng
‹ Prev 1 2 3 10 Next ›