English
Related papers

Related papers: On learning k-parities with and without noise

200 papers

We describe a slightly sub-exponential time algorithm for learning parity functions in the presence of random classification noise. This results in a polynomial-time algorithm for the case of parity functions that depend on only the first…

Machine Learning · Computer Science 2007-05-23 Avrim Blum , Adam Kalai , Hal Wasserman

We consider sparse variants of the classical Learning Parities with random Noise (LPN) problem. Our main contribution is a new algorithmic framework that provides learning algorithms against low-noise for both Learning Sparse Parities…

Cryptography and Security · Computer Science 2025-06-03 Xue Chen , Wenxuan Shu , Zhaienhe Zhou

In this work, we show, for the well-studied problem of learning parity under noise, where a learner tries to learn $x=(x_1,\ldots,x_n) \in \{0,1\}^n$ from a stream of random linear equations over $\mathrm{F}_2$ that are correct with…

Machine Learning · Computer Science 2021-07-07 Sumegha Garg , Pravesh K. Kothari , Pengda Liu , Ran Raz

We make progress on two important problems regarding attribute efficient learnability. First, we give an algorithm for learning decision lists of length $k$ over $n$ variables using $2^{\tilde{O}(k^{1/3})} \log n$ examples and time…

Machine Learning · Computer Science 2007-05-23 Adam R. Klivans , Rocco A. Servedio

Demonstrating quantum advantage with less powerful but more realistic devices is of great importance in modern quantum information science. Recently, a significant quantum speedup was achieved in the problem of learning a hidden parity…

Quantum Physics · Physics 2018-03-28 Daniel K. Park , June-Koo K. Rhee , Soonchil Lee

This work investigates the hardness of computing sparse solutions to systems of linear equations over F_2. Consider the k-EvenSet problem: given a homogeneous system of linear equations over F_2 on n variables, decide if there exists a…

Computational Complexity · Computer Science 2015-11-30 Arnab Bhattacharyya , Ameet Gadekar , Suprovat Ghoshal , Rishi Saket

There is mounting evidence of emergent phenomena in the capabilities of deep learning methods as we scale up datasets, model sizes, and training times. While there are some accounts of how these resources modulate statistical capacity, far…

Machine Learning · Computer Science 2023-01-18 Boaz Barak , Benjamin L. Edelman , Surbhi Goel , Sham Kakade , Eran Malach , Cyril Zhang

We give a quasipolynomial-time algorithm for learning stochastic decision trees that is optimally resilient to adversarial noise. Given an $\eta$-corrupted set of uniform random samples labeled by a size-$s$ stochastic decision tree, our…

Machine Learning · Computer Science 2021-05-11 Guy Blanc , Jane Lange , Li-Yang Tan

We consider the problem of finding the $k^{th}$ highest element in a totally ordered set of $n$ elements (select), and partitioning a totally ordered set into the top $k$ and bottom $n-k$ elements (partition) using pairwise comparisons.…

Data Structures and Algorithms · Computer Science 2016-03-17 Mark Braverman , Jieming Mao , S. Matthew Weinberg

We study the problem of learning a mixture of two subspaces over $\mathbb{F}_2^n$. The goal is to recover the individual subspaces, given samples from a (weighted) mixture of samples drawn uniformly from the two subspaces $A_0$ and $A_1$.…

Data Structures and Algorithms · Computer Science 2021-02-16 Aidao Chen , Anindya De , Aravindan Vijayaraghavan

Consider the model where we can access a parity function through random uniform labeled examples in the presence of random classification noise. In this paper, we show that approximating the number of relevant variables in the parity…

Machine Learning · Computer Science 2024-07-17 Nader H. Bshouty , George Haddad

We present a polynomial-time reduction from solving noisy linear equations over $\mathbb{Z}/q\mathbb{Z}$ in dimension $\Theta(k\log n/\mathsf{poly}(\log k,\log q,\log\log n))$ with a uniformly random coefficient matrix to noisy linear…

Computational Complexity · Computer Science 2024-11-20 Kiril Bangachev , Guy Bresler , Stefan Tiegel , Vinod Vaikuntanathan

Noise is often regarded as anathema to quantum computation, but in some settings it can be an unlikely ally. We consider the problem of learning the class of $n$-bit parity functions by making queries to a quantum example oracle. In the…

Quantum Physics · Physics 2015-08-05 Andrew W. Cross , Graeme Smith , John A. Smolin

We give an algorithm for learning symmetric k-juntas (boolean functions of $n$ boolean variables which depend only on an unknown set of $k$ of these variables) in the PAC model under the uniform distribution, which runs in time n^{O(k/\log…

Combinatorics · Mathematics 2007-05-23 Mihail N. Kolountzakis , Evangelos Markakis , Aranyak Mehta

Noise-tolerant PAC learning of linear models has been of central interests in machine learning community since the last century. In recent years, many computationally-efficient algorithms have been proposed for the problem of learning…

Machine Learning · Computer Science 2026-05-19 Rita Adhikari , Shiwei Zeng

We pose a fundamental question in computational learning theory: can we efficiently test whether a training set satisfies the assumptions of a given noise model? This question has remained unaddressed despite decades of research on learning…

Machine Learning · Computer Science 2026-05-11 Surbhi Goel , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We analyse the performance of well-known evolutionary algorithms (1+1)EA and (1+$\lambda$)EA in the prior noise model, where in each fitness evaluation the search point is altered before evaluation with probability $p$. We present refined…

Neural and Evolutionary Computing · Computer Science 2018-12-04 Dirk Sudholt

We study the problem of learning an unknown mixture of $k$ rankings over $n$ elements, given access to noisy samples drawn from the unknown mixture. We consider a range of different noise models, including natural variants of the "heat…

Machine Learning · Computer Science 2018-11-06 Anindya De , Ryan O'Donnell , Rocco Servedio

We study the problem of PAC learning one-hidden-layer ReLU networks with $k$ hidden units on $\mathbb{R}^d$ under Gaussian marginals in the presence of additive label noise. For the case of positive coefficients, we give the first…

Machine Learning · Computer Science 2020-06-23 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Nikos Zarifis

We give tight statistical query (SQ) lower bounds for learnining halfspaces in the presence of Massart noise. In particular, suppose that all labels are corrupted with probability at most $\eta$. We show that for arbitrary $\eta \in…

Machine Learning · Computer Science 2022-01-25 Rajai Nasser , Stefan Tiegel
‹ Prev 1 2 3 10 Next ›