English
Related papers

Related papers: Noise-Tolerant Learning, the Parity Problem, and t…

200 papers

We consider the problem of finding the $k^{th}$ highest element in a totally ordered set of $n$ elements (select), and partitioning a totally ordered set into the top $k$ and bottom $n-k$ elements (partition) using pairwise comparisons.…

Data Structures and Algorithms · Computer Science 2016-03-17 Mark Braverman , Jieming Mao , S. Matthew Weinberg

We study {\em online} active learning of homogeneous halfspaces in $\mathbb{R}^d$ with adversarial noise where the overall probability of a noisy label is constrained to be at most $\nu$. Our main contribution is a Perceptron-like online…

Machine Learning · Computer Science 2021-06-24 Jie Shen

Let $f:\{-1,1\}^n$ be a polynomial with at most $s$ non-zero real coefficients. We give an algorithm for exactly reconstructing f given random examples from the uniform distribution on $\{-1,1\}^n$ that runs in time polynomial in $n$ and…

Machine Learning · Computer Science 2014-11-10 Murat Kocaoglu , Karthikeyan Shanmugam , Alexandros G. Dimakis , Adam Klivans

The increased availability of data in recent years has led several authors to ask whether it is possible to use data as a {\em computational} resource. That is, if more data is available, beyond the sample complexity limit, is it possible…

Machine Learning · Computer Science 2013-11-12 Amit Daniely , Nati Linial , Shai Shalev Shwartz

We use a Bayesian approach to optimally solve problems in noisy binary search. We deal with two variants: 1. Each comparison can be erroneous with some probability $1 - p$. 2. At each stage $k$ comparisons can be performed in parallel and a…

Quantum Physics · Physics 2011-11-09 M. Ben-Or , Avinatan Hassidim

We use a combination of analytical and numerical techniques to calculate the noise threshold and resource requirements for a linear optical quantum computing scheme based on parity-state encoding. Parity-state encoding is used at the lowest…

Quantum Physics · Physics 2013-05-29 A. J. F. Hayes , H. L. Haselgrove , Alexei Gilchrist , T. C. Ralph

In this paper we explore noise tolerant learning of classifiers. We formulate the problem as follows. We assume that there is an ${\bf unobservable}$ training set which is noise-free. The actual training set given to the learning algorithm…

Machine Learning · Computer Science 2013-11-27 Naresh Manwani , P. S. Sastry

The problem of learning structural equation models (SEMs) from data is a fundamental problem in causal inference. We develop a new algorithm --- which is computationally and statistically efficient and works in the high-dimensional regime…

Machine Learning · Computer Science 2019-01-30 Asish Ghoshal , Jean Honorio

The operationalization of algorithmic fairness comes with several practical challenges, not the least of which is the availability or reliability of protected attributes in datasets. In real-world contexts, practical and legal impediments…

Machine Learning · Computer Science 2023-07-12 Avijit Ghosh , Pablo Kvitca , Christo Wilson

We study the efficient learnability of geometric concept classes - specifically, low-degree polynomial threshold functions (PTFs) and intersections of halfspaces - when a fraction of the data is adversarially corrupted. We give the first…

Machine Learning · Computer Science 2017-07-06 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Classical verification of quantum learning allows classical clients to reliably leverage quantum computing advantages by interacting with untrusted quantum servers. Yet, current quantum devices available in practice suffers from a variety…

Quantum Physics · Physics 2024-11-15 Yinghao Ma , Jiaxi Su , Dong-Ling Deng

We consider the following basic inference problem: there is an unknown high-dimensional vector $w \in \mathbb{R}^n$, and an algorithm is given access to labeled pairs $(x,y)$ where $x \in \mathbb{R}^n$ is a measurement and $y = w \cdot x +…

Computational Complexity · Computer Science 2019-11-05 Xue Chen , Anindya De , Rocco A. Servedio

We study the problem of PAC learning $\gamma$-margin halfspaces with Massart noise. We propose a simple proper learning algorithm, the Perspectron, that has sample complexity $\widetilde{O}((\epsilon\gamma)^{-2})$ and achieves…

Machine Learning · Computer Science 2025-01-20 Gautam Chandrasekaran , Vasilis Kontonis , Konstantinos Stavropoulos , Kevin Tian

We study the query complexity of Weak Parity: the problem of computing the parity of an n-bit input string, where one only has to succeed on a 1/2+eps fraction of input strings, but must do so with high probability on those inputs where one…

Computational Complexity · Computer Science 2013-12-03 Scott Aaronson , Andris Ambainis , Kaspars Balodis , Mohammad Bavarian

We study the algorithmic task of testably learning general Massart halfspaces under the Gaussian distribution. In the testable learning setting, the aim is the design of a tester-learner pair satisfying the following properties: (1) if the…

Data Structures and Algorithms · Computer Science 2026-02-27 Ilias Diakonikolas , Giannis Iakovidis , Daniel M. Kane , Sihan Liu

We study the problem of learning an unknown mixture of $k$ rankings over $n$ elements, given access to noisy samples drawn from the unknown mixture. We consider a range of different noise models, including natural variants of the "heat…

Machine Learning · Computer Science 2018-11-06 Anindya De , Ryan O'Donnell , Rocco Servedio

We present a technique of proving lower bounds for noisy computations. This is achieved by a theorem connecting computations on a kind of randomized decision trees and sampling based algorithms. This approach is surprisingly powerful, and…

Computational Complexity · Computer Science 2015-03-03 Chinmoy Dutta , Jaikumar Radhakrishnan

We study the collaborative PAC learning problem recently proposed in Blum et al.~\cite{BHPQ17}, in which we have $k$ players and they want to learn a target function collaboratively, such that the learned function approximates the target…

Machine Learning · Computer Science 2018-10-15 Jiecao Chen , Qin Zhang , Yuan Zhou

We consider the problem of estimating how well a model class is capable of fitting a distribution of labeled data. We show that it is often possible to accurately estimate this "learnability" even when given an amount of data that is too…

Machine Learning · Computer Science 2019-03-26 Weihao Kong , Gregory Valiant

In this expository note we show that the learning parities with noise (LPN) assumption is robust to weak dependencies in the noise distribution of small batches of samples. This provides a partial converse to the linearization technique of…

Cryptography and Security · Computer Science 2024-04-18 Noah Golowich , Ankur Moitra , Dhruv Rohatgi