English
Related papers

Related papers: On the Power of Interactive Proofs for Learning

200 papers

In recent years crowdsourcing has become the method of choice for gathering labeled training data for learning algorithms. Standard approaches to crowdsourcing view the process of acquiring labeled data separately from the process of…

Machine Learning · Computer Science 2017-04-17 Pranjal Awasthi , Avrim Blum , Nika Haghtalab , Yishay Mansour

In distributed interactive proofs, the nodes of a graph G interact with a powerful but untrustable prover who tries to convince them, in a small number of rounds and through short messages, that G satisfies some property. This series of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-22 Pedro Montealegre , Diego Ramírez-Romero , Ivan Rapaport

This paper revisits the problem of learning a k-CNF Boolean function from examples in the context of online learning under the logarithmic loss. In doing so, we give a Bayesian interpretation to one of Valiant's celebrated PAC learning…

Machine Learning · Computer Science 2014-03-28 Joel Veness , Marcus Hutter

We study a variant of Collaborative PAC Learning, in which we aim to learn an accurate classifier for each of the $n$ data distributions, while minimizing the number of samples drawn from them in total. Unlike in the usual collaborative…

Machine Learning · Computer Science 2024-05-24 Yuyang Deng , Mingda Qiao

Training machine learning interatomic potentials that are both computationally and data-efficient is a key challenge for enabling their routine use in atomistic simulations. To this effect, we introduce franken, a scalable and lightweight…

We give an algorithm that learns arbitrary Boolean functions of $k$ arbitrary halfspaces over $\mathbb{R}^n$, in the challenging distribution-free Probably Approximately Correct (PAC) learning model, running in time $2^{\sqrt{n} \cdot (\log…

Data Structures and Algorithms · Computer Science 2026-03-10 Josh Alman , Shyamal Patel , Rocco A. Servedio

An agnostic PAC learning algorithm finds a predictor that is competitive with the best predictor in a benchmark hypothesis class, where competitiveness is measured with respect to a given loss function. However, its predictions might be…

Machine Learning · Computer Science 2021-05-24 Guy N Rothblum , Gal Yona

As illustrated by the success of integer linear programming, linear integer arithmetic is a powerful tool for modelling combinatorial problems. Furthermore, the probabilistic extension of linear programming has been used to formulate…

Artificial Intelligence · Computer Science 2024-10-17 Lennert De Smet , Pedro Zuidberg Dos Martires

We show that if a language $L$ admits a public-coin unambiguous interactive proof (UIP) with round complexity $\ell$, where $a$ bits are communicated per round, then the batch language $L^{\otimes k}$, i.e. the set of $k$-tuples of…

Computational Complexity · Computer Science 2025-10-23 Bonnie Berger , Rohan Goyal , Matthew M. Hong , Yael Tauman Kalai

We study the power of query access for the task of agnostic learning under the Gaussian distribution. In the agnostic model, no assumptions are made on the labels and the goal is to compute a hypothesis that is competitive with the {\em…

Machine Learning · Computer Science 2023-12-29 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

Although a concept class may be learnt more efficiently using quantum samples as compared with classical samples in certain scenarios, Arunachalam and de Wolf (JMLR, 2018) proved that quantum learners are asymptotically no more efficient…

Quantum Physics · Physics 2024-02-29 Shima Bab Hadiashar , Ashwin Nayak , Pulkit Sinha

We study the problem of robust learning under clean-label data-poisoning attacks, where the attacker injects (an arbitrary set of) correctly-labeled examples to the training set to fool the algorithm into making mistakes on specific test…

Machine Learning · Computer Science 2021-07-08 Avrim Blum , Steve Hanneke , Jian Qian , Han Shao

Active Learning (AL) is a human-in-the-loop framework to interactively and adaptively label data instances, thereby enabling significant gains in model performance compared to random sampling. AL approaches function by selecting the hardest…

Machine Learning · Computer Science 2023-06-05 Nathan Beck , Krishnateja Killamsetty , Suraj Kothawade , Rishabh Iyer

We consider the problem of boosting the accuracy of weak learning algorithms in the agnostic learning framework of Haussler (1992) and Kearns et al. (1992). Known algorithms for this problem (Ben-David et al., 2001; Gavinsky, 2002; Kalai et…

Machine Learning · Computer Science 2012-02-22 Vitaly Feldman

We initiate the study of tolerant adversarial PAC-learning with respect to metric perturbation sets. In adversarial PAC-learning, an adversary is allowed to replace a test point $x$ with an arbitrary point in a closed ball of radius $r$…

Machine Learning · Statistics 2023-02-16 Hassan Ashtiani , Vinayak Pathak , Ruth Urner

In recent years the framework of learning from label proportions (LLP) has been gaining importance in machine learning. In this setting, the training examples are aggregated into subsets or bags and only the average label per bag is…

Computational Complexity · Computer Science 2024-03-29 Venkatesan Guruswami , Rishi Saket

In two-prover one-round interactive proof systems, no-signaling provers are those who are allowed to use arbitrary strategies, not limited to local operations, as long as their strategies cannot be used for communication between them. Study…

Computational Complexity · Computer Science 2009-10-20 Tsuyoshi Ito

We study the problem of interactively learning a binary classifier using noisy labeling and pairwise comparison oracles, where the comparison oracle answers which one in the given two instances is more likely to be positive. Learning from…

Machine Learning · Statistics 2017-05-23 Yichong Xu , Hongyang Zhang , Aarti Singh , Kyle Miller , Artur Dubrawski

Inspired by the problem of improving classification accuracy on rare or hard subsets of a population, there has been recent interest in models of learning where the goal is to generalize to a collection of distributions, each representing a…

Machine Learning · Computer Science 2023-06-06 Nick Rittler , Kamalika Chaudhuri

We describe a framework for designing efficient active learning algorithms that are tolerant to random classification noise and are differentially-private. The framework is based on active learning algorithms that are statistical in the…

Machine Learning · Computer Science 2014-11-06 Maria Florina Balcan , Vitaly Feldman