English
Related papers

Related papers: On the Power of Interactive Proofs for Learning

200 papers

Polynomial approximations to boolean functions have led to many positive results in computer science. In particular, polynomial approximations to the sign function underly algorithms for agnostically learning halfspaces, as well as…

Computational Complexity · Computer Science 2014-12-09 Mark Bun , Thomas Steinke

Naor, Parter, and Yogev [SODA 2020] recently designed a compiler for automatically translating standard centralized interactive protocols to distributed interactive protocols, as introduced by Kol, Oshman, and Saxena [PODC 2018]. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-17 Laurent Feuilloley , Pierre Fraigniaud , Pedro Montealegre , Ivan Rapaport , Éric Rémila , Ioan Todinca

We consider interactive learning in the realizable setting and develop a general framework to handle problems ranging from best arm identification to active classification. We begin our investigation with the observation that agnostic…

Machine Learning · Computer Science 2021-11-10 Julian Katz-Samuels , Blake Mason , Kevin Jamieson , Rob Nowak

We generalize the "indirect learning" technique of Furst et. al., 1991 to reduce from learning a concept class over a samplable distribution $\mu$ to learning the same concept class over the uniform distribution. The reduction succeeds when…

Machine Learning · Computer Science 2021-12-24 Eric Binnendyk , Marco Carmosino , Antonina Kolokolova , Ramyaa Ramyaa , Manuel Sabin

We study the efficient learnability of low-degree polynomial threshold functions (PTFs) in the presence of a constant fraction of adversarial corruptions. Our main algorithmic result is a polynomial-time PAC learning algorithm for this…

Data Structures and Algorithms · Computer Science 2024-04-02 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

We consider the problem of distribution-free learning for Boolean function classes in the PAC and agnostic models. Generalizing a beautiful work of Malach and Shalev-Shwartz (2022) that gave tight correlational SQ (CSQ) lower bounds for…

Data Structures and Algorithms · Computer Science 2023-08-25 Aravind Gollakota , Sushrut Karmalkar , Adam Klivans

We revisit the framework of interactive proofs for distribution testing, first introduced by Chiesa and Gur (ITCS 2018), which has recently experienced a surge in interest, accompanied by notable progress (e.g., Herman and Rothblum, STOC…

Computational Complexity · Computer Science 2025-12-01 Ari Biswas , Mark Bun , Clément Canonne , Satchit Sivakumar

There are many high dimensional function classes that have fast agnostic learning algorithms when assumptions on the distribution of examples can be made, such as Gaussianity or uniformity over the domain. But how can one be confident that…

Machine Learning · Computer Science 2022-11-22 Ronitt Rubinfeld , Arsen Vasilyan

Inspired by recent work on learning with distribution shift, we give a general outlier removal algorithm called iterative polynomial filtering and show a number of striking applications for supervised learning with contamination: (1) We…

Machine Learning · Computer Science 2026-01-13 Adam R. Klivans , Konstantinos Stavropoulos , Kevin Tian , Arsen Vasilyan

In a landmark result, Linial, Mansour and Nisan (J. ACM 1993) gave a quasipolynomial-time algorithm for learning constant-depth circuits given labeled i.i.d. samples under the uniform distribution. Their work has had a deep and lasting…

Machine Learning · Computer Science 2026-04-08 Gautam Chandrasekaran , Jason Gaitonde , Ankur Moitra , Arsen Vasilyan

We study the problem of efficient PAC active learning of homogeneous linear classifiers (halfspaces) in $\mathbb{R}^d$, where the goal is to learn a halfspace with low error using as few label queries as possible. Under the extra assumption…

Machine Learning · Computer Science 2018-06-05 Chicheng Zhang

Adversarially robust PAC learning has proved to be challenging, with the currently best known learners [Montasser et al., 2021a] relying on improper methods based on intricate compression schemes, resulting in sample complexity exponential…

Machine Learning · Computer Science 2025-02-12 Hassan Ashtiani , Vinayak Pathak , Ruth Urner

Discriminative Feature Feedback is a setting proposed by Dastupta et al. (2018), which provides a protocol for interactive learning based on feature explanations that are provided by a human teacher. The features distinguish between the…

Machine Learning · Computer Science 2023-11-14 Sivan Sabato

Recently there has been much interest in Gowers uniformity norms from the perspective of theoretical computer science. This is mainly due to the fact that these norms provide a method for testing whether the maximum correlation of a…

Computational Complexity · Computer Science 2013-08-14 Hamed Hatami , Shachar Lovett

Motivated by the fact that input distributions are often unknown in advance, distribution-free property testing considers a setting where the algorithmic task is to accept functions $f : [n] \to \{0,1\}$ with a certain property P and reject…

Computational Complexity · Computer Science 2024-02-19 Hugo Aaronson , Tom Gur , Ninad Rajgopal , Ron D. Rothblum

Feasible interpolation is a general technique for proving proof complexity lower bounds. The monotone version of the technique converts, in its basic variant, lower bounds for monotone Boolean circuits separating two NP-sets to proof…

Computational Complexity · Computer Science 2022-01-19 Lukáš Folwarczný

We propose a general methodology for testing whether a given polynomial with integer coefficients is identically zero. The methodology evaluates the polynomial at efficiently computable approximations of suitable irrational points. In…

Data Structures and Algorithms · Computer Science 2007-05-23 Zhi-Zhong Chen , Ming-Yang Kao

We consider the problem of testing and learning from data in the presence of resource constraints, such as limited memory or weak data access, which place limitations on the efficiency and feasibility of testing or learning. In particular,…

Quantum Physics · Physics 2025-07-22 Matthias C. Caro , Jens Eisert , Marcel Hinsche , Marios Ioannou , Alexander Nietner , Ryan Sweke

This paper investigates learning-augmented algorithms for smooth integer programs, covering canonical problems such as MAX-CUT and MAX-k-SAT. We introduce a framework that incorporates a predictive oracle to construct a linear surrogate of…

Data Structures and Algorithms · Computer Science 2026-02-04 Hao-Yuan He , Ming Li

During recent years, active learning has evolved into a popular paradigm for utilizing user's feedback to improve accuracy of learning algorithms. Active learning works by selecting the most informative sample among unlabeled data and…

Machine Learning · Computer Science 2016-11-17 Alireza Ghasemi , Hamid R. Rabiee , Mohsen Fadaee , Mohammad T. Manzuri , Mohammad H. Rohban