English
Related papers

Related papers: A Mysterious Connection Between Tolerant Junta Tes…

200 papers

The framework of distribution testing is currently ubiquitous in the field of property testing. In this model, the input is a probability distribution accessible via independently drawn samples from an oracle. The testing task is to…

Data Structures and Algorithms · Computer Science 2022-09-22 Sourav Chakraborty , Eldar Fischer , Arijit Ghosh , Gopinath Mishra , Sayantan Sen

Inspired by the problem of improving classification accuracy on rare or hard subsets of a population, there has been recent interest in models of learning where the goal is to generalize to a collection of distributions, each representing a…

Machine Learning · Computer Science 2023-06-06 Nick Rittler , Kamalika Chaudhuri

We give the first agnostic, efficient, proper learning algorithm for monotone Boolean functions. Given $2^{\tilde{O}(\sqrt{n}/\varepsilon)}$ uniformly random examples of an unknown function $f:\{\pm 1\}^n \rightarrow \{\pm 1\}$, our…

Data Structures and Algorithms · Computer Science 2023-05-25 Jane Lange , Arsen Vasilyan

We consider the problem of enumerating relevant features hidden in other irrelevant information for multi-labeled data, which is formalized as learning juntas. A $k$-junta function is a function which depends on only $k$ coordinates of the…

Machine Learning · Computer Science 2019-07-16 Mikito Nanashima

We study the problem of learning under arbitrary distribution shift, where the learner is trained on a labeled set from one distribution but evaluated on a different, potentially adversarially generated test distribution. We focus on two…

Data Structures and Algorithms · Computer Science 2024-06-06 Surbhi Goel , Abhishek Shetty , Konstantinos Stavropoulos , Arsen Vasilyan

In this work, we give the first algorithms for tolerant testing of nontrivial classes in the active model: estimating the distance of a target function to a hypothesis class C with respect to some arbitrary distribution D, using only a…

Machine Learning · Statistics 2017-11-02 Avrim Blum , Lunjia Hu

For some hypothesis classes and input distributions, active agnostic learning needs exponentially fewer samples than passive learning; for other classes and distributions, it offers little to no improvement. The most popular algorithms for…

Machine Learning · Computer Science 2024-05-24 Eric Price , Yihan Zhou

We develop a framework using Hilbert spaces as a proxy to analyze PAC learning problems with structural properties. We consider a joint Hilbert space incorporating the relation between the true label and the predictor under a joint…

Machine Learning · Computer Science 2021-02-15 Mohsen Heidari , Wojciech Szpankowski

In this article we develop quantum algorithms for learning and testing juntas, i.e. Boolean functions which depend only on an unknown set of k out of n input variables. Our aim is to develop efficient algorithms: - whose sample complexity…

Quantum Physics · Physics 2007-10-16 Alp Atici , Rocco A. Servedio

Much of learning theory is concerned with the design and analysis of probably approximately correct (PAC) learners. The closely related transductive model of learning has recently seen more scrutiny, with its learners often used as…

Machine Learning · Statistics 2024-10-31 Shaddin Dughmi , Yusuf Kalayci , Grayson York

Statistical learning theory and the Probably Approximately Correct (PAC) criterion are the common approach to mathematical learning theory. PAC is widely used to analyze learning problems and algorithms, and have been studied thoroughly.…

Machine Learning · Computer Science 2024-05-03 Adi Hendel , Meir Feder

Adversarially robust PAC learning has proved to be challenging, with the currently best known learners [Montasser et al., 2021a] relying on improper methods based on intricate compression schemes, resulting in sample complexity exponential…

Machine Learning · Computer Science 2025-02-12 Hassan Ashtiani , Vinayak Pathak , Ruth Urner

Multi-distribution learning extends agnostic Probably Approximately Correct (PAC) learning to the setting in which a family of $k$ distributions, $\{D_i\}_{i\in[k]}$, is considered and a classifier's performance is measured by its error…

Machine Learning · Computer Science 2025-06-24 Chicheng Zhang , Yihan Zhou

We study several questions in the reliable agnostic learning framework of Kalai et al. (2009), which captures learning tasks in which one type of error is costlier than others. A positive reliable classifier is one that makes no false…

Machine Learning · Computer Science 2014-02-25 Varun Kanade , Justin Thaler

In this paper, we study the following variant of the junta learning problem. We are given oracle access to a Boolean function $f$ on $n$ variables that only depends on $k$ variables, and, when restricted to them, equals some predefined…

Quantum Physics · Physics 2014-10-29 Aleksandrs Belovs

We study agnostic active learning, where the goal is to learn a classifier in a pre-specified hypothesis class interactively with as few label queries as possible, while making no assumptions on the true function generating the labels. The…

Machine Learning · Computer Science 2014-07-15 Chicheng Zhang , Kamalika Chaudhuri

In this paper, we propose a learning algorithm that enables a model to quickly exploit commonalities among related tasks from an unseen task distribution, before quickly adapting to specific tasks from that same distribution. We investigate…

Machine Learning · Computer Science 2021-07-21 Arnout Devos , Yatin Dandi

We consider the basic statistical problem of detecting truncation of the uniform distribution on the Boolean hypercube by juntas. More concretely, we give upper and lower bounds on the problem of distinguishing between i.i.d. sample access…

Computational Complexity · Computer Science 2023-09-06 William He , Shivam Nadimpalli

We investigate the computational efficiency of agnostic learning for several fundamental geometric concept classes in the plane. While the sample complexity of agnostic learning is well understood, its time complexity has received much less…

Data Structures and Algorithms · Computer Science 2025-10-22 Talya Eden , Ludmila Glinskih , Sofya Raskhodnikova

We present a generalization of the well-known problem of learning k-juntas in R^n, and a novel tensor algorithm for unraveling the structure of high-dimensional distributions. Our algorithm can be viewed as a higher-order extension of…

Computational Complexity · Computer Science 2012-04-17 Santosh S. Vempala , Ying Xiao