English
Related papers

Related papers: On characterizations of learnability with computab…

200 papers

As learning solutions reach critical applications in social, industrial, and medical domains, the need to curtail their behavior has become paramount. There is now ample evidence that without explicit tailoring, learning can lead to biased,…

Machine Learning · Computer Science 2021-02-19 Luiz F. O. Chamon , Alejandro Ribeiro

We examine the relationship between learnability and robust (or agnostic) learnability for the problem of distribution learning. We show that, contrary to other learning settings (e.g., PAC learning of function classes), realizable…

Machine Learning · Statistics 2024-06-27 Shai Ben-David , Alex Bie , Gautam Kamath , Tosca Lechner

We study the problem of learning an adversarially robust predictor to test time attacks in the semi-supervised PAC model. We address the question of how many labeled and unlabeled examples are required to ensure learning. We show that…

Machine Learning · Computer Science 2024-05-07 Idan Attias , Steve Hanneke , Yishay Mansour

In a recent article, Alon, Hanneke, Holzman, and Moran (FOCS '21) introduced a unifying framework to study the learnability of classes of partial concepts. One of the central questions studied in their work is whether the learnability of a…

Machine Learning · Computer Science 2023-03-31 Tsun-Ming Cheung , Hamed Hatami , Pooya Hatami , Kaave Hosseini

We study the problem of reducing adversarially robust learning to standard PAC learning, i.e. the complexity of learning adversarially robust predictors using access to only a black-box non-robust learner. We give a reduction that can…

Machine Learning · Computer Science 2020-10-26 Omar Montasser , Steve Hanneke , Nathan Srebro

We consider the relationship between learnability of a "base class" of functions on a set $X$, and learnability of a class of statistical functions derived from the base class. For example, we refine results showing that learnability of a…

Logic in Computer Science · Computer Science 2025-05-28 Aaron Anderson , Michael Benedikt

We introduce a formal notion of defendability against backdoors using a game between an attacker and a defender. In this game, the attacker modifies a function to behave differently on a particular input known as the "trigger", while…

Machine Learning · Computer Science 2025-02-12 Paul Christiano , Jacob Hilton , Victor Lecomte , Mark Xu

We study the problem of learning from multiple untrusted data sources, a scenario of increasing practical relevance given the recent emergence of crowdsourcing and collaborative learning paradigms. Specifically, we analyze the situation in…

Machine Learning · Computer Science 2020-07-01 Nikola Konstantinov , Elias Frantar , Dan Alistarh , Christoph H. Lampert

We study computational aspects of algorithmic replicability, a notion of stability introduced by Impagliazzo, Lei, Pitassi, and Sorrell [2022]. Motivated by a recent line of work that established strong statistical connections between…

Machine Learning · Computer Science 2024-12-03 Alkis Kalavasis , Amin Karbasi , Grigoris Velegkas , Felix Zhou

We extend the theory of PAC learning in a way which allows to model a rich variety of learning tasks where the data satisfy special properties that ease the learning process. For example, tasks where the distance of the data from the…

Machine Learning · Computer Science 2021-07-22 Noga Alon , Steve Hanneke , Ron Holzman , Shay Moran

An agnostic PAC learning algorithm finds a predictor that is competitive with the best predictor in a benchmark hypothesis class, where competitiveness is measured with respect to a given loss function. However, its predictions might be…

Machine Learning · Computer Science 2021-05-24 Guy N Rothblum , Gal Yona

Valiant's 1984 paper is widely credited with introducing the PAC learning model, but it, in fact, introduced a different model: unlike PAC learning, the learner receives only positives, may issue membership queries, and must output a…

Machine Learning · Statistics 2026-05-14 Steve Hanneke , Anay Mehrotra , Grigoris Velegkas , Manolis Zampetakis

Learning and logic are distinct and remarkable approaches to prediction. Machine learning has experienced a surge in popularity because it is robust to noise and achieves high performance; however, ML experiences many issues with knowledge…

Artificial Intelligence · Computer Science 2018-07-16 Jeffrey Cheng

Much of learning theory is concerned with the design and analysis of probably approximately correct (PAC) learners. The closely related transductive model of learning has recently seen more scrutiny, with its learners often used as…

Machine Learning · Statistics 2024-10-31 Shaddin Dughmi , Yusuf Kalayci , Grayson York

In response to a 1997 problem of M. Vidyasagar, we state a criterion for PAC learnability of a concept class $\mathscr C$ under the family of all non-atomic (diffuse) measures on the domain $\Omega$. The uniform Glivenko--Cantelli property…

Machine Learning · Statistics 2013-03-27 Vladimir Pestov

We introduce the problem of learning conditional averages in the PAC framework. The learner receives a sample labeled by an unknown target concept from a known concept class, as in standard PAC learning. However, instead of learning the…

This paper explores a PAC (probably approximately correct) learning model in cooperative games. Specifically, we are given $m$ random samples of coalitions and their values, taken from some unknown cooperative game; can we predict the…

Computer Science and Game Theory · Computer Science 2016-10-11 Maria-Florina Balcan , Ariel D. Procaccia , Yair Zick

The basic problem in the PAC model of computational learning theory is to determine which hypothesis classes are efficiently learnable. There is presently a dearth of results showing hardness of learning problems. Moreover, the existing…

Machine Learning · Computer Science 2014-03-11 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

The goal of a learning algorithm is to receive a training data set as input and provide a hypothesis that can generalize to all possible data points from a domain set. The hypothesis is chosen from hypothesis classes with potentially…

Machine Learning · Statistics 2023-03-29 Soosan Beheshti , Mahdi Shamsi

We informally call a stochastic process learnable if it admits a generalization error approaching zero in probability for any concept class with finite VC-dimension (IID processes are the simplest example). A mixture of learnable processes…

Machine Learning · Statistics 2015-07-27 Cosma Rohilla Shalizi , Aryeh Kontorovich