English
Related papers

Related papers: A Computational Separation between Private Learnin…

200 papers

We formalize the problem of online learning-unlearning, where a model is updated sequentially in an online setting while accommodating unlearning requests between updates. After a data point is unlearned, all subsequent outputs must be…

Machine Learning · Computer Science 2025-05-14 Yaxi Hu , Bernhard Schölkopf , Amartya Sanyal

We study multiclass classification in the agnostic adversarial online learning setting. As our main result, we prove that any multiclass concept class is agnostically learnable if and only if its Littlestone dimension is finite. This solves…

Machine Learning · Computer Science 2023-07-10 Steve Hanneke , Shay Moran , Vinod Raman , Unique Subedi , Ambuj Tewari

Most of our lives are conducted in the cyberspace. The human notion of privacy translates into a cyber notion of privacy on many functions that take place in the cyberspace. This article focuses on three such functions: how to privately…

Cryptography and Security · Computer Science 2021-08-03 Sennur Ulukus , Salman Avestimehr , Michael Gastpar , Syed Jafar , Ravi Tandon , Chao Tian

We compare the sample complexity of private learning [Kasiviswanathan et al. 2008] and sanitization~[Blum et al. 2008] under pure $\epsilon$-differential privacy [Dwork et al. TCC 2006] and approximate $(\epsilon,\delta)$-differential…

Machine Learning · Computer Science 2014-07-11 Amos Beimel , Kobbi Nissim , Uri Stemmer

We propose a learning model called the quantum statistical learning QSQ model, which extends the SQ learning model introduced by Kearns to the quantum setting. Our model can be also seen as a restriction of the quantum PAC learning model:…

Quantum Physics · Physics 2020-11-26 Srinivasan Arunachalam , Alex B. Grilo , Henry Yuen

Much of learning theory is concerned with the design and analysis of probably approximately correct (PAC) learners. The closely related transductive model of learning has recently seen more scrutiny, with its learners often used as…

Machine Learning · Statistics 2024-10-31 Shaddin Dughmi , Yusuf Kalayci , Grayson York

We present new differentially private algorithms for learning a large-margin halfspace. In contrast to previous algorithms, which are based on either differentially private simulations of the statistical query model or on private convex…

Machine Learning · Computer Science 2020-02-25 Huy L. Nguyen , Jonathan Ullman , Lydia Zakynthinou

Despite recent progress in offline learning, these methods are still trained and tested on the same environment. In this paper, we compare the generalization abilities of widely used online and offline learning methods such as online…

Machine Learning · Computer Science 2024-03-18 Ishita Mediratta , Qingfei You , Minqi Jiang , Roberta Raileanu

We study uniform computability properties of PAC learning using Weihrauch complexity. We focus on closed concept classes, which are either represented by positive, by negative or by full information. Among other results, we prove that…

Logic · Mathematics 2026-01-27 Vasco Brattka , Guillaume Chirache

The diversity and quantity of data warehouses, gathering data from distributed devices such as mobile devices, can enhance the success and robustness of machine learning algorithms. Federated learning enables distributed participants to…

Machine Learning · Computer Science 2022-03-10 Shuo Wang , Surya Nepal , Kristen Moore , Marthie Grobler , Carsten Rudolph , Alsharif Abuadbba

In this dissertation we study statistical and online learning problems from an optimization viewpoint.The dissertation is divided into two parts : I. We first consider the question of learnability for statistical learning problems in the…

Machine Learning · Computer Science 2012-04-19 Karthik Sridharan

This paper contributes to the study of CPAC learnability -- a computable version of PAC learning -- by solving three open questions from recent papers. Firstly, we prove that every improperly CPAC learnable class is contained in a class…

Computational Complexity · Computer Science 2023-02-24 Valentino Delle Rose , Alexander Kozachinskiy , Cristobal Rojas , Tomasz Steifer

Noise is often regarded as anathema to quantum computation, but in some settings it can be an unlikely ally. We consider the problem of learning the class of $n$-bit parity functions by making queries to a quantum example oracle. In the…

Quantum Physics · Physics 2015-08-05 Andrew W. Cross , Graeme Smith , John A. Smolin

We study the sample complexity of learning threshold functions under the constraint of differential privacy. It is assumed that each labeled example in the training data is the information of one individual and we would like to come up with…

Data Structures and Algorithms · Computer Science 2019-11-25 Haim Kaplan , Katrina Ligett , Yishay Mansour , Moni Naor , Uri Stemmer

We present algorithms that learn certain classes of function-free recursive logic programs in polynomial time from equivalence queries. In particular, we show that a single k-ary recursive constant-depth determinate clause is learnable.…

Artificial Intelligence · Computer Science 2014-11-17 W. W. Cohen

We revisit the problem of online learning with individual fairness, where an online learner strives to maximize predictive accuracy while ensuring that similar individuals are treated similarly. We first extend the frameworks of Gillen et…

Machine Learning · Computer Science 2024-03-12 Yahav Bechavod

We study a variant of Collaborative PAC Learning, in which we aim to learn an accurate classifier for each of the $n$ data distributions, while minimizing the number of samples drawn from them in total. Unlike in the usual collaborative…

Machine Learning · Computer Science 2024-05-24 Yuyang Deng , Mingda Qiao

This paper surveys various results in the field of Quantum Learning theory, specifically focusing on learning quantum-encoded classical concepts in the Probably Approximately Correct (PAC) framework. The cornerstone of this work is the…

Quantum Physics · Physics 2026-02-03 Sagnik Chatterjee

In many quantum tasks, there is an unknown quantum object that one wishes to learn. An online strategy for this task involves adaptively refining a hypothesis to reproduce such an object or its measurement statistics. A common evaluation…

Quantum Physics · Physics 2025-11-25 Akshay Bansal , Ian George , Soumik Ghosh , Jamie Sikora , Alice Zheng

We study the problem of learning from multiple untrusted data sources, a scenario of increasing practical relevance given the recent emergence of crowdsourcing and collaborative learning paradigms. Specifically, we analyze the situation in…

Machine Learning · Computer Science 2020-07-01 Nikola Konstantinov , Elias Frantar , Dan Alistarh , Christoph H. Lampert