English
Related papers

Related papers: Tight Bounds for Collaborative PAC Learning via Mu…

200 papers

We give an efficient algorithm for learning a binary function in a given class C of bounded VC dimension, with training data distributed according to P and test data according to Q, where P and Q may be arbitrary distributions over X. This…

Machine Learning · Computer Science 2021-02-17 Adam Kalai , Varun Kanade

We present an improved algorithm for {\em quasi-properly} learning convex polyhedra in the realizable PAC setting from data with a margin. Our learning algorithm constructs a consistent polyhedron as an intersection of about $t \log t$…

Machine Learning · Computer Science 2021-11-03 Lee-Ad Gottlieb , Eran Kaufman , Aryeh Kontorovich , Gabriel Nivasch

In this article we study the transfer learning model of action advice under a budget. We focus on reinforcement learning teachers providing action advice to heterogeneous students playing the game of Pac-Man under a limited advice budget.…

Artificial Intelligence · Computer Science 2017-12-12 Anestis Fachantidis , Matthew E. Taylor , Ioannis Vlahavas

Hybrid Reinforcement Learning (RL), where an agent learns from both an offline dataset and online explorations in an unknown environment, has garnered significant recent interest. A crucial question posed by Xie et al. (2022) is whether…

Machine Learning · Statistics 2024-08-09 Kevin Tan , Wei Fan , Yuting Wei

We propose a new method for supervised learning with multiple sets of features ("views"). The multiview problem is especially important in biology and medicine, where "-omics" data such as genomics, proteomics and radiomics are measured on…

Methodology · Statistics 2022-10-12 Daisy Yi Ding , Shuangning Li , Balasubramanian Narasimhan , Robert Tibshirani

We study the complexity of PAC learning halfspaces in the presence of Massart noise. In this problem, we are given i.i.d. labeled examples $(\mathbf{x}, y) \in \mathbb{R}^N \times \{ \pm 1\}$, where the distribution of $\mathbf{x}$ is…

Machine Learning · Computer Science 2022-07-29 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi , Lisheng Ren

Continual learning algorithms which keep the parameters of new tasks close to that of previous tasks, are popular in preventing catastrophic forgetting in sequential task learning settings. However, 1) the performance for the new continual…

Machine Learning · Computer Science 2023-07-21 Wei Cong , Yang Cong , Gan Sun , Yuyang Liu , Jiahua Dong

We introduce a new and rigorously-formulated PAC-Bayes meta-learning algorithm that solves few-shot learning. Our proposed method extends the PAC-Bayes framework from a single task setting to the meta-learning multiple task setting to…

Machine Learning · Computer Science 2021-11-02 Cuong Nguyen , Thanh-Toan Do , Gustavo Carneiro

In this work, we consider multitask learning problems where clusters of nodes are interested in estimating their own parameter vector. Cooperation among clusters is beneficial when the optimal models of adjacent clusters have a good number…

Systems and Control · Computer Science 2016-11-03 Roula Nassif , Cédric Richard , André Ferrari , Ali H. Sayed

While there has been significant progress in curriculum learning and continuous learning for training agents to generalize across a wide variety of environments in the context of single-agent reinforcement learning, it is unclear if these…

Artificial Intelligence · Computer Science 2023-12-20 Rupali Bhati , Sai Krishna Gottipati , Clodéric Mars , Matthew E. Taylor

Supervised Learning is a way of developing Artificial Intelligence systems in which a computer algorithm is trained on labeled data inputs. Effectiveness of a Supervised Learning algorithm is determined by its performance on a given dataset…

Computers and Society · Computer Science 2024-10-29 Shubhi Bansal , Atharva Tendulkar , Nagendra Kumar

In multi-task learning several related tasks are considered simultaneously, with the hope that by an appropriate sharing of information across tasks, each task may benefit from the others. In the context of learning linear functions for…

Machine Learning · Computer Science 2008-09-12 Laurent Jacob , Francis Bach , Jean-Philippe Vert

Federated learning (FL) is a new distributed learning paradigm, with privacy, utility, and efficiency as its primary pillars. Existing research indicates that it is unlikely to simultaneously attain infinitesimal privacy leakage, utility…

Machine Learning · Computer Science 2023-05-22 Xiaojin Zhang , Anbu Huang , Lixin Fan , Kai Chen , Qiang Yang

This paper studies the sample complexity (aka number of comparisons) bounds for the active best-$k$ items selection from pairwise comparisons. From a given set of items, the learner can make pairwise comparisons on every pair of items, and…

Machine Learning · Computer Science 2021-08-02 Wenbo Ren , Jia Liu , Ness B. Shroff

Consider a multi-class labelling problem, where the labels can take values in $[k]$, and a predictor predicts a distribution over the labels. In this work, we study the following foundational question: Are there notions of multi-class…

Machine Learning · Computer Science 2024-06-11 Parikshit Gopalan , Lunjia Hu , Guy N. Rothblum

We are interested in how to design reinforcement learning agents that provably reduce the sample complexity for learning new tasks by transferring knowledge from previously-solved ones. The availability of solutions to related problems…

Machine Learning · Computer Science 2020-07-03 Andrea Tirinzoni , Riccardo Poiani , Marcello Restelli

Modeling the spread of social contagions is central to various applications in social computing. In this paper, we study the learnability of the competitive threshold model from a theoretical perspective. We demonstrate how competitive…

Machine Learning · Computer Science 2022-05-10 Yifan Wang , Guangmo Tong

Optimization problems are ubiquitous in our societies and are present in almost every segment of the economy. Most of these optimization problems are NP-hard and computationally demanding, often requiring approximate solutions for…

Optimization and Control · Mathematics 2021-06-23 James Kotary , Ferdinando Fioretto , Pascal Van Hentenryck

We introduce definitions of computable PAC learning for binary classification over computable metric spaces. We provide sufficient conditions for learners that are empirical risk minimizers (ERM) to be computable, and bound the strong…

Machine Learning · Computer Science 2021-11-30 Nathanael Ackerman , Julian Asilis , Jieqi Di , Cameron Freer , Jean-Baptiste Tristan

We show how any PAC learning algorithm that works under the uniform distribution can be transformed, in a blackbox fashion, into one that works under an arbitrary and unknown distribution $\mathcal{D}$. The efficiency of our transformation…

Machine Learning · Statistics 2023-03-31 Guy Blanc , Jane Lange , Ali Malik , Li-Yang Tan