中文
相关论文

相关论文: On PAC Learning Halfspaces in Non-interactive Loca…

200 篇论文

We consider the problem of PAC-learning from distributed data and analyze fundamental communication complexity questions involved. We provide general upper and lower bounds on the amount of communication needed to learn well, showing that…

机器学习 · 计算机科学 2012-05-28 Maria-Florina Balcan , Avrim Blum , Shai Fine , Yishay Mansour

We continue the study of the computational complexity of differentially private PAC learning and how it is situated within the foundations of machine learning. A recent line of work uncovered a qualitative equivalence between the private…

机器学习 · 计算机科学 2024-02-20 Mark Bun , Aloni Cohen , Rathin Desai

We study the sample complexity of learning threshold functions under the constraint of differential privacy. It is assumed that each labeled example in the training data is the information of one individual and we would like to come up with…

数据结构与算法 · 计算机科学 2019-11-25 Haim Kaplan , Katrina Ligett , Yishay Mansour , Moni Naor , Uri Stemmer

Learning problems form an important category of computational tasks that generalizes many of the computations researchers apply to large real-life data sets. We ask: what concept classes can be learned privately, namely, by an algorithm…

机器学习 · 计算机科学 2012-10-10 Shiva Prasad Kasiviswanathan , Homin K. Lee , Kobbi Nissim , Sofya Raskhodnikova , Adam Smith

In recent years the framework of learning from label proportions (LLP) has been gaining importance in machine learning. In this setting, the training examples are aggregated into subsets or bags and only the average label per bag is…

计算复杂性 · 计算机科学 2024-03-29 Venkatesan Guruswami , Rishi Saket

We develop a framework using Hilbert spaces as a proxy to analyze PAC learning problems with structural properties. We consider a joint Hilbert space incorporating the relation between the true label and the predictor under a joint…

机器学习 · 计算机科学 2021-02-15 Mohsen Heidari , Wojciech Szpankowski

We study the problem of computationally and label efficient PAC active learning $d$-dimensional halfspaces with Tsybakov Noise~\citep{tsybakov2004optimal} under structured unlabeled data distributions. Inspired…

机器学习 · 计算机科学 2024-07-23 Yinan Li , Chicheng Zhang

Identifying low-dimensional latent structures within high-dimensional data has long been a central topic in the machine learning community, driven by the need for data compression, storage, transmission, and deeper data understanding.…

机器学习 · 统计学 2025-03-28 Ye Tian , Sanyou Wu , Long Feng

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces under the Gaussian distribution on $R^d$ in the presence of some form of query access. In the classical pool-based active learning model, where the…

机器学习 · 计算机科学 2025-01-03 Ilias Diakonikolas , Daniel M. Kane , Mingchen Ma

In this paper we revisit some classic problems on classification under misspecification. In particular, we study the problem of learning halfspaces under Massart noise with rate $\eta$. In a recent work, Diakonikolas, Goulekakis, and Tzamos…

机器学习 · 计算机科学 2023-09-21 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

The collection of individuals' data has become commonplace in many industries. Local differential privacy (LDP) offers a rigorous approach to preserving privacy whereby the individual privatises their data locally, allowing only their…

机器学习 · 计算机科学 2022-05-17 Alex Mansbridge , Gregory Barbour , Davide Piras , Michael Murray , Christopher Frye , Ilya Feige , David Barber

Robust learning in expressive languages with real-world data continues to be a challenging task. Numerous conventional methods appeal to heuristics without any assurances of robustness. While probably approximately correct (PAC) Semantics…

人工智能 · 计算机科学 2021-09-08 Alexander P. Rader , Ionela G. Mocanu , Vaishak Belle , Brendan Juba

Noise-tolerant PAC learning of linear models has been of central interests in machine learning community since the last century. In recent years, many computationally-efficient algorithms have been proposed for the problem of learning…

机器学习 · 计算机科学 2026-05-19 Rita Adhikari , Shiwei Zeng

We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a…

机器学习 · 计算机科学 2023-03-10 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

We study model personalization under user-level differential privacy (DP) in the shared representation framework. In this problem, there are $n$ users whose data is statistically heterogeneous, and their optimal parameters share an unknown…

机器学习 · 计算机科学 2025-06-25 Conor Snedeker , Xinyu Zhou , Raef Bassily

We study the problem of efficient PAC active learning of homogeneous linear classifiers (halfspaces) in $\mathbb{R}^d$, where the goal is to learn a halfspace with low error using as few label queries as possible. Under the extra assumption…

机器学习 · 计算机科学 2018-06-05 Chicheng Zhang

We study non-convex empirical risk minimization for learning halfspaces and neural networks. For loss functions that are $L$-Lipschitz continuous, we present algorithms to learn halfspaces and multi-layer neural networks that achieve…

机器学习 · 计算机科学 2015-11-26 Yuchen Zhang , Jason D. Lee , Martin J. Wainwright , Michael I. Jordan

We study the task of testable learning of general -- not necessarily homogeneous -- halfspaces with adversarial label noise with respect to the Gaussian distribution. In the testable learning framework, the goal is to develop a…

机器学习 · 计算机科学 2024-09-02 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Nikos Zarifis

In Semi-Supervised Semi-Private (SP) learning, the learner has access to both public unlabelled and private labelled data. We propose a computationally efficient algorithm that, under mild assumptions on the data, provably achieves…

机器学习 · 计算机科学 2023-06-08 Francesco Pinto , Yaxi Hu , Fanny Yang , Amartya Sanyal

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

机器学习 · 计算机科学 2025-02-18 Jie Shen