中文
相关论文

相关论文: A PTAS for Agnostically Learning Halfspaces

200 篇论文

We present an algorithm for testing halfspaces over arbitrary, unknown rotation-invariant distributions. Using $\tilde O(\sqrt{n}\epsilon^{-7})$ random examples of an unknown function $f$, the algorithm determines with high probability…

数据结构与算法 · 计算机科学 2018-11-02 Nathaniel Harms

We study active learning of homogeneous $s$-sparse halfspaces in $\mathbb{R}^d$ under the setting where the unlabeled data distribution is isotropic log-concave and each label is flipped with probability at most $\eta$ for a parameter $\eta…

机器学习 · 计算机科学 2021-08-16 Chicheng Zhang , Jie Shen , Pranjal Awasthi

We develop a framework for obtaining polynomial time approximation schemes (PTAS) for a class of stochastic dynamic programs. Using our framework, we obtain the first PTAS for the following stochastic combinatorial optimization problems:…

数据结构与算法 · 计算机科学 2018-05-22 Hao Fu , Jian Li , Pan Xu

We give the first dimension-efficient algorithms for learning Rectified Linear Units (ReLUs), which are functions of the form $\mathbf{x} \mapsto \max(0, \mathbf{w} \cdot \mathbf{x})$ with $\mathbf{w} \in \mathbb{S}^{n-1}$. Our algorithm…

机器学习 · 计算机科学 2016-12-06 Surbhi Goel , Varun Kanade , Adam Klivans , Justin Thaler

This paper is concerned with computationally efficient learning of homogeneous sparse halfspaces in $\mathbb{R}^d$ under noise. Though recent works have established attribute-efficient learning algorithms under various types of label noise…

机器学习 · 统计学 2021-03-03 Jie Shen , Chicheng Zhang

We give an algorithm for properly learning Poisson binomial distributions. A Poisson binomial distribution (PBD) of order $n$ is the discrete probability distribution of the sum of $n$ mutually independent Bernoulli random variables. Given…

数据结构与算法 · 计算机科学 2015-11-13 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We analyze the properties of adversarial training for learning adversarially robust halfspaces in the presence of agnostic label noise. Denoting $\mathsf{OPT}_{p,r}$ as the best robust classification error achieved by a halfspace that is…

机器学习 · 计算机科学 2021-04-20 Difan Zou , Spencer Frei , Quanquan Gu

We give the first almost optimal polynomial-time proper learning algorithm of Boolean sparse multivariate polynomial under the uniform distribution. For $s$-sparse polynomial over $n$ variables and $\epsilon=1/s^\beta$, $\beta>1$, our…

机器学习 · 计算机科学 2022-02-08 Nader H. Bshouty

We consider a problem which has received considerable attention in systems literature because of its applications to routing in delay tolerant networks and replica placement in distributed storage systems. In abstract terms the problem can…

数据结构与算法 · 计算机科学 2013-07-16 Constantinos Daskalakis , Anindya De , Ilias Diakonikolas , Ankur Moitra , Rocco A. Servedio

In recent years, the crucial importance of metrics in machine learning algorithms has led to an increasing interest for optimizing distance and similarity functions. Most of the state of the art focus on learning Mahalanobis distances…

机器学习 · 计算机科学 2019-01-25 Aurelien Bellet , Amaury Habrard , Marc Sebban

We provide an algorithm for properly learning mixtures of two single-dimensional Gaussians without any separability assumptions. Given $\tilde{O}(1/\varepsilon^2)$ samples from an unknown mixture, our algorithm outputs a mixture that is…

数据结构与算法 · 计算机科学 2014-05-20 Constantinos Daskalakis , Gautam Kamath

We study the problem of computationally and label efficient PAC active learning $d$-dimensional halfspaces with Tsybakov Noise~\citep{tsybakov2004optimal} under structured unlabeled data distributions. Inspired…

机器学习 · 计算机科学 2024-07-23 Yinan Li , Chicheng Zhang

We show how any PAC learning algorithm that works under the uniform distribution can be transformed, in a blackbox fashion, into one that works under an arbitrary and unknown distribution $\mathcal{D}$. The efficiency of our transformation…

机器学习 · 统计学 2023-03-31 Guy Blanc , Jane Lange , Ali Malik , Li-Yang Tan

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

机器学习 · 计算机科学 2025-02-18 Jie Shen

We consider active learning for binary classification in the agnostic pool-based setting. The vast majority of works in active learning in the agnostic setting are inspired by the CAL algorithm where each query is uniformly sampled from the…

机器学习 · 计算机科学 2021-05-17 Julian Katz-Samuels , Jifan Zhang , Lalit Jain , Kevin Jamieson

We study the task of testable learning of general -- not necessarily homogeneous -- halfspaces with adversarial label noise with respect to the Gaussian distribution. In the testable learning framework, the goal is to develop a…

机器学习 · 计算机科学 2024-09-02 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Nikos Zarifis

We consider the Partition problem and propose a deterministic FPTAS (Fully Polynomial-Time Approximation Scheme) that runs in $\widetilde{O}(n + 1/\varepsilon)$-time. This is the best possible (up to a polylogarithmic factor) assuming the…

数据结构与算法 · 计算机科学 2025-01-23 Lin Chen , Jiayi Lian , Yuchen Mao , Guochuan Zhang

We give the first polynomial-time approximation scheme (PTAS) for the stochastic load balancing problem when the job sizes follow Poisson distributions. This improves upon the 2-approximation algorithm due to Goel and Indyk (FOCS'99).…

数据结构与算法 · 计算机科学 2020-06-24 Anindya De , Sanjeev Khanna , Huan Li , Hesam Nikpey

We study the complexity of PAC learning halfspaces in the presence of Massart noise. In this problem, we are given i.i.d. labeled examples $(\mathbf{x}, y) \in \mathbb{R}^N \times \{ \pm 1\}$, where the distribution of $\mathbf{x}$ is…

机器学习 · 计算机科学 2022-07-29 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi , Lisheng Ren

We study the problem of PAC learning $\gamma$-margin halfspaces in the presence of Massart noise. Without computational considerations, the sample complexity of this learning problem is known to be $\widetilde{\Theta}(1/(\gamma^2…

机器学习 · 计算机科学 2025-01-17 Ilias Diakonikolas , Nikos Zarifis