中文
相关论文

相关论文: Agnostic learning in (almost) optimal time via Gau…

200 篇论文

What is the optimal number of independent observations from which a sparse Gaussian Graphical Model can be correctly recovered? Information-theoretic arguments provide a lower bound on the minimum number of samples necessary to perfectly…

机器学习 · 计算机科学 2018-11-20 Sidhant Misra , Marc Vuffray , Andrey Y. Lokhov

An open problem that is widely regarded as one of the most important in quantum query complexity is to resolve the quantum query complexity of the k-distinctness function on inputs of size N. While the case of k=2 (also called Element…

量子物理 · 物理学 2023-03-15 Nikhil S. Mande , Justin Thaler , Shuchen Zhu

We study the complexity of training neural network models with one hidden nonlinear activation layer and an output weighted sum layer. We analyze Gradient Descent applied to learning a bounded target function on $n$ real-valued inputs. We…

机器学习 · 计算机科学 2019-05-28 Santosh Vempala , John Wilmes

A single-index model (SIM) is a function of the form $\sigma(\mathbf{w}^{\ast} \cdot \mathbf{x})$, where $\sigma: \mathbb{R} \to \mathbb{R}$ is a known link function and $\mathbf{w}^{\ast}$ is a hidden unit vector. We study the task of…

机器学习 · 计算机科学 2024-11-11 Puqian Wang , Nikos Zarifis , Ilias Diakonikolas , Jelena Diakonikolas

We establish new exponential in dimension lower bounds for the Maximum Halfspace Discrepancy problem, which models linear classification. Both are fundamental problems in computational geometry and machine learning in their exact and…

计算几何 · 计算机科学 2026-03-20 Alexander Munteanu , Simon Omlor , Jeff M. Phillips

We prove that the list replicability number of $d$-dimensional $\gamma$-margin half-spaces satisfies \[ \frac{d}{2}+1 \le \mathrm{LR}(H^d_\gamma) \le d, \] which grows with dimension. This resolves several open problems: $\bullet$ Every…

机器学习 · 计算机科学 2025-10-27 Ari Blondal , Hamed Hatami , Pooya Hatami , Chavdar Lalov , Sivan Tretiak

We give the first agnostic, efficient, proper learning algorithm for monotone Boolean functions. Given $2^{\tilde{O}(\sqrt{n}/\varepsilon)}$ uniformly random examples of an unknown function $f:\{\pm 1\}^n \rightarrow \{\pm 1\}$, our…

数据结构与算法 · 计算机科学 2023-05-25 Jane Lange , Arsen Vasilyan

In this paper, we study the quantitative convergence of shallow neural networks trained via gradient descent to their associated Gaussian processes in the infinite-width limit. While previous work has established qualitative convergence…

机器学习 · 统计学 2026-03-06 Eloy Mosig , Andrea Agazzi , Dario Trevisan

Recent results have established dramatic advantages in learning properties of quantum states when a quantum computer is available to process or jointly measure multiple copies of the unknown quantum state. Learning tasks can be accomplished…

量子物理 · 物理学 2026-05-08 Spencer Dimitroff , John Kallaugher , Ashe Miller , Mohan Sarovar

We study the optimal scale at which real-valued function classes exhibit uniform convergence and learnability. Our main result establishes a scale-sensitive generalization of the fundamental theorem of PAC learning: for every bounded…

机器学习 · 计算机科学 2026-05-14 Shashaank Aiyer , Yishay Mansour , Shay Moran , Han Shao , Tom Waknine

Hardness results for maximum agreement problems have close connections to hardness results for proper learning in computational learning theory. In this paper we prove two hardness results for the problem of finding a low degree polynomial…

机器学习 · 计算机科学 2010-10-19 Ilias Diakonikolas , Ryan O'Donnell , Rocco A. Servedio , Yi Wu

We consider linear prediction with a convex Lipschitz loss, or more generally, stochastic convex optimization problems of generalized linear form, i.e.~where each instantaneous loss is a scalar convex function of a linear function. We show…

机器学习 · 计算机科学 2022-11-01 Idan Amir , Roi Livni , Nathan Srebro

We present a PTAS for agnostically learning halfspaces w.r.t. the uniform distribution on the $d$ dimensional sphere. Namely, we show that for every $\mu>0$ there is an algorithm that runs in time $\mathrm{poly}(d,\frac{1}{\epsilon})$, and…

数据结构与算法 · 计算机科学 2015-06-26 Amit Daniely

We consider the problem of efficiently learning mixtures of a large number of spherical Gaussians, when the components of the mixture are well separated. In the most basic form of this problem, we are given samples from a uniform mixture of…

数据结构与算法 · 计算机科学 2017-11-01 Oded Regev , Aravindan Vijayaraghavan

Operator learning, the approximation of mappings between infinite-dimensional function spaces using machine learning, has gained increasing research attention in recent years. Approximate operators, learned from data, can serve as efficient…

机器学习 · 计算机科学 2025-06-27 Ben Adcock , Michael Griebel , Gregor Maier

We revisit the problem of distribution learning within the framework of learning-augmented algorithms. In this setting, we explore the scenario where a probability distribution is provided as potentially inaccurate advice on the true,…

机器学习 · 计算机科学 2025-02-03 Arnab Bhattacharyya , Davin Choo , Philips George John , Themis Gouleakis

We give the first efficient algorithm for learning halfspaces in the testable learning model recently defined by Rubinfeld and Vasilyan (2023). In this model, a learner certifies that the accuracy of its output hypothesis is near optimal…

机器学习 · 计算机科学 2023-03-14 Aravind Gollakota , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We present a new general-purpose algorithm for learning classes of $[0,1]$-valued functions in a generalization of the prediction model, and prove a general upper bound on the expected absolute error of this algorithm in terms of a…

机器学习 · 计算机科学 2023-04-25 Peter L. Bartlett , Philip M. Long

We consider a learning problem of identifying a dictionary matrix D (M times N dimension) from a sample set of M dimensional vectors Y = N^{-1/2} DX, where X is a sparse matrix (N times P dimension) in which the density of non-zero entries…

机器学习 · 计算机科学 2014-02-06 Ayaka Sakata , Yoshiyuki Kabashima

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

机器学习 · 计算机科学 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis