中文
相关论文

相关论文: Scale-Sensitive Shattering: Learnability and Evalu…

200 篇论文

We consider neural networks (NNs) where the final layer is down-scaled by a fixed hyperparameter $\gamma$. Recent work has identified $\gamma$ as controlling the strength of feature learning. As $\gamma$ increases, network evolution changes…

机器学习 · 计算机科学 2025-03-04 Alexander Atanasov , Alexandru Meterez , James B. Simon , Cengiz Pehlevan

We introduce SCAL, an algorithm designed to perform efficient exploration-exploitation in any unknown weakly-communicating Markov decision process (MDP) for which an upper bound $c$ on the span of the optimal bias function is known. For an…

机器学习 · 计算机科学 2018-07-09 Ronan Fruit , Matteo Pirotta , Alessandro Lazaric , Ronald Ortner

We establish optimal Statistical Query (SQ) lower bounds for robustly learning certain families of discrete high-dimensional distributions. In particular, we show that no efficient SQ algorithm with access to an $\epsilon$-corrupted binary…

数据结构与算法 · 计算机科学 2022-06-10 Ilias Diakonikolas , Daniel M. Kane , Yuxin Sun

We study exact active learning of binary and multiclass classifiers with margin. Given an $n$-point set $X \subset \mathbb{R}^m$, we want to learn any unknown classifier on $X$ whose classes have finite strong convex hull margin, a new…

机器学习 · 计算机科学 2022-09-12 Marco Bressan , Nicolò Cesa-Bianchi , Silvio Lattanzi , Andrea Paudice , Maximilian Thiessen

In this paper, we consider the problem of replicable realizable PAC learning. We construct a particularly hard learning problem and show a sample complexity lower bound with a close to $(\log|H|)^{3/2}$ dependence on the size of the…

机器学习 · 计算机科学 2026-02-24 Kasper Green Larsen , Markus Engelund Mathiasen , Chirag Pabbaraju , Clement Svendsen

We study two-to-two scattering amplitudes of a scalar particle of mass $m$. For simplicity, we assume the presence of $\mathbb{Z}_2$ symmetry and that the particle is $\mathbb{Z}_2$ odd. We consider two classes of amplitudes: the fully…

高能物理 - 理论 · 物理学 2023-01-04 Hongbin Chen , A. Liam Fitzpatrick , Denis Karateev

We show that $n$-variable tree-structured Ising models can be learned computationally-efficiently to within total variation distance $\epsilon$ from an optimal $O(n \ln n/\epsilon^2)$ samples, where $O(\cdot)$ hides an absolute constant…

机器学习 · 计算机科学 2020-12-01 Constantinos Daskalakis , Qinxuan Pan

Binary classification in the classic PAC model exhibits a curious phenomenon: Empirical Risk Minimization (ERM) learners are suboptimal in the realizable case yet optimal in the agnostic case. Roughly speaking, this owes itself to the fact…

机器学习 · 计算机科学 2025-12-22 Julian Asilis , Mikael Møller Høgsgaard , Grigoris Velegkas

In this article we give several new results on the complexity of algorithms that learn Boolean functions from quantum queries and quantum examples. Hunziker et al. conjectured that for any class C of Boolean functions, the number of quantum…

量子物理 · 物理学 2007-05-23 Alp Atici , Rocco A. Servedio

We study several questions in the reliable agnostic learning framework of Kalai et al. (2009), which captures learning tasks in which one type of error is costlier than others. A positive reliable classifier is one that makes no false…

机器学习 · 计算机科学 2014-02-25 Varun Kanade , Justin Thaler

We devise a geometric description of bounded systems at criticality in any dimension $d$. This is achieved by altering the flat metric with a space dependent scale factor $\gamma(x)$, $x$ belonging to a general bounded domain $\Omega$.…

统计力学 · 物理学 2020-07-09 Giacomo Gori , Andrea Trombettoni

We study the problem of learning Single-Index Models under the $L_2^2$ loss in the agnostic model. We give an efficient learning algorithm, achieving a constant factor approximation to the optimal loss, that succeeds under a range of…

机器学习 · 计算机科学 2024-02-28 Nikos Zarifis , Puqian Wang , Ilias Diakonikolas , Jelena Diakonikolas

In this paper we study the approximate learnability of valuations commonly used throughout economics and game theory for the quantitative encoding of agent preferences. We provide upper and lower bounds regarding the learnability of…

计算机科学与博弈论 · 计算机科学 2011-09-05 Maria Florina Balcan , Florin Constantin , Satoru Iwata , Lei Wang

$ \newcommand{\eps}{\varepsilon} $In learning theory, the VC dimension of a concept class $C$ is the most common way to measure its "richness." In the PAC model $$ \Theta\Big(\frac{d}{\eps} + \frac{\log(1/\delta)}{\eps}\Big) $$ examples are…

量子物理 · 物理学 2017-06-08 Srinivasan Arunachalam , Ronald de Wolf

We show hardness of improperly learning halfspaces in the agnostic model, both in the distribution-independent as well as the distribution-specific setting, based on the assumption that worst-case lattice problems, such as GapSVP or SIVP,…

机器学习 · 计算机科学 2023-02-21 Stefan Tiegel

We study efficient PAC learning of homogeneous halfspaces in $\mathbb{R}^d$ in the presence of malicious noise of Valiant (1985). This is a challenging noise model and only until recently has near-optimal noise tolerance bound been…

机器学习 · 计算机科学 2021-10-06 Jie Shen

The goal of a learning algorithm is to receive a training data set as input and provide a hypothesis that can generalize to all possible data points from a domain set. The hypothesis is chosen from hypothesis classes with potentially…

机器学习 · 统计学 2023-03-29 Soosan Beheshti , Mahdi Shamsi

In this paper we study complete manifolds equipped with smooth measures whose spectrum of the weighted Laplacian has an optimal positive lower bound and the $m$-dimensional Bakry-\'Emery Ricci curvature is bounded from below by some…

微分几何 · 数学 2012-08-23 Jia-Yong Wu

Let $\mathscr{F}_{n,d}$ be the class of all functions $f:\{-1,1\}^n\to[-1,1]$ on the $n$-dimensional discrete hypercube of degree at most $d$. In the first part of this paper, we prove that any (deterministic or randomized) algorithm which…

机器学习 · 计算机科学 2024-10-23 Alexandros Eskenazis , Paata Ivanisvili , Lauritz Streck

In reinforcement learning, the classic objectives of maximizing discounted and finite-horizon cumulative rewards are PAC-learnable: There are algorithms that learn a near-optimal policy with high probability using a finite amount of samples…

机器学习 · 计算机科学 2023-07-04 Cambridge Yang , Michael Littman , Michael Carbin