中文
相关论文

相关论文: Improved sample complexity bound for sample-based …

200 篇论文

The problem of learning threshold functions is a fundamental one in machine learning. Classical learning theory implies sample complexity of $O(\xi^{-1} \log(1/\beta))$ (for generalization error $\xi$ with confidence $1-\beta$). The private…

机器学习 · 计算机科学 2022-11-14 Edith Cohen , Xin Lyu , Jelani Nelson , Tamás Sarlós , Uri Stemmer

In this paper, we propose a new, simplified high probability analysis of AdaGrad for smooth, non-convex problems. More specifically, we focus on a particular accelerated gradient (AGD) template (Lan, 2020), through which we recover the…

最优化与控制 · 数学 2022-04-07 Ali Kavis , Kfir Yehuda Levy , Volkan Cevher

We resolve the open question regarding the sample complexity of policy learning for maximizing the long-run average reward associated with a uniformly ergodic Markov decision process (MDP), assuming a generative model. In this context, the…

机器学习 · 计算机科学 2024-02-14 Shengbo Wang , Jose Blanchet , Peter Glynn

We study monotonicity testing of functions $f \colon \{0,1\}^d \to \{0,1\}$ using sample-based algorithms, which are only allowed to observe the value of $f$ on points drawn independently from the uniform distribution. A classic result by…

数据结构与算法 · 计算机科学 2024-08-21 Hadley Black

We consider the problem of performing linear regression over a stream of $d$-dimensional examples, and show that any algorithm that uses a subquadratic amount of memory exhibits a slower rate of convergence than can be achieved without…

机器学习 · 计算机科学 2020-10-13 Vatsal Sharan , Aaron Sidford , Gregory Valiant

Multi-distribution learning (MDL), which seeks to learn a shared model that minimizes the worst-case risk across $k$ distinct data distributions, has emerged as a unified framework in response to the evolving demand for robustness,…

机器学习 · 计算机科学 2025-08-12 Zihan Zhang , Wenhao Zhan , Yuxin Chen , Simon S. Du , Jason D. Lee

We give a lower bound on the iteration complexity of a natural class of Lagrangean-relaxation algorithms for approximately solving packing/covering linear programs. We show that, given an input with $m$ random 0/1-constraints on $n$…

数据结构与算法 · 计算机科学 2015-11-23 Phil Klein , Neal E. Young

We study differentially private (DP) optimization algorithms for stochastic and empirical objectives which are neither smooth nor convex, and propose methods that return a Goldstein-stationary point with sample complexity bounds that…

机器学习 · 计算机科学 2025-06-10 Guy Kornowski , Daogao Liu , Kunal Talwar

We provide a new upper bound for sampling numbers $(g_n)_{n\in \mathbb{N}}$ associated to the compact embedding of a separable reproducing kernel Hilbert space into the space of square integrable functions. There are universal constants…

数值分析 · 数学 2021-02-11 Nicolas Nagel , Martin Schäfer , Tino Ullrich

In this work we analyze the sample complexity of classification by differentially private algorithms. Differential privacy is a strong and well-studied notion of privacy introduced by Dwork et al. (2006) that ensures that the output of an…

数据结构与算法 · 计算机科学 2015-09-15 Vitaly Feldman , David Xiao

This note extends the results of classical parametric statistics like Fisher and Wilks theorem to modern setups with a high or infinite parameter dimension, limited sample size, and possible model misspecification. We consider a special…

统计理论 · 数学 2025-06-09 Vladimir Spokoiny

A new framework is introduced for examining and evaluating the fundamental limits of lossless data compression, that emphasizes genuinely non-asymptotic results. The {\em sample complexity} of compressing a given source is defined as the…

信息论 · 计算机科学 2026-04-16 Terence Viaud , Ioannis Kontoyiannis

In this paper, we consider the related problems of multicalibration -- a multigroup fairness notion and omniprediction -- a simultaneous loss minimization paradigm, both in the distributional and online settings. The recent work of Garg et…

机器学习 · 计算机科学 2025-05-29 Haipeng Luo , Spandan Senapati , Vatsal Sharan

Quantum phase estimation (QPE) and Lindbladian dynamics are both foundational in quantum information science and central to quantum algorithm design. In this work, we bridge these two concepts: certain simple Lindbladian processes can be…

量子物理 · 物理学 2025-11-18 Zhong-Xia Shang , Naixu Guo , Patrick Rebentrost , Alán Aspuru-Guzik , Tongyang Li , Qi Zhao

Group-invariant probability distributions appear in many data-generative models in machine learning, such as graphs, point clouds, and images. In practice, one often needs to estimate divergences between such distributions. In this work, we…

机器学习 · 计算机科学 2026-02-05 Behrooz Tahmasebi , Stefanie Jegelka

We revisit the identification of an $\varepsilon$-optimal policy in average-reward Markov Decision Processes (MDP). In such MDPs, two measures of complexity have appeared in the literature: the diameter, $D$, and the optimal bias span, $H$,…

机器学习 · 计算机科学 2024-05-28 Adrienne Tuynman , Rémy Degenne , Emilie Kaufmann

Multivariate quantum signal processing (M-QSP) has recently been shown to be applicable for non-Hermitian Hamiltonian simulation, opening several problems regarding the optimization landscape, angle-finding, and constant-factor analysis. We…

量子物理 · 物理学 2026-05-14 Joshua M. Courtney

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

机器学习 · 计算机科学 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

As often emerges in various basic quantum properties such as R\'enyi and Tsallis entropies, the trace of quantum state powers $\text{tr}(\rho^q)$ has attracted a lot of attention. The recent work of Liu and Wang (SODA 2025) showed that,…

量子物理 · 物理学 2026-04-03 Kean Chen , Yupan Liu , Qisheng Wang

Understanding the precise interaction mechanisms between quantum systems and their environment is crucial for advancing stable quantum technologies, designing reliable experimental frameworks, and building accurate models of real-world…