中文
相关论文

相关论文: Tight Query Complexity Lower Bounds for PCA via Fi…

200 篇论文

We prove a \emph{query complexity} lower bound on rank-one principal component analysis (PCA). We consider an oracle model where, given a symmetric matrix $M \in \mathbb{R}^{d \times d}$, an algorithm is allowed to make $T$ \emph{exact}…

机器学习 · 计算机科学 2017-04-18 Max Simchowitz , Ahmed El Alaoui , Benjamin Recht

We investigate the computational complexity of several basic linear algebra primitives, including largest eigenvector computation and linear regression, in the computational model that allows access to the data via a matrix-vector product…

机器学习 · 计算机科学 2021-05-25 Mark Braverman , Elad Hazan , Max Simchowitz , Blake Woodworth

Minimizing a convex, quadratic objective of the form $f_{\mathbf{A},\mathbf{b}}(x) := \frac{1}{2}x^\top \mathbf{A} x - \langle \mathbf{b}, x \rangle$ for $\mathbf{A} \succ 0 $ is a fundamental problem in machine learning and optimization.…

机器学习 · 计算机科学 2019-04-17 Max Simchowitz

Given an implicit $n\times n$ matrix $A$ with oracle access $x^TA x$ for any $x\in \mathbb{R}^n$, we study the query complexity of randomized algorithms for estimating the trace of the matrix. This problem has many applications in quantum…

计算复杂性 · 计算机科学 2014-05-29 Karl Wimmer , Yi Wu , Peng Zhang

This paper studies the lower bound complexity for the optimization problem whose objective function is the average of $n$ individual smooth convex functions. We consider the algorithm which gets access to gradient and proximal oracle for…

最优化与控制 · 数学 2019-08-23 Guangzeng Xie , Luo Luo , Zhihua Zhang

In this paper, we provide tight lower bounds for the oracle complexity of minimizing high-order H\"older smooth and uniformly convex functions. Specifically, for a function whose $p^{th}$-order derivatives are H\"older continuous with…

最优化与控制 · 数学 2025-06-10 Cedar Site Bai , Brian Bullins

We provide a first-order oracle complexity lower bound for finding stationary points of min-max optimization problems where the objective function is smooth, nonconvex in the minimization variable, and strongly concave in the maximization…

最优化与控制 · 数学 2021-04-20 Haochuan Li , Yi Tian , Jingzhao Zhang , Ali Jadbabaie

We construct a family of functions suitable for establishing lower bounds on the oracle complexity of first-order minimization of smooth strongly-convex functions. Based on this construction, we derive new lower bounds on the complexity of…

最优化与控制 · 数学 2021-06-16 Yoel Drori , Adrien Taylor

We introduce a framework for proving lower bounds on computational problems over distributions against algorithms that can be implemented using access to a statistical query oracle. For such algorithms, access to the input distribution is…

计算复杂性 · 计算机科学 2016-08-16 Vitaly Feldman , Elena Grigorescu , Lev Reyzin , Santosh Vempala , Ying Xiao

The classic lower bound of Kuhn, Moscibroda and Wattenhofer [JACM 2016] states that approximate maximum matching and approximate vertex cover (among other problems) in the LOCAL model require $\Omega(\min\{\sqrt{\frac{\log n}{\log\log n}},…

数据结构与算法 · 计算机科学 2026-05-14 Peter Davies-Peck

We prove a query complexity lower bound for $\mathsf{QMA}$ protocols that solve approximate counting: estimating the size of a set given a membership oracle. This gives rise to an oracle $A$ such that $\mathsf{SBP}^A \not\subset…

计算复杂性 · 计算机科学 2019-02-08 William Kretschmer

We study the computational model where we can access a matrix $\mathbf{A}$ only by computing matrix-vector products $\mathbf{A}\mathrm{x}$ for vectors of the form $\mathrm{x} = \mathrm{x}_1 \otimes \cdots \otimes \mathrm{x}_q$. We prove…

数据结构与算法 · 计算机科学 2025-02-14 Raphael A. Meyer , William Swartworth , David P. Woodruff

We propose a sampling algorithm that achieves superior complexity bounds in all the classical settings (strongly log-concave, log-concave, Logarithmic-Sobolev inequality (LSI), Poincar\'e inequality) as well as more general settings with…

统计理论 · 数学 2023-06-29 Jiaojiao Fan , Bo Yuan , Yongxin Chen

Within a mathematically rigorous model, we analyse the curse of dimensionality for deterministic exact similarity search in the context of popular indexing schemes: metric trees. The datasets $X$ are sampled randomly from a domain $\Omega$,…

数据结构与算法 · 计算机科学 2013-03-27 Vladimir Pestov

We provide tight upper and lower bounds on the complexity of minimizing the average of $m$ convex functions using gradient and prox oracles of the component functions. We show a significant gap between the complexity of deterministic vs…

最优化与控制 · 数学 2019-04-05 Blake Woodworth , Nathan Srebro

Local search is a powerful heuristic in optimization and computer science, the complexity of which has been studied in the white box and black box models. In the black box model, we are given a graph $G = (V,E)$ and oracle access to a…

计算复杂性 · 计算机科学 2024-11-19 Simina Brânzei , Nicholas J. Recker

We prove tight lower bounds for the following variant of the counting problem considered by Aaronson, Kothari, Kretschmer, and Thaler (2020). The task is to distinguish whether an input set $x\subseteq [n]$ has size either $k$ or…

量子物理 · 物理学 2024-05-08 Aleksandrs Belovs , Ansis Rosmanis

Given a random $n \times n$ symmetric matrix $\boldsymbol W$ drawn from the Gaussian orthogonal ensemble (GOE), we consider the problem of certifying an upper bound on the maximum value of the quadratic form $\boldsymbol x^\top \boldsymbol…

数据结构与算法 · 计算机科学 2019-04-09 Afonso S. Bandeira , Dmitriy Kunisky , Alexander S. Wein

We show tight lower bounds for the entire trade-off between space and query time for the Approximate Near Neighbor search problem. Our lower bounds hold in a restricted model of computation, which captures all hashing-based approaches. In…

数据结构与算法 · 计算机科学 2016-08-22 Alexandr Andoni , Thijs Laarhoven , Ilya Razenshteyn , Erik Waingarten

The System of Linear Equations Problem (SLEP) is specified by a complex invertible matrix $A$, the condition number $\kappa$ of $A$, a vector $b$, a Hermitian matrix $M$ and an accuracy $\epsilon$, and the task is to estimate $x^\dagger…

‹ 上一页 1 2 3 10 下一页 ›