English
Related papers

Related papers: Localizability of the approximation method

200 papers

Although recent provable methods have been developed to compute preimage bounds for neural networks, their scalability is fundamentally limited by the #P-hardness of the problem. In this work, we adopt a novel probabilistic perspective,…

Machine Learning · Computer Science 2025-11-18 Luca Marzari , Manuele Bicego , Ferdinando Cicalese , Alessandro Farinelli

We prove a query complexity lower bound for $\mathsf{QMA}$ protocols that solve approximate counting: estimating the size of a set given a membership oracle. This gives rise to an oracle $A$ such that $\mathsf{SBP}^A \not\subset…

Computational Complexity · Computer Science 2019-02-08 William Kretschmer

We propose a method for improving approximate inference methods that corrects for the influence of loops in the graphical model. The method is applicable to arbitrary factor graphs, provided that the size of the Markov blankets is not too…

Artificial Intelligence · Computer Science 2011-11-10 Joris Mooij , Bert Kappen

We study the computational complexity of (deterministic or randomized) algorithms based on point samples for approximating or integrating functions that can be well approximated by neural networks. Such algorithms (most prominently…

Machine Learning · Computer Science 2021-04-08 Philipp Grohs , Felix Voigtlaender

We consider the communication complexity of some fundamental convex optimization problems in the point-to-point (coordinator) and blackboard communication models. We strengthen known bounds for approximately solving linear regression,…

Data Structures and Algorithms · Computer Science 2024-03-29 Mehrdad Ghadiri , Yin Tat Lee , Swati Padmanabhan , William Swartworth , David Woodruff , Guanghao Ye

We study a Markovian agent-based model (MABM) in this paper. Each agent is endowed with a local state that changes over time as the agent interacts with its neighbours. The neighbourhood structure is given by a graph. In a recent paper…

Probability · Mathematics 2018-04-04 Wasiur R. KhudaBukhsh , Arnab Auddy , Yann Disser , Heinz Koeppl

Due to their flexibility, frames of Hilbert spaces are attractive alternatives to bases in approximation schemes for problems where identifying a basis is not straightforward or even feasible. Computing a best approximation using frames,…

Numerical Analysis · Mathematics 2020-07-08 Ben Adcock , Mohsen Seifi

The convergence of the Conjugate Gradient method is subject to a locality limitation which imposes a lower bound on the number of iterations required before a qualitatively accurate approximation can be obtained. This limitation originates…

Numerical Analysis · Mathematics 2026-01-16 Ulrich Rüde

The question of what can be computed, and how efficiently, are at the core of computer science. Not surprisingly, in distributed systems and networking research, an equally fundamental question is what can be computed in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-01 Fabian Kuhn , Thomas Moscibroda , Roger Wattenhofer

Coherent lower previsions are general probabilistic models allowing incompletely specified probability distributions. However, for complete description of a coherent lower prevision -- even on finite underlying sample spaces -- an infinite…

Probability · Mathematics 2022-09-29 Damjan Škulj

State-of-the-art methods in convex and non-convex optimization employ higher-order derivative information, either implicitly or explicitly. We explore the limitations of higher-order optimization and prove that even for convex optimization,…

Optimization and Control · Mathematics 2017-10-31 Naman Agarwal , Elad Hazan

We prove a tight lower bound (up to constant factors) on the sample complexity of any non-interactive local differentially private protocol for optimizing a linear function over the simplex. This lower bound also implies a tight lower bound…

Cryptography and Security · Computer Science 2021-05-17 Jonathan Ullman

Circuit augmentation schemes are a family of combinatorial algorithms for linear programming that generalize the simplex method. To solve the linear program, they construct a so-called monotone circuit walk: They start at an initial vertex…

Data Structures and Algorithms · Computer Science 2025-10-03 Alexander E. Black , Christian Nöbel , Raphael Steiner

We prove lower bounds on the complexity of finding $\epsilon$-stationary points (points $x$ such that $\|\nabla f(x)\| \le \epsilon$) of smooth, high-dimensional, and potentially non-convex functions $f$. We consider oracle-based complexity…

Optimization and Control · Mathematics 2019-08-16 Yair Carmon , John C. Duchi , Oliver Hinder , Aaron Sidford

We study the complexity of fundamental distributed graph problems in the recently popular setting where information about the input graph is available to the nodes before the start of the computation. We focus on the most common such…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-03 Alkida Balliu , Thomas Boudier , Sebastian Brandt , Dennis Olivetti

We consider the problem of approximating a function in a general nonlinear subset of $L^2$, when only a weighted Monte Carlo estimate of the $L^2$-norm can be computed. Of particular interest in this setting is the concept of sample…

Numerical Analysis · Mathematics 2023-01-24 Philipp Trunschke

The goal of this work is to fill a gap in [Yang, SIAM J. Matrix Anal. Appl, 41 (2020), 1797--1825]. In that work, an approximation procedure was proposed for orthogonal low-rank tensor approximation; however, the approximation lower bound…

Optimization and Control · Mathematics 2021-01-01 Yuning Yang

Many recent studies on first-order methods (FOMs) focus on \emph{composite non-convex non-smooth} optimization with linear and/or nonlinear function constraints. Upper (or worst-case) complexity bounds have been established for these…

Optimization and Control · Mathematics 2025-05-14 Wei Liu , Qihang Lin , Yangyang Xu

Restricted non-linear approximation is a type of N-term approximation where a measure $\nu$ on the index set (rather than the counting measure) is used to control the number of terms in the approximation. We show that embeddings for…

Classical Analysis and ODEs · Mathematics 2011-08-15 Eugenio Hernández , Daniel Vera

Extremal graph theory studies the maximum or minimum number of subgraphs isomorphic to a prescribed graph under given constraints. \textit{Localization} has recently emerged as a framework that refines such problems by assigning extremal…

Combinatorics · Mathematics 2026-03-10 Rajat Adak , L. Sunil Chandran