English
Related papers

Related papers: Algorithmic Universality, Low-Degree Polynomials, …

200 papers

For a graph $G$, let $Z(G,\lambda)$ be the partition function of the monomer-dimer system defined by $\sum_k m_k(G)\lambda^k$, where $m_k(G)$ is the number of matchings of size $k$ in $G$. We consider graphs of bounded degree and develop a…

Data Structures and Algorithms · Computer Science 2013-09-05 Marc Lelarge , Hang Zhou

We prove a universal approximation property (UAP) for a class of ODENet and a class of ResNet, which are simplified mathematical models for deep learning systems with skip connections. The UAP can be stated as follows. Let $n$ and $m$ be…

Machine Learning · Computer Science 2023-05-19 Yuto Aizawa , Masato Kimura , Kazunori Matsui

One fundamental problem in decentralized multi-agent optimization is the trade-off between gradient/sampling complexity and communication complexity. We propose new algorithms whose gradient and sampling complexities are graph topology…

Optimization and Control · Mathematics 2021-01-14 Guanghui Lan , Yuyuan Ouyang , Yi Zhou

We present the first linear time complexity randomized algorithms for unbiased approximation of the celebrated family of general random walk kernels (RWKs) for sparse graphs. This includes both labelled and unlabelled instances. The…

Machine Learning · Computer Science 2024-10-16 Krzysztof Choromanski , Isaac Reid , Arijit Sehanobish , Avinava Dubey

The concept of universality has shaped our understanding of many-body physics, but is mostly limited to homogenous systems. Here, we present a study of universality on a non-homogeneous graph, the long-range diluted graph (LRDG). Its…

Statistical Mechanics · Physics 2024-05-21 Giacomo Bighin , Tilman Enss , Nicolò Defenu

A common sparse linear regression formulation is the l1 regularized least squares, which is also known as least absolute shrinkage and selection operator (LASSO). Approximate message passing (AMP) has been proved to asymptotically achieve…

Information Theory · Computer Science 2021-07-01 Yanting Ma , Min Kang , Jack W. Silverstein , Dror Baron

In 1999, Brodal and Fagerberg (BF) gave an algorithm for maintaining a low outdegree orientation of a dynamic uniformly sparse graph. Specifically, for a dynamic graph on $n$-vertices, with arboricity bounded by $\alpha$ at all times, the…

Data Structures and Algorithms · Computer Science 2018-02-27 Haim Kaplan , Shay Solomon

Bidimensionality is the most common technique to design subexponential-time parameterized algorithms on special classes of graphs, particularly planar graphs. The core engine behind it is a combinatorial lemma of Robertson, Seymour and…

Data Structures and Algorithms · Computer Science 2019-03-05 Fedor V. Fomin , Daniel Lokshtanov , Fahad Panolan , Saket Saurabh , Meirav Zehavi

This article presents a new search algorithm for the NP-hard problem of optimizing functions of binary variables that decompose according to a graphical model. It can be applied to models of any order and structure. The main novelty is a…

Data Structures and Algorithms · Computer Science 2010-09-22 Bjoern Andres , Joerg H. Kappes , Ullrich Koethe , Fred A. Hamprecht

We consider decision problems for deterministic pushdown automata over a unary alphabet (udpda, for short). Udpda are a simple computation model that accept exactly the unary regular languages, but can be exponentially more succinct than…

Formal Languages and Automata Theory · Computer Science 2014-03-04 Dmitry Chistikov , Rupak Majumdar

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem…

Machine Learning · Statistics 2013-07-19 Qiang Liu , Alexander Ihler

This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees.…

Systems and Control · Electrical Eng. & Systems 2022-11-17 Vivek Khatana , Murti V. Salapaka

In this work we produce a framework for constructing universal function approximators on graph isomorphism classes. We prove how this framework comes with a collection of theoretically desirable properties and enables novel analysis. We…

Data Structures and Algorithms · Computer Science 2020-10-27 Rickard Brüel-Gabrielsson

We initiate the study of approximation algorithms and computational barriers for constructing sparse $\alpha$-navigable graphs [IX23, DGM+24], a core primitive underlying recent advances in graph-based nearest neighbor search. Given an…

Data Structures and Algorithms · Computer Science 2025-07-21 Sanjeev Khanna , Ashwin Padaki , Erik Waingarten

We consider the problem of approximating the reachability probabilities in Markov decision processes (MDP) with uncountable (continuous) state and action spaces. While there are algorithms that, for special classes of such MDP, provide a…

Systems and Control · Electrical Eng. & Systems 2022-07-13 Kush Grover , Jan Křetínský , Tobias Meggendorfer , Maximilian Weininger

In this work we consider the problem of fitting Random Utility Models (RUMs) to user choices. Given the winner distributions of the subsets of size $k$ of a universe, we obtain a polynomial-time algorithm that finds the RUM that best…

Machine Learning · Computer Science 2023-05-23 Flavio Chierichetti , Mirko Giacchini , Ravi Kumar , Alessandro Panconesi , Andrew Tomkins

There has been significant recent progress on algorithms for approximating graph spanners, i.e., algorithms which approximate the best spanner for a given input graph. Essentially all of these algorithms use the same basic LP relaxation, so…

Computational Complexity · Computer Science 2019-05-21 Michael Dinitz , Yasamin Nazari , Zeyu Zhang

The present paper studies local distributed graph problems in highly dynamic networks. Communication and changes of the graph happen in synchronous rounds and our algorithms always, i.e., in every round, satisfy non-trivial guarantees, no…

Data Structures and Algorithms · Computer Science 2018-12-10 Philipp Bamberger , Fabian Kuhn , Yannic Maus