English
Related papers

Related papers: Geometric Barriers for Stable and Online Algorithm…

200 papers

The symmetric binary perceptron ($\texttt{SBP}$) exhibits a dramatic statistical-to-computational gap: the densities at which known efficient algorithms find solutions are far below the threshold for the existence of solutions. Furthermore,…

Computational Complexity · Computer Science 2022-03-30 David Gamarnik , Eren C. Kızıldağ , Will Perkins , Changji Xu

The problem of optimizing over random structures emerges in many areas of science and engineering, ranging from statistical physics to machine learning and artificial intelligence. For many such structures finding optimal solutions by means…

Computational Complexity · Computer Science 2022-10-12 David Gamarnik

We study the algorithmic problem of finding a large independent set in the Erd{\"o}s-R\'{e}nyi random graph $G(n,p)$. For constant $p$ and $b=1/(1-p)$, the largest independent set has size $2\log_b n$, while a simple greedy algorithm -…

Data Structures and Algorithms · Computer Science 2026-02-03 David Gamarnik , Eren C. Kızıldağ , Lutz Warnke

We consider the algorithmic problem of finding a near-optimal solution for the number partitioning problem (NPP). The NPP appears in many applications, including the design of randomized controlled trials, multiprocessor scheduling, and…

Statistics Theory · Mathematics 2021-03-03 David Gamarnik , Eren C. Kızıldağ

In [97,99,100], an fl-RDT framework is introduced to characterize \emph{statistical computational gaps} (SCGs). Studying \emph{symmetric binary perceptrons} (SBPs), [100] obtained an \emph{algorithmic} threshold estimate $\alpha_a\approx…

Machine Learning · Computer Science 2026-04-22 Mihailo Stojnic

In this work, we show that for all statistical estimation problems, a natural MMSE instability (discontinuity) condition implies the failure of stable algorithms, serving as a version of OGP for estimation tasks. Using this criterion, we…

Statistics Theory · Mathematics 2026-03-24 Xifan Yu , Ilias Zadik

We introduce a model of online algorithms subject to strict constraints on data retention. An online learning algorithm encounters a stream of data points, one per round, generated by some stationary process. Crucially, each data point can…

Machine Learning · Computer Science 2024-04-18 Nicole Immorlica , Brendan Lucier , Markus Mobius , James Siderius

We study the binary perceptron, a random constraint satisfaction problem that asks to find a Boolean vector in the intersection of independently chosen random halfspaces. A striking feature of this model is that at every positive constraint…

Computational Complexity · Computer Science 2026-04-02 Shuyang Gong , Brice Huang , Shuangping Li , Mark Sellke

This paper is motivated by recent research in the $d$-dimensional stochastic linear bandit literature, which has revealed an unsettling discrepancy: algorithms like Thompson sampling and Greedy demonstrate promising empirical performance,…

Machine Learning · Computer Science 2025-05-20 Yuwei Luo , Mohsen Bayati

We study the matrix discrepancy problem in the average-case setting. Given a sequence of $m \times m$ symmetric matrices $A_1,\ldots,A_n$, its discrepancy is defined as the minimal spectral norm over all signed sums $\sum_{i=1}^n x_iA_i$…

Probability · Mathematics 2025-10-07 Dmitriy Kunisky , Timm Oertel , Nicola Wengiel , Peiyuan Zhang

Online algorithms that allow a small amount of migration or recourse have been intensively studied in the last years. They are essential in the design of competitive algorithms for dynamic problems, where objects can also depart from the…

Data Structures and Algorithms · Computer Science 2019-05-21 Sebastian Berndt , Valentin Dreismann , Kilian Grage , Klaus Jansen , Ingmar Knof

This paper focuses on designing edge-weighted networks, whose robustness is characterized by maximizing algebraic connectivity, or the second smallest eigenvalue of the Laplacian matrix. This problem is motivated by cooperative vehicle…

Systems and Control · Electrical Eng. & Systems 2024-03-20 Neelkamal Somisetty , Harsha Nagarajan , Swaroop Darbha

We study the algorithmic tractability of finding large independent sets in dense random hypergraphs. In the sparse regime, much of the natural algorithms can be formulated within either the local or the low-degree polynomial (LDP)…

Data Structures and Algorithms · Computer Science 2026-05-08 Abhishek Dhawan , Nhi U. Dinh , Eren C. Kızıldağ , Neeladri Maitra , Bayram A. Şahin

We study the minimum backlog problem (MBP). This online problem arises, e.g., in the context of sensor networks. We focus on two main variants of MBP. The discrete MBP is a 2-person game played on a graph $G=(V,E)$. The player is initially…

This paper considers the stability of online learning algorithms and its implications for learnability (bounded regret). We introduce a novel quantity called {\em forward regret} that intuitively measures how good an online learning…

Machine Learning · Computer Science 2012-11-28 Ankan Saha , Prateek Jain , Ambuj Tewari

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

We consider an online vector balancing question where $T$ vectors, chosen from an arbitrary distribution over $[-1,1]^n$, arrive one-by-one and must be immediately given a $\pm$ sign. The goal is to keep the discrepancy small as possible. A…

Data Structures and Algorithms · Computer Science 2020-04-14 Nikhil Bansal , Haotian Jiang , Sahil Singla , Makrand Sinha

The overlap gap property (OGP) is a statement about the geometry of near-optimal solutions. Exhibiting OGP implies failure of a class of local algorithms; and has been observed to coincide with conjectured algorithmic limits in problems…

The problem of finding a path between two points while avoiding obstacles is critical in robotic path planning. We focus on the feasibility problem: determining whether such a path exists. We model the robot as a query-specific rectangular…

Computational Geometry · Computer Science 2025-04-16 Alex Fan , Alicia Li , Arul Kolla , Jason Gonzalez

Exploiting geometric structure to improve the asymptotic complexity of discrete assignment problems is a well-studied subject. In contrast, the practical advantages of using geometry for such problems have not been explored. We implement…

Computational Geometry · Computer Science 2016-06-13 Michael Kerber , Dmitriy Morozov , Arnur Nigmetov
‹ Prev 1 2 3 10 Next ›