English
Related papers

Related papers: On the hardness of learning sparse parities

200 papers

Permutation patterns and pattern avoidance have been intensively studied in combinatorics and computer science, going back at least to the seminal work of Knuth on stack-sorting (1968). Perhaps the most natural algorithmic question in this…

Data Structures and Algorithms · Computer Science 2019-08-14 Benjamin Aram Berendsohn , László Kozma , Dániel Marx

Similarity and metric learning provides a principled approach to construct a task-specific similarity from weakly supervised data. However, these methods are subject to the curse of dimensionality: as the number of features grows large,…

Machine Learning · Statistics 2019-09-10 Kuan Liu , Aurélien Bellet

We study the complexity of PAC learning halfspaces in the presence of Massart noise. In this problem, we are given i.i.d. labeled examples $(\mathbf{x}, y) \in \mathbb{R}^N \times \{ \pm 1\}$, where the distribution of $\mathbf{x}$ is…

Machine Learning · Computer Science 2022-07-29 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi , Lisheng Ren

We study the square root bottleneck in the recovery of sparse vectors from quadratic equations. It is acknowledged that a sparse vector $ \mathbf x_0\in \mathbb{R}^n$, $\| \mathbf x_0\|_0 = k$ can in theory be recovered from as few as…

Information Theory · Computer Science 2024-12-30 Augustin Cosse

A fundamental question in reinforcement learning theory is: suppose the optimal value functions are linear in given features, can we learn them efficiently? This problem's counterpart in supervised learning, linear regression, can be solved…

Machine Learning · Computer Science 2023-02-28 Daniel Kane , Sihan Liu , Shachar Lovett , Gaurav Mahajan , Csaba Szepesvári , Gellért Weisz

We study the problem of \emph{robust satisfiability} of systems of nonlinear equations, namely, whether for a given continuous function $f:\,K\to\mathbb{R}^n$ on a~finite simplicial complex $K$ and $\alpha>0$, it holds that each function…

Computational Complexity · Computer Science 2014-02-05 Peter Franek , Marek Krcal

We consider the problem of computing the k-sparse approximation to the discrete Fourier transform of an n-dimensional signal. We show: * An O(k log n)-time randomized algorithm for the case where the input signal has at most k non-zero…

Data Structures and Algorithms · Computer Science 2012-04-09 Haitham Hassanieh , Piotr Indyk , Dina Katabi , Eric Price

In this paper we consider a system of quadratic equations |<z_j, x>|^2 = b_j, j = 1, ..., m, where x in R^n is unknown while normal random vectors z_j in R_n and quadratic measurements b_j in R are known. The system is assumed to be…

Information Theory · Computer Science 2012-09-24 Xiaodong Li , Vladislav Voroninski

We consider the classical $k$-Center problem in undirected graphs. The problem is known to have a polynomial-time 2-approximation. There are even $(2+\varepsilon)$-approximations running in near-linear time. The conventional wisdom is that…

Data Structures and Algorithms · Computer Science 2025-03-13 Ce Jin , Yael Kirkpatrick , Virginia Vassilevska Williams , Nicole Wein

The paper deals with the Feedback Vertex Set problem parameterized by the solution size. Given a graph $G$ and a parameter $k$, one has to decide if there is a set $S$ of at most $k$ vertices such that $G-S$ is acyclic. Assuming the…

Data Structures and Algorithms · Computer Science 2026-01-16 Gaétan Berthe , Marin Bougeret , Daniel Gonçalves , Jean-Florent Raymond

The weighted low-rank approximation problem is a fundamental numerical linear algebra problem and has many applications in machine learning. Given a $n \times n$ weight matrix $W$ and a $n \times n$ matrix $A$, the goal is to find two…

Computational Complexity · Computer Science 2025-02-25 Chenyang Li , Yingyu Liang , Zhenmei Shi , Zhao Song

We consider the problem of finding a subcomplex K' of a simplicial complex K such that K' is homeomorphic to the 2-dimensional sphere, S^2. We study two variants of this problem. The first asks if there exists such a K' with at most k…

Data Structures and Algorithms · Computer Science 2019-09-10 Benjamin Burton , Sergio Cabello , Stefan Kratsch , William Pettersson

An important goal in algorithm design is determining the best running time for solving a problem (approximately). For some problems, we know the optimal running time, assuming certain conditional lower bounds. In this work, we study the…

Data Structures and Algorithms · Computer Science 2024-03-04 Moritz Buchem , Paul Deuker , Andreas Wiese

In this paper, we focus on the problem of existence and computing of small and large stable models. We show that for every fixed integer k, there is a linear-time algorithm to decide the problem LSM (large stable models problem): does a…

Logic in Computer Science · Computer Science 2007-05-23 Miroslaw Truszczynski

In the Sparse Linear Regression (SLR) problem, given a $d \times n$ matrix $M$ and a $d$-dimensional query $q$, the goal is to compute a $k$-sparse $n$-dimensional vector $\tau$ such that the error $||M \tau-q||$ is minimized. This problem…

Computational Geometry · Computer Science 2018-05-01 Sariel Har-Peled , Piotr Indyk , Sepideh Mahabadi

The problem central to sparse recovery and compressive sensing is that of stable sparse recovery: we want a distribution of matrices A in R^{m\times n} such that, for any x \in R^n and with probability at least 2/3 over A, there is an…

Data Structures and Algorithms · Computer Science 2011-12-30 Eric Price , David P. Woodruff

An efficient quantum algorithm is proposed to solve in polynomial time the parity problem, one of the hardest problems both in conventional quantum computation and in classical computation, on NMR quantum computers. It is based on the…

Quantum Physics · Physics 2007-05-23 Xijia Miao

We show how to convert any unsatisfiable 3-CNF formula which is sparse and exponentially hard to refute in Resolution into a negative instance of the $k$-clique problem whose corresponding natural encoding as a CNF formula is…

Computational Complexity · Computer Science 2026-01-27 Albert Atserias

The sum of radii problem ($k$-MSR) asks, given a metric space on $n$ points, to place $k$ balls covering all points so as to minimize the sum of their radii. Despite extensive study from the perspectives of approximation and parameterized…

Data Structures and Algorithms · Computer Science 2026-05-08 Ameet Gadekar

We develop a polynomial method on finite fields to amplify the hardness of spare sets in nondeterministic time complexity classes on a randomized streaming model. One of our results shows that if there exists a $2^{n^{o(1)}}$-sparse set in…

Computational Complexity · Computer Science 2020-07-14 Bin Fu