English
Related papers

Related papers: Optimal Sketching for Kronecker Product Regression…

200 papers

A distance matrix $A \in \mathbb R^{n \times m}$ represents all pairwise distances, $A_{ij}=\mathrm{d}(x_i,y_j)$, between two point sets $x_1,...,x_n$ and $y_1,...,y_m$ in an arbitrary metric space $(\mathcal Z, \mathrm{d})$. Such matrices…

Data Structures and Algorithms · Computer Science 2019-06-05 Piotr Indyk , Ali Vakilian , Tal Wagner , David Woodruff

The Knapsack problem is one of the most fundamental NP-complete problems at the intersection of computer science, optimization, and operations research. A recent line of research worked towards understanding the complexity of…

Data Structures and Algorithms · Computer Science 2024-02-27 Karl Bringmann

There have been several algorithms designed to optimise matrix multiplication. From schoolbook method with complexity $O(n^3)$ to advanced tensor-based tools with time complexity $O(n^{2.3728639})$ (lowest possible bound achieved), a lot of…

Data Structures and Algorithms · Computer Science 2019-01-30 Shrohan Mohapatra

We consider the problem of recovering an $n_1 \times n_2$ low-rank matrix with $k$-sparse singular vectors from a small number of linear measurements (sketch). We propose a sketching scheme and an algorithm that can recover the singular…

Information Theory · Computer Science 2024-07-02 Xiaoqi Liu , Ramji Venkataramanan

One of the central goals of Recurrent Neural Networks (RNNs) is to learn long-term dependencies in sequential data. Nevertheless, the most popular training method, Truncated Backpropagation through Time (TBPTT), categorically forbids…

Machine Learning · Computer Science 2019-05-20 Frederik Benzing , Marcelo Matheus Gauy , Asier Mujika , Anders Martinsson , Angelika Steger

One of the most fundamental problems in Computer Science is the Knapsack problem. Given a set of n items with different weights and values, it asks to pick the most valuable subset whose total weight is below a capacity threshold T. Despite…

Data Structures and Algorithms · Computer Science 2018-07-16 Kyriakos Axiotis , Christos Tzamos

Recurrent Neural Networks (RNN) can be difficult to deploy on resource constrained devices due to their size. As a result, there is a need for compression techniques that can significantly compress RNNs without negatively impacting task…

Machine Learning · Computer Science 2019-10-10 Urmish Thakker , Igor Fedorov , Jesse Beu , Dibakar Gope , Chu Zhou , Ganesh Dasika , Matthew Mattina

The fundamental sparsest cut problem takes as input a graph $G$ together with the edge costs and demands, and seeks a cut that minimizes the ratio between the costs and demands across the cuts. For $n$-node graphs~$G$ of treewidth~$k$,…

Data Structures and Algorithms · Computer Science 2024-04-23 Parinya Chalermsook , Matthias Kaul , Matthias Mnich , Joachim Spoerhase , Sumedha Uniyal , Daniel Vaz

Tensor Kronecker products, the natural generalization of the matrix Kronecker product, are independently emerging in multiple research communities. Like their matrix counterpart, the tensor generalization gives structure for implicit…

Social and Information Networks · Computer Science 2022-06-14 Charles Colley , Huda Nassar , David Gleich

In their seminal paper that initiated the field of algorithmic mechanism design, \citet{NR99} studied the problem of designing strategyproof mechanisms for scheduling jobs on unrelated machines aiming to minimize the makespan. They provided…

Computer Science and Game Theory · Computer Science 2022-09-12 Eric Balkanski , Vasilis Gkatzelis , Xizhi Tan

We study the problem of efficiently correcting an erroneous product of two $n\times n$ matrices over a ring. Among other things, we provide a randomized algorithm for correcting a matrix product with at most $k$ erroneous entries running in…

Data Structures and Algorithms · Computer Science 2016-08-19 Leszek Gasieniec , Christos Levcopoulos , Andrzej Lingas , Rasmus Pagh , Takeshi Tokuyama

In a seminal paper on finding large matchings in sparse random graphs, Karp and Sipser proposed two algorithms for this task. The second algorithm has been intensely studied, but due to technical difficulties, the first algorithm has…

Combinatorics · Mathematics 2018-11-28 Michael Anastos

In this paper, we consider the problem of recovering an unknown sparse matrix X from the matrix sketch Y = AX B^T. The dimension of Y is less than that of X, and A and B are known matrices. This problem can be solved using standard…

Numerical Analysis · Computer Science 2013-11-12 Thakshila Wimalajeewa , Yonina C. Eldar , Pramod K. Varshney

We investigate pseudopolynomial-time algorithms for Bounded Knapsack and Bounded Subset Sum. Recent years have seen a growing interest in settling their fine-grained complexity with respect to various parameters. For Bounded Knapsack, the…

Data Structures and Algorithms · Computer Science 2023-12-06 Lin Chen , Jiayi Lian , Yuchen Mao , Guochuan Zhang

We provide the first nearly-linear time algorithm for approximating $\ell_{q \rightarrow p}$-norms of non-negative matrices, for $q \geq p \geq 1$. Our algorithm returns a $(1-\varepsilon)$-approximation to the matrix norm in time…

Data Structures and Algorithms · Computer Science 2025-03-26 Étienne Objois , Adrian Vladu

Given an edge-weighted graph, how many minimum $k$-cuts can it have? This is a fundamental question in the intersection of algorithms, extremal combinatorics, and graph theory. It is particularly interesting in that the best known bounds…

Data Structures and Algorithms · Computer Science 2019-06-04 Anupam Gupta , Euiwoong Lee , Jason Li

Many convex problems in machine learning and computer science share the same form: \begin{align*} \min_{x} \sum_{i} f_i( A_i x + b_i), \end{align*} where $f_i$ are convex functions on $\mathbb{R}^{n_i}$ with constant $n_i$, $A_i \in…

Data Structures and Algorithms · Computer Science 2019-05-14 Yin Tat Lee , Zhao Song , Qiuyi Zhang

We study the low rank approximation problem of any given matrix $A$ over $\mathbb{R}^{n\times m}$ and $\mathbb{C}^{n\times m}$ in entry-wise $\ell_p$ loss, that is, finding a rank-$k$ matrix $X$ such that $\|A-X\|_p$ is minimized. Unlike…

Machine Learning · Computer Science 2019-10-31 Chen Dan , Hong Wang , Hongyang Zhang , Yuchen Zhou , Pradeep Ravikumar

We study the approximability of two related problems on graphs with $n$ nodes and $m$ edges: $n$-Pairs Shortest Paths ($n$-PSP), where the goal is to find a shortest path between $O(n)$ prespecified pairs, and All Node Shortest Cycles…

Data Structures and Algorithms · Computer Science 2022-09-21 Mina Dalirrooyfard , Ce Jin , Virginia Vassilevska Williams , Nicole Wein

For many hard computational problems, simple algorithms that run in time $2^n \cdot n^{O(1)}$ arise, say, from enumerating all subsets of a size-$n$ set. Finding (exponentially) faster algorithms is a natural goal that has driven much of…

Data Structures and Algorithms · Computer Science 2025-06-30 László Kozma , Junqi Tan