English
Related papers

Related papers: Optimal Sketching for Kronecker Product Regression…

200 papers

We consider the Minimum Steiner Cut problem on undirected planar graphs with non-negative edge weights. This problem involves finding the minimum cut of the graph that separates a specified subset $X$ of vertices (terminals) into two parts.…

Data Structures and Algorithms · Computer Science 2020-01-01 Stephen Jue , Philip N. Klein

We consider the problem of jointly learning row-wise and column-wise dependencies of matrix-variate observations, which are modelled separately by two precision matrices. Due to the complicated structure of Kronecker-product precision…

Machine Learning · Computer Science 2024-03-06 Meixia Lin , Yangjing Zhang

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Low-rank approximation is a common tool used to accelerate kernel methods: the $n \times n$ kernel matrix $K$ is approximated via a rank-$k$ matrix $\tilde K$ which can be stored in much less space and processed more quickly. In this work…

Data Structures and Algorithms · Computer Science 2017-11-07 Cameron Musco , David P. Woodruff

Matrix sensing is a problem in signal processing and machine learning that involves recovering a low-rank matrix from a set of linear measurements. The goal is to reconstruct the original matrix as accurately as possible, given only a set…

Information Theory · Computer Science 2023-03-14 Yichuan Deng , Zhihang Li , Zhao Song

We present an $n\Delta^{O(k^2)}$ time algorithm to obtain an optimal solution for $1$-dimensional cutting stock problem: the bin packing problem of packing $n$ items onto unit capacity bins under the restriction that the number of item…

Discrete Mathematics · Computer Science 2020-01-07 Srikrishnan Divakaran

We introduce space-efficient plane-sweep algorithms for basic planar geometric problems. It is assumed that the input is in a read-only array of $n$ items and that the available workspace is $\Theta(s)$ bits, where $\lg n \leq s \leq n…

Data Structures and Algorithms · Computer Science 2016-04-25 Amr Elmasry , Frank Kammer

We give new sublinear and parallel algorithms for the extensively studied problem of approximating n-variable r-CSPs (constraint satisfaction problems with constraints of arity r up to an additive error. The running time of our algorithms…

Data Structures and Algorithms · Computer Science 2014-07-31 Grigory Yaroslavtsev

Matrix trace estimation is ubiquitous in machine learning applications and has traditionally relied on Hutchinson's method, which requires $O(\log(1/\delta)/\epsilon^2)$ matrix-vector product queries to achieve a $(1 \pm…

Data Structures and Algorithms · Computer Science 2021-11-02 Shuli Jiang , Hai Pham , David P. Woodruff , Qiuyi , Zhang

In project management, a project is typically described as an activity-on-edge network (AOE network), where each activity / job is represented as an edge of some network $N$ (which is a DAG). Some jobs must be finished before others can be…

Data Structures and Algorithms · Computer Science 2024-04-17 Ruixi Luo , Kai Jin , Zelin Ye

We propose new approximate alternating projection methods, based on randomized sketching, for the low-rank nonnegative matrix approximation problem: find a low-rank approximation of a nonnegative matrix that is nonnegative, but whose…

Numerical Analysis · Mathematics 2023-04-25 Sergey A. Matveev , Stanislav Budzinskiy

We give a sketching-based iterative algorithm that computes a $1+\varepsilon$ approximate solution for the ridge regression problem $\min_x \|Ax-b\|_2^2 +\lambda\|x\|_2^2$ where $A \in R^{n \times d}$ with $d \ge n$. Our algorithm, for a…

Data Structures and Algorithms · Computer Science 2022-06-20 Praneeth Kacham , David P. Woodruff

We introduce co-occurring directions sketching, a deterministic algorithm for approximate matrix product (AMM), in the streaming model. We show that co-occuring directions achieves a better error bound for AMM than other randomized and…

Machine Learning · Computer Science 2016-10-26 Youssef Mroueh , Etienne Marcheret , Vaibhava Goel

Binary quadratic programming problems have attracted much attention in the last few decades due to their potential applications. This type of problems are NP-hard in general, and still considered a challenge in the design of efficient…

Data Structures and Algorithms · Computer Science 2014-11-20 Khaled Elbassioni , Trung Thanh Nguyen

A recent work by [Larsen, SODA 2023] introduced a faster combinatorial alternative to Bansal's SDP algorithm for finding a coloring $x \in \{-1, 1\}^n$ that approximately minimizes the discrepancy $\mathrm{disc}(A, x) := | A x |_{\infty}$…

Data Structures and Algorithms · Computer Science 2025-05-27 Yichuan Deng , Xiaoyu Li , Zhao Song , Omri Weinstein

We develop a fast algorithm for computing the "SVD-truncated" regularized solution to the least-squares problem: $ \min_{\x} \TNorm{\matA \x - \b}. $ Let $\matA_k$ of rank $k$ be the best rank $k$ matrix computed via the SVD of $\matA$.…

Data Structures and Algorithms · Computer Science 2014-05-29 Christos Boutsidis , Malik Magdon-Ismail

We present a quantum algorithm for fitting a linear regression model to a given data set using the least squares approach. Different from previous algorithms which yield a quantum state encoding the optimal parameters, our algorithm outputs…

Quantum Physics · Physics 2017-08-01 Guoming Wang

We consider a fast approximation algorithm for the linear matroid intersection problem. In this problem, we are given two $r \times n$ matrices $M_1$ and $M_2$, and the objective is to find a largest set of columns that are linearly…

Data Structures and Algorithms · Computer Science 2026-04-14 Tatsuya Terao

We revisit the problem of sketching using approximate leverage scores for matrix least squares problems of the form $\| AX - B \|_F^2$ where the design matrix $A \in \mathbb{R}^{N \times r}$ is tall and skinny with $N \gg r$. We derive the…

Numerical Analysis · Mathematics 2026-03-31 Brett W. Larsen , Tamara G. Kolda

In the restricted shortest paths problem, we are given a graph $G$ whose edges are assigned two non-negative weights: lengths and delays, a source $s$, and a delay threshold $D$. The goal is to find, for each target $t$, the length of the…

Data Structures and Algorithms · Computer Science 2024-10-23 Vikrant Ashvinkumar , Aaron Bernstein , Adam Karczmarz