English
Related papers

Related papers: Faster Low-rank Approximation using Adaptive Gap-b…

200 papers

The low-rank matrix approximation problem with respect to the entry-wise $\ell_{\infty}$-norm is the following: given a matrix $M$ and a factorization rank $r$, find a matrix $X$ whose rank is at most $r$ and that minimizes $\max_{i,j}…

Computational Complexity · Computer Science 2019-08-06 Nicolas Gillis , Yaroslav Shitov

Consider the problem in which n jobs that are classified into k types are to be scheduled on m identical machines without preemption. A machine requires a proper setup taking s time units before processing jobs of a given type. The…

Data Structures and Algorithms · Computer Science 2015-04-28 Alexander Mäcker , Manuel Malatyali , Friedhelm Meyer auf der Heide , Sören Riechers

We approach the Max-3-Cut problem through the lens of maximizing complex-valued quadratic forms and demonstrate that low-rank structure in the objective matrix can be exploited, leading to alternative algorithms to classical semidefinite…

Data Structures and Algorithms · Computer Science 2026-04-27 Ria Stevens , Fangshuo Liao , Barbara Su , Jianqiang Li , Anastasios Kyrillidis

This paper is concerned with the development and analysis of an iterative solver for high-dimensional second-order elliptic problems based on subspace-based low-rank tensor formats. Both the subspaces giving rise to low-rank approximations…

Numerical Analysis · Mathematics 2014-07-21 Markus Bachmayr , Wolfgang Dahmen

We give new sublinear and parallel algorithms for the extensively studied problem of approximating n-variable r-CSPs (constraint satisfaction problems with constraints of arity r up to an additive error. The running time of our algorithms…

Data Structures and Algorithms · Computer Science 2014-07-31 Grigory Yaroslavtsev

We present a simple randomized polynomial time algorithm to approximate the mixed discriminant of $n$ positive semidefinite $n \times n$ matrices within a factor $2^{O(n)}$. Consequently, the algorithm allows us to approximate in randomized…

Rings and Algebras · Mathematics 2008-02-03 Alexander Barvinok

We provide fast algorithms for overconstrained $\ell_p$ regression and related problems: for an $n\times d$ input matrix $A$ and vector $b\in\mathbb{R}^n$, in $O(nd\log n)$ time we reduce the problem $\min_{x\in\mathbb{R}^d} \|Ax-b\|_p$ to…

Data Structures and Algorithms · Computer Science 2014-04-08 Kenneth L. Clarkson , Petros Drineas , Malik Magdon-Ismail , Michael W. Mahoney , Xiangrui Meng , David P. Woodruff

We present a simple, accurate method for solving consistent, rank-deficient linear systems, with or without addi- tional rank-completing constraints. Such problems arise in a variety of applications, such as the computation of the…

Numerical Analysis · Mathematics 2014-01-15 Josef Sifuentes , Zydrunas Gimbutas , Leslie Greengard

A rank-adaptive integrator for the approximate solution of high-order tensor differential equations by tree tensor networks is proposed and analyzed. In a recursion from the leaves to the root, the integrator updates bases and then evolves…

Numerical Analysis · Mathematics 2022-07-26 Gianluca Ceruti , Christian Lubich , Dominik Sulz

Low-rank tensor approximations have shown great potential for uncertainty quantification in high dimensions, for example, to build surrogate models that can be used to speed up large-scale inference problems (Eigel et al., Inverse Problems…

Numerical Analysis · Mathematics 2020-11-30 Paul B. Rohrbach , Sergey Dolgov , Lars Grasedyck , Robert Scheichl

Low-rank matrix approximation plays an important role in various applications such as image processing, signal processing and data analysis. The existing methods require a guess of the ranks of matrices that represent images or involve…

Numerical Analysis · Mathematics 2025-07-01 Weiwei Xu , Weijie Shen , Chang Liu , Zhigang Jia

We study \emph{sublinear} algorithms that solve linear systems locally. In the classical version of this problem the input is a matrix $S\in \mathbb{R}^{n\times n}$ and a vector $b\in\mathbb{R}^n$ in the range of $S$, and the goal is to…

Data Structures and Algorithms · Computer Science 2026-02-23 Alexandr Andoni , Robert Krauthgamer , Yosef Pogrow

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

We study dynamic algorithms for maintaining fundamental algebraic properties of matrices, specifically, rank, basis, and full-rank submatrices, with applications to maximum matching on dynamic graphs. Prior dynamic algorithms for rank…

Data Structures and Algorithms · Computer Science 2026-05-12 Jan van den Brand , Vishal Kumar , Daniel J. Zhang

Let $A$ and $B$ be two point sets in the plane of sizes $r$ and $n$ respectively (assume $r \leq n$), and let $k$ be a parameter. A matching between $A$ and $B$ is a family of pairs in $A \times B$ so that any point of $A \cup B$ appears in…

Data Structures and Algorithms · Computer Science 2019-03-25 Pankaj K. Agarwal , Hsien-Chih Chang , Allen Xiao

We give an algorithm that given a graph $G$ with $n$ vertices and $m$ edges and an integer $k$, in time $O_k(n^{1+o(1)}) + O(m)$ either outputs a rank decomposition of $G$ of width at most $k$ or determines that the rankwidth of $G$ is…

Data Structures and Algorithms · Computer Science 2024-02-20 Tuukka Korhonen , Marek Sokołowski

In this paper, we describe the randomized QLP (RQLP) algorithm and its enhanced version (ERQLP) for computing the low rank approximation to $A$ of size $m\times n$ efficiently such that $A\approx QLP$, where $L$ is the rank-$k$…

Numerical Analysis · Mathematics 2018-11-26 Nianci Wu , Hua Xiang

We revisit the task of computing the edit distance in sublinear time. In the $(k,K)$-gap edit distance problem the task is to distinguish whether the edit distance of two strings is at most $k$ or at least $K$. It has been established by…

Data Structures and Algorithms · Computer Science 2023-03-17 Karl Bringmann , Alejandro Cassis , Nick Fischer , Vasileios Nakos

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

As deep learning models exponentially increase in size, optimizers such as Adam encounter significant memory consumption challenges due to the storage of first and second moment data. Current memory-efficient methods like Adafactor and CAME…

Machine Learning · Computer Science 2024-03-25 Pengxiang Zhao , Ping Li , Yingjie Gu , Yi Zheng , Stephan Ludger Kölker , Zhefeng Wang , Xiaoming Yuan