English
Related papers

Related papers: Near-optimal hierarchical matrix approximation fro…

200 papers

Knapsack is one of the most fundamental problems in theoretical computer science. In the $(1 - \epsilon)$-approximation setting, although there is a fine-grained lower bound of $(n + 1 / \epsilon) ^ {2 - o(1)}$ based on the $(\min,…

Data Structures and Algorithms · Computer Science 2025-08-12 Xiao Mao

Several recent applications of optimal transport (OT) theory to machine learning have relied on regularization, notably entropy and the Sinkhorn algorithm. Because matrix-vector products are pervasive in the Sinkhorn algorithm, several…

Machine Learning · Statistics 2021-03-09 Meyer Scetbon , Marco Cuturi , Gabriel Peyré

In this paper, the problem of matrix rank minimization under affine constraints is addressed. The state-of-the-art algorithms can recover matrices with a rank much less than what is sufficient for the uniqueness of the solution of this…

Information Theory · Computer Science 2016-11-15 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Arash Amini , Christian Jutten

Nystr\"om approximation is a fast randomized method that rapidly solves kernel ridge regression (KRR) problems through sub-sampling the n-by-n empirical kernel matrix appearing in the objective function. However, the performance of such a…

Machine Learning · Statistics 2021-03-10 Yifan Chen , Yun Yang

We present two new algebraic multilevel hierarchical matrix algorithms to perform fast matrix-vector product (MVP) for $N$-body problems in $d$ dimensions, namely efficient $\mathcal{H}^2_{*}$ (fully nested algorithm, i.e., $\mathcal{H}^2$…

Numerical Analysis · Mathematics 2026-04-13 Ritesh Khan , Sivaram Ambikasaran

This paper proposes a stochastic variant of a classic algorithm---the cubic-regularized Newton method [Nesterov and Polyak 2006]. The proposed algorithm efficiently escapes saddle points and finds approximate local minima for general…

Machine Learning · Computer Science 2017-12-07 Nilesh Tripuraneni , Mitchell Stern , Chi Jin , Jeffrey Regier , Michael I. Jordan

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

We present prior robust algorithms for a large class of resource allocation problems where requests arrive one-by-one (online), drawn independently from an unknown distribution at every step. We design a single algorithm that, for every…

Data Structures and Algorithms · Computer Science 2019-03-12 Nikhil R. Devanur , Kamal Jain , Balasubramanian Sivan , Christopher A. Wilkens

We prove that for any real-valued matrix $X \in \R^{m \times n}$, and positive integers $r \ge k$, there is a subset of $r$ columns of $X$ such that projecting $X$ onto their span gives a $\sqrt{\frac{r+1}{r-k+1}}$-approximation to best…

Data Structures and Algorithms · Computer Science 2015-03-19 Venkatesan Guruswami , Ali Kemal Sinop

We study the strong approximation of a rough volatility model, in which the log-volatility is given by a fractional Ornstein-Uhlenbeck process with Hurst parameter $H<1/2$. Our methods are based on an equidistant discretization of the…

Probability · Mathematics 2016-06-14 Andreas Neuenkirch , Taras Shalaiko

Dasgupta recently introduced a cost function for the hierarchical clustering of a set of points given pairwise similarities between them. He showed that this function is NP-hard to optimize, but a top-down recursive partitioning heuristic…

Data Structures and Algorithms · Computer Science 2016-10-03 Moses Charikar , Vaggos Chatziafratis

There has been significant success in designing highly efficient algorithms for distance and shortest-path queries in recent years; many of the state-of-the-art algorithms use the hub labeling framework. In this paper, we study the…

Data Structures and Algorithms · Computer Science 2016-11-22 Haris Angelidakis , Yury Makarychev , Vsevolod Oparin

This work, for the first time, introduces two constant factor approximation algorithms with linear query complexity for non-monotone submodular maximization over a ground set of size $n$ subject to a knapsack constraint, $\mathsf{DLA}$ and…

Data Structures and Algorithms · Computer Science 2023-07-11 Canh V. Pham , Tan D. Tran , Dung T. K. Ha , My T. Thai

Computing the top eigenvectors of a matrix is a problem of fundamental interest to various fields. While the majority of the literature has focused on analyzing the reconstruction error of low-rank matrices associated with the retrieved…

Machine Learning · Computer Science 2022-02-17 Ruo-Chun Tzeng , Po-An Wang , Florian Adriaens , Aristides Gionis , Chi-Jen Lu

Sinkhorn divergence is a measure of dissimilarity between two probability measures. It is obtained through adding an entropic regularization term to Kantorovich's optimal transport problem and can hence be viewed as an entropically…

Numerical Analysis · Mathematics 2020-05-01 Mohammad Motamed

Multi-task learning (MTL) has emerged as a pivotal paradigm in machine learning by leveraging shared structures across multiple related tasks. Despite its empirical success, the development of likelihood-based efficiently solvable…

Machine Learning · Computer Science 2026-05-07 Shihong Ding , Fangyu Du , Cong Fang

Optimal decision tree (\odt) is a fundamental problem arising in applications such as active learning, entity identification, and medical diagnosis. An instance of \odt is given by $m$ hypotheses, out of which an unknown ``true'' hypothesis…

Data Structures and Algorithms · Computer Science 2025-05-22 Zhengjia Zhuo , Viswanath Nagarajan

We consider the problem of approximating an affinely structured matrix, for example a Hankel matrix, by a low-rank matrix with the same structure. This problem occurs in system identification, signal processing and computer algebra, among…

Numerical Analysis · Mathematics 2014-06-25 Mariya Ishteva , Konstantin Usevich , Ivan Markovsky

Inspired by the quantum computing algorithms for Linear Algebra problems [HHL,TaShma] we study how the simulation on a classical computer of this type of "Phase Estimation algorithms" performs when we apply it to solve the Eigen-Problem of…

Data Structures and Algorithms · Computer Science 2017-04-07 Michael Ben-Or , Lior Eldar

A new algorithm to approximate Hermitian matrices by positive semidefinite Hermitian matrices based on modified Cholesky decompositions is presented. In contrast to existing algorithms, this algorithm allows to specify bounds on the…

Numerical Analysis · Mathematics 2019-12-12 Joscha Reimer