English
Related papers

Related papers: Fast and Cheap Krylov-Based Covariance Smoothing

200 papers

This work introduces a novel algorithm to solve large-scale eigenvalue problems and seek a small set of eigenpairs. The method, called randomized Krylov-Schur (rKS), has a simple implementation and benefits from fast and efficient…

Numerical Analysis · Mathematics 2025-08-08 Jean-Guillaume de Damas , Laura Grigori

We propose a sampling-based method for computing the tensor ring (TR) decomposition of a data tensor. The method uses leverage score sampled alternating least squares to fit the TR cores in an iterative fashion. By taking advantage of the…

Numerical Analysis · Mathematics 2021-07-12 Osman Asif Malik , Stephen Becker

Krylov subspace recycling is a powerful tool for solving long series of large, sparse linear systems that change slowly. In PDE constrained shape optimization, these appear naturally, as hundreds or more optimization steps are needed with…

Numerical Analysis · Mathematics 2020-10-23 Matthias Bolten , Eric de Sturler , Camilla Hahn

Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate…

Quantum Physics · Physics 2025-01-01 Linjian Ma , Matthew Fishman , Miles Stoudenmire , Edgar Solomonik

This paper develops a new class of Rosenbrock-type integrators based on a Krylov space solution of the linear systems. The new family, called Rosenbrock-Krylov (Rosenbrock-K), is well suited for solving large scale systems of ODEs or…

Numerical Analysis · Mathematics 2015-01-30 Paul Tranquilli , Adrian Sandu

Filtering and smoothing algorithms for linear discrete-time state-space models with skew-t-distributed measurement noise are proposed. The algorithms use a variational Bayes based posterior approximation with coupled location and skewness…

Systems and Control · Computer Science 2018-11-28 Henri Nurminen , Tohid Ardeshiri , Robert Piché , Fredrik Gustafsson

Adaptive stretching, where the post compression signal is iteratively stretched to maximize the correlation between the pre and post compression rf echo frames, has demonstrated superior performance compared to gradient based methods. At…

Tissues and Organs · Quantitative Biology 2022-10-25 Shaiban Ahmed , Rasheed Abid , S. Kaisar Alam

Frequency-dependent correlations, such as the spectral function and the dynamical structure factor, help understand condensed matter experiments. Within the density matrix renormalization group (DMRG) framework, an accurate method for…

Strongly Correlated Electrons · Physics 2016-12-21 A. Nocera , G. Alvarez

In the past few years powerful generalizations to the Euclidean k-means problem have been made, such as Bregman clustering [7], co-clustering (i.e., simultaneous clustering of rows and columns of an input matrix) [9,18], and tensor…

Data Structures and Algorithms · Computer Science 2009-11-09 Stefanie Jegelka , Suvrit Sra , Arindam Banerjee

A coarse grid correction (CGC) approach is proposed to enhance the efficiency of the matrix exponential and $\varphi$ matrix function evaluations. The approach is intended for iterative methods computing the matrix-vector products with…

Numerical Analysis · Mathematics 2024-04-23 Mike A. Botchev

Recently, tensor data (or multidimensional array) have been generated in many modern applications, such as functional magnetic resonance imaging (fMRI) in neuroscience and videos in video analysis. Many efforts are made in recent years to…

Machine Learning · Computer Science 2023-08-10 Jiaqi Zhang , Yinghao Cai , Zhaoyang Wang , Beilun Wang

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

We show that the optimal complexity of Nesterov's smooth first-order optimization algorithm is preserved when the gradient is only computed up to a small, uniformly bounded error. In applications of this method to semidefinite programs,…

Optimization and Control · Mathematics 2008-05-16 Alexandre d'Aspremont

Vision-Language Models suffer severe KV cache pressure at inference, as a single image often encodes into thousands of tokens. Most existing methods exploit token sparsity through token pruning, but permanently discarding visual content…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Beomseok Kang , Dongwon Jo , Jiwon Song , Donghwee Son , Jae-Joon Kim

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is…

Machine Learning · Statistics 2015-03-17 Ryota Tomioka , Kohei Hayashi , Hisashi Kashima

An optimization-based approach for the Tucker tensor approximation of parameter-dependent data tensors and solutions of tensor differential equations with low Tucker rank is presented. The problem of updating the tensor decomposition is…

Optimization and Control · Mathematics 2019-05-31 Lukas Exl

This paper addresses a distributed convex optimization problem with a class of coupled constraints, which arise in a multi-agent system composed of multiple communities modeled by cliques. First, we propose a fully distributed…

Optimization and Control · Mathematics 2022-11-21 Yuto Watanabe , Kazunori Sakurama

As a regression technique in spatial statistics, the spatiotemporally varying coefficient model (STVC) is an important tool for discovering nonstationary and interpretable response-covariate associations over both space and time. However,…

Machine Learning · Statistics 2024-05-17 Mengying Lei , Aurelie Labbe , Lijun Sun

Boundary element methods produce dense linear systems that can be accelerated via multipole expansions. Solved with Krylov methods, this implies computing the matrix-vector products within each iteration with some error, at an accuracy…

Numerical Analysis · Mathematics 2016-10-04 Tingyu Wang , Simon K. Layton , Lorena A. Barba

We present the first deterministic, finite-step algorithm for exact tensor ring (TR) decomposition, addressing an open question about the existence of such procedures. Our method leverages blockwise simultaneous diagonalization to recover…

Numerical Analysis · Mathematics 2025-12-02 Han Chen , Sitan Chen , Anru R. Zhang