English
Related papers

Related papers: Fast and Cheap Krylov-Based Covariance Smoothing

200 papers

We propose a fast algorithm for computing the entire ridge regression regularization path in nearly linear time. Our method constructs a basis on which the solution of ridge regression can be computed instantly for any value of the…

Optimization and Control · Mathematics 2022-10-25 Yifei Wang , Mert Pilanci

Classical iterative methods for tomographic reconstruction include the class of Algebraic Reconstruction Techniques (ART). Convergence of these stationary linear iterative methods is however notably slow. In this paper we propose the use of…

Numerical Analysis · Mathematics 2015-01-22 Siegfried Cools , Pieter Ghysels , Wim van Aarle , J. Sijbers , Wim Vanroose

Sparse matrices have recently played a significant and impactful role in scientific computing, including artificial intelligence-related fields. According to historical studies on sparse matrix--vector multiplication (SpMV), Krylov subspace…

Numerical Analysis · Mathematics 2024-12-24 Tomonori Kouya

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Stochastic optimization is a vital field in the realm of mathematical optimization, finding applications in diverse areas ranging from operations research to machine learning. In this paper, we introduce a novel first-order optimization…

Optimization and Control · Mathematics 2024-09-17 Vladimir Solodkin , Savelii Chezhegov , Ruslan Nazikov , Aleksandr Beznosikov , Alexander Gasnikov

Krylov quantum diagonalization methods have emerged as a promising use case for quantum computers. However, many existing implementations rely on controlled operations, which pose challenges to near-term quantum hardware. We introduce a…

Quantum Physics · Physics 2025-10-15 Nicola Mariella , Enrique Rico , Adam Byrne , Sergiy Zhuk

The Stokeslet and stresslet kernels are commonly used in boundary element simulations and singularity methods for slow viscous flow. Evaluating the velocity induced by a collection of Stokeslets and stresslets by direct summation requires…

Numerical Analysis · Mathematics 2019-08-30 Lei Wang , Svetlana Tlupova , Robert Krasny

Tensor decompositions have rich applications in statistics and machine learning, and developing efficient, accurate algorithms for the problem has received much attention recently. Here, we present a new method built on Kruskal's uniqueness…

Machine Learning · Computer Science 2017-04-20 Miaoyan Wang , Yun S. Song

Gradient-enhanced Kriging (GE-Kriging) is a well-established surrogate modelling technique for approximating expensive computational models. However, it tends to get impractical for high-dimensional problems due to the size of the inherent…

Machine Learning · Statistics 2024-01-05 Kai Cheng , Ralf Zimmermann

We consider generalizations of the Sylvester matrix equation, consisting of the sum of a Sylvester operator and a linear operator $\Pi$ with a particular structure. More precisely, the commutator of the matrix coefficients of the operator…

Numerical Analysis · Mathematics 2019-06-18 Elias Jarlebring , Giampaolo Mele , Davide Palitta , Emil Ringh

While convolutional neural networks (CNNs) have become the de facto standard for most image processing and computer vision applications, their deployment on edge devices remains challenging. Tensor decomposition methods provide a means of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Marawan Gamal Abdel Hameed , Ali Mosleh , Marzieh S. Tahaei , Vahid Partovi Nia

A Support Vector Method for multivariate performance measures was recently introduced by Joachims (2005). The underlying optimization problem is currently solved using cutting plane methods such as SVM-Perf and BMRM. One can show that these…

Machine Learning · Computer Science 2012-02-20 Xinhua Zhang , Ankan Saha , S. V. N. Vishwanatan

In the present work, we propose new tensor Krylov subspace method for ill posed linear tensor problems such as in color or video image restoration. Those methods are based on the tensor-tensor discrete cosine transform that gives fast…

Numerical Analysis · Mathematics 2021-03-23 M. El Guide , A. El Ichi , K. Jbilou

The problem of minimizing a separable convex function under linearly coupled constraints arises from various application domains such as economic systems, distributed control, and network flow. The main challenge for solving this problem is…

Optimization and Control · Mathematics 2017-09-05 Qin Fan , Min Xu , Yiming Ying

We propose a real-space renormalization group algorithm for accurately coarse-graining two-dimensional tensor networks. The central innovation of our method lies in utilizing variational boundary tensors as a globally optimized environment…

Statistical Mechanics · Physics 2026-03-03 Feng-Feng Song , Naoki Kawashima

We propose regularization schemes for deformable registration and efficient algorithms for their numerical approximation. We treat image registration as a variational optimal control problem. The deformation map is parametrized by its…

Optimization and Control · Mathematics 2016-09-09 Andreas Mang , George Biros

In fluid dynamics, predicting and characterizing bifurcations, from the onset of unsteadiness to the transition to turbulence, is of critical importance for both academic and industrial applications. Different tools from dynamical systems…

Fluid Dynamics · Physics 2023-01-31 Ricardo S. Frantz , Jean-Christophe Loiseau , Jean-Christophe Robinet

The spanning tree heuristic is a commonly adopted procedure in network inference and estimation. It allows one to generalize an inference method developed for trees, which is usually based on a statistically rigorous approach, to a…

Signal Processing · Electrical Eng. & Systems 2019-05-22 Feng Ji , Wenchang Tang , Wee Peng Tay

We propose a new family of subgradient- and gradient-based methods which converges with optimal complexity for convex optimization problems whose feasible region is simple enough. This includes cases where the objective function is…

Optimization and Control · Mathematics 2016-08-19 Masaru Ito , Mituhiro Fukuda

Electromigration (EM) induced stress evolution is a major reliability challenge in nanometer-scale VLSI interconnects. Accurate EM analysis requires solving stress-governing partial differential equations over large interconnect trees,…

Hardware Architecture · Computer Science 2026-03-27 Sheldon X. -D. Tan , Haotian Lu