English
Related papers

Related papers: Towards More Efficient SPSD Matrix Approximation a…

200 papers

We present a novel method for efficiently producing semi-dense matches across images. Previous detector-free matcher LoFTR has shown remarkable matching capability in handling large-viewpoint change and texture-poor scenarios but suffers…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Yifan Wang , Xingyi He , Sida Peng , Dongli Tan , Xiaowei Zhou

In this paper, we present an efficient semismooth Newton method, named SSNCP, for solving a class of semidefinite programming problems. Our approach is rooted in an equivalent semismooth system derived from the saddle point problem induced…

Optimization and Control · Mathematics 2025-04-24 Zhanwang Deng , Jiang Hu , Kangkang Deng , Zaiwen Wen

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

In contrast with Mercer kernel-based approaches as used e.g., in Kernel Principal Component Analysis (KPCA), it was previously shown that Singular Value Decomposition (SVD) inherently relates to asymmetric kernels and Asymmetric Kernel…

Machine Learning · Computer Science 2025-03-11 Qinghua Tao , Francesco Tonin , Alex Lambert , Yingyi Chen , Panagiotis Patrinos , Johan A. K. Suykens

Low rank matrix approximations appear in a number of scientific computing applications. We consider the Nystr\"{o}m method for approximating a positive semidefinite matrix $A$. In the case that $A$ is very large or its entries can only be…

Numerical Analysis · Mathematics 2023-07-24 Erin Carson , Ieva Daužickaitė

Stochastic optimization methods have become a class of popular optimization tools in machine learning. Especially, stochastic gradient descent (SGD) has been widely used for machine learning problems such as training neural networks due to…

Optimization and Control · Mathematics 2021-02-26 Qingsong Zhang , Feihu Huang , Cheng Deng , Heng Huang

The essential difficulty of gradient-based bilevel optimization using implicit differentiation is to estimate the inverse Hessian vector product with respect to neural network parameters. This paper proposes to tackle this problem by the…

Machine Learning · Computer Science 2023-02-21 Ryuichiro Hataya , Makoto Yamada

The intrinsic dynamics and event-driven nature of spiking neural networks (SNNs) make them excel in processing temporal information by naturally utilizing embedded time sequences as time steps. Recent studies adopting this approach have…

Machine Learning · Computer Science 2024-12-18 Jiaqi Wang , Liutao Yu , Liwei Huang , Chenlin Zhou , Han Zhang , Zhenxi Song , Min Zhang , Zhengyu Ma , Zhiguo Zhang

In an iterative approach for solving linear systems with ill-conditioned, symmetric positive definite (SPD) kernel matrices, both fast matrix-vector products and fast preconditioning operations are required. Fast (linear-scaling)…

Numerical Analysis · Mathematics 2021-01-13 Xin Xing , Hua Huang , Edmond Chow

Matrices arising in scientific applications frequently admit linear low-rank approximations due to smoothness in the physical and/or temporal domain of the problem. In large-scale problems, computing an optimal low-rank approximation can be…

Numerical Analysis · Mathematics 2021-05-05 Alec Michael Dunton , Alireza Doostan

In this paper, we consider the problem of efficiently computing the eigenvalues of limited-memory quasi-Newton matrices that exhibit a compact formulation. In addition, we produce a compact formula for quasi-Newton matrices generated by any…

Numerical Analysis · Mathematics 2015-07-14 Jennifer B. Erway , Roummel F. Marcia

A model-based collaborative filtering (CF) approach utilizing fast adaptive randomized singular value decomposition (SVD) is proposed for the matrix completion problem in recommender system. Firstly, a fast adaptive PCA frameworkis…

Machine Learning · Computer Science 2025-04-08 Xiangyun Ding , Wenjian Yu , Yuyang Xie , Shenghua Liu

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou

We present a novel coreset construction algorithm for solving classification tasks using Support Vector Machines (SVMs) in a computationally efficient manner. A coreset is a weighted subset of the original data points that provably…

Data Structures and Algorithms · Computer Science 2017-11-13 Cenk Baykal , Lucas Liebenwein , Wilko Schwarting

With the emergence of Artificial Intelligence, numerical algorithms are moving towards more approximate approaches. For methods such as PCA or diffusion maps, it is necessary to compute eigenvalues of a large matrix, which may also be dense…

Numerical Analysis · Mathematics 2023-11-17 Keerthi Gaddameedi , Severin Reiz , Tobias Neckel , Hans-Joachim Bungartz

Deep learning demonstrates effectiveness across a wide range of tasks. However, the dense and over-parameterized nature of these models results in significant resource consumption during deployment. In response to this issue, weight…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-05 Cong Ma , Du Wu , Zhelang Deng , Jiang Chen , Xiaowen Huang , Jintao Meng , Wenxi Zhu , Bingqiang Wang , Amelie Chi Zhou , Peng Chen , Minwen Deng , Yanjie Wei , Shengzhong Feng , Yi Pan

Tenfold improvements in computation speed can be brought to the alternating direction method of multipliers (ADMM) for Semidefinite Programming with virtually no decrease in robustness and provable convergence simply by projecting…

Optimization and Control · Mathematics 2021-12-28 Nikitas Rontsis , Paul J. Goulart , Yuji Nakatsukasa

We present randomized algorithms for estimating the log-determinant of regularized symmetric positive semi-definite matrices. The algorithms access the matrix only through matrix vector products, and are based on the introduction of a…

Numerical Analysis · Mathematics 2026-02-20 Alice Cortinovis , Daniele Toni

In recent years, compressed sensing (CS) has been applied in the field of synthetic aperture radar (SAR) imaging and shows great potential. The existing models are, however, based on application of the sensing matrix acquired by the exact…

Information Theory · Computer Science 2014-05-23 Jian Fang , Zongben Xu , Bingchen Zhang , Wen Hong , Yirong Wu

Disparity estimation is a difficult problem in stereo vision because the correspondence technique fails in images with textureless and repetitive regions. Recent body of work using deep convolutional neural networks (CNN) overcomes this…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Rowel Atienza