English
Related papers

Related papers: Towards More Efficient SPSD Matrix Approximation a…

200 papers

Asymmetric data naturally exist in real life, such as directed graphs. Different from the common kernel methods requiring Mercer kernels, this paper tackles the asymmetric kernel-based learning problem. We describe a nonlinear extension of…

Machine Learning · Computer Science 2023-06-13 Qinghua Tao , Francesco Tonin , Panagiotis Patrinos , Johan A. K. Suykens

Sketching techniques have gained popularity in numerical linear algebra to accelerate the solution of least squares problems. The so-called $\varepsilon$-subspace embedding property of a sketching matrix $S$ has been largely used to…

Numerical Analysis · Mathematics 2025-11-21 Davide Palitta , Valeria Simoncini

We present a new algorithm for convex separable quadratic programming (QP) called Nys-IP-PMM, a regularized interior-point solver that uses low-rank structure to accelerate solution of the Newton system. The algorithm combines the interior…

Optimization and Control · Mathematics 2025-01-15 Ya-Chi Chu , Luiz-Rafael Santos , Madeleine Udell

Stereo depth estimation is used for many computer vision applications. Though many popular methods strive solely for depth quality, for real-time mobile applications (e.g. prosthetic glasses or micro-UAVs), speed and power efficiency are…

Image and Video Processing · Electrical Eng. & Systems 2019-08-09 Oscar Rahnama , Tommaso Cavallari , Stuart Golodetz , Simon Walker , Philip H. S. Torr

Dynamic mode decomposition (DMD) is an emerging methodology that has recently attracted computational scientists working on nonintrusive reduced order modeling. One of the major strengths that DMD possesses is having ground theoretical…

Numerical Analysis · Mathematics 2022-01-12 Shady E. Ahmed , Omer San , Diana A. Bistrian , Ionel M. Navon

The spectral bundle method proposed by Helmberg and Rendl is well established for solving large-scale semidefinite programs (SDP) thanks to its low per iteration computational complexity and strong practical performance. In this paper, we…

Optimization and Control · Mathematics 2022-11-08 Lijun Ding , Benjamin Grimmer

Cell recognition is a fundamental task in digital histopathology image analysis. Point-based cell recognition (PCR) methods normally require a vast number of annotations, which is extremely costly, time-consuming and labor-intensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongyi Shui , Yizhi Zhao , Sunyi Zheng , Yunlong Zhang , Honglin Li , Shichuan Zhang , Xiaoxuan Yu , Chenglu Zhu , Lin Yang

We study a cutting-plane method for semidefinite optimization problems (SDOs), and supply a proof of the method's convergence, under a boundedness assumption. By relating the method's rate of convergence to an initial outer approximation's…

Optimization and Control · Mathematics 2020-02-17 Dimitris Bertsimas , Ryan Cory-Wright

This article deals with the efficient and certified numerical approximation of the smallest eigenvalue and the associated eigenspace of a large-scale parametric Hermitian matrix. For this aim, we rely on projection-based model order…

Numerical Analysis · Mathematics 2026-01-14 Mattia Manucci , Benjamin Stamm , Zhuoyao Zeng

A matrix algorithm is said to be superfast (that is, runs at sublinear cost) if it involves much fewer scalars and flops than the input matrix has entries. Such algorithms have been extensively studied and widely applied in modern…

Numerical Analysis · Mathematics 2025-05-28 Soo Go , Victor Y. Pan

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

In this paper, we consider approximating the parameter-to-solution maps of parametric partial differential equations (PPDEs) using deep neural networks (DNNs). We propose an efficient approach combining reduced collocation methods (RCMs)…

Numerical Analysis · Mathematics 2025-08-18 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng

In this paper we propose and study a new complexity model for approximation algorithms. The main motivation are practical problems over large data sets that need to be solved many times for different scenarios, e.g., many multicast trees…

Data Structures and Algorithms · Computer Science 2010-06-18 Marek Cygan , Lukasz Kowalik , Marcin Mucha , Marcin Pilipczuk , Piotr Sankowski

The ground state energy of a many-electron system can be approximated by an variational approach in which the total energy of the system is minimized with respect to one and two-body reduced density matrices (RDM) instead of many-electron…

Optimization and Control · Mathematics 2017-09-01 Yongfeng Li , Zaiwen Wen , Chao Yang , Yaxiang Yuan

Kernel approximation via nonlinear random feature maps is widely used in speeding up kernel machines. There are two main challenges for the conventional kernel approximation methods. First, before performing kernel approximation, a good…

Machine Learning · Statistics 2015-03-16 Felix X. Yu , Sanjiv Kumar , Henry Rowley , Shih-Fu Chang

Traditional linear subspace reduced order models (LS-ROMs) are able to accelerate physical simulations, in which the intrinsic solution space falls into a subspace with a small dimension, i.e., the solution space has a small Kolmogorov…

Numerical Analysis · Mathematics 2020-11-17 Youngkyu Kim , Youngsoo Choi , David Widemann , Tarek Zohdi

The Nystr\"om method is one of the most popular techniques for improving the scalability of kernel methods. However, it has not yet been derived for kernel PCA in line with classical PCA. In this paper we derive kernel PCA with the…

Machine Learning · Statistics 2022-08-22 Fredrik Hallgren

The randomized coordinate descent (RCD) method is a classical algorithm with simple, lightweight iterations that is widely used for various optimization problems, including the solution of positive semidefinite linear systems. As a linear…

Numerical Analysis · Mathematics 2026-02-13 Jackie Lok , Elizaveta Rebrova

Coordinating the design of sampling and sparse-dense matrix multiplication (SpMM) is crucial for accelerating graph neural networks (GNNs). However, due to irrational sampling strategies, existing methods face a trade-off between accuracy…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-25 Yingchen Song , Yaobin Wang , Yi Luo , Huan Wu , Pingping Tang

Many real-world problems, such as those with fairness constraints, involve complex expectation constraints and large datasets, necessitating the design of efficient stochastic methods to solve them. Most existing research focuses on cases…

Optimization and Control · Mathematics 2025-09-11 Wei Liu , Yangyang Xu