English
Related papers

Related papers: Implicit QR for Companion-like Pencils

200 papers

We present a new algorithm for solving an eigenvalue problem for a real symmetric matrix which is a rank-one modification of a diagonal matrix. The algorithm computes each eigenvalue and all components of the corresponding eigenvector with…

Numerical Analysis · Mathematics 2015-09-22 Nevena Jakovcevic Stor , Ivan Slapnicar , Jesse L. Barlow

We propose a general framework for reconstructing and denoising single entries of incomplete and noisy entries. We describe: effective algorithms for deciding if and entry can be reconstructed and, if so, for reconstructing and denoising…

Machine Learning · Statistics 2013-04-02 Franz J. Király , Louis Theran

In this paper, we describe the randomized QLP (RQLP) algorithm and its enhanced version (ERQLP) for computing the low rank approximation to $A$ of size $m\times n$ efficiently such that $A\approx QLP$, where $L$ is the rank-$k$…

Numerical Analysis · Mathematics 2018-11-26 Nianci Wu , Hua Xiang

Updating a linear least squares solution can be critical for near real-time signalprocessing applications. The Greville algorithm proposes a simple formula for updating the pseudoinverse of a matrix A $\in$ R nxm with rank r. In this paper,…

Mathematical Software · Computer Science 2021-06-23 Ruben Staub , Stephan N. Steinmann

Affine rank minimization algorithms typically rely on calculating the gradient of a data error followed by a singular value decomposition at every iteration. Because these two steps are expensive, heuristic approximations are often used to…

Optimization and Control · Mathematics 2013-06-04 Stephen Becker , Volkan Cevher , Anastasios Kyrillidis

In recent years, Orthogonal Recurrent Neural Networks (ORNNs) have gained popularity due to their ability to manage tasks involving long-term dependencies, such as the copy-task, and their linear complexity. However, existing ORNNs utilize…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Armand Foucault , Franck Mamalet , François Malgouyres

In many applications, it is of interest to approximate data, given by mxn matrix A, by a matrix B of at most rank k, which is much smaller than m and n. The best approximation is given by singular value decomposition, which is too time…

Numerical Analysis · Mathematics 2007-05-23 Shmuel Friedland , Mostafa Kaveh , Amir Niknejad , Hossein Zare

An important component of autoencoders is the method by which the information capacity of the latent representation is minimized or limited. In this work, the rank of the covariance matrix of the codes is implicitly minimized by relying on…

Machine Learning · Computer Science 2020-10-15 Li Jing , Jure Zbontar , Yann LeCun

This paper addresses computational challenges in estimating Quantile Regression with Selection (QRS). The estimation of the parameters that model self-selection requires the estimation of the entire quantile process several times. Moreover,…

Econometrics · Economics 2024-02-27 Santiago Pereda-Fernández

The application of eigenvalue theory to dual quaternion Hermitian matrices holds significance in the realm of multi-agent formation control. In this paper, we study the Rayleigh quotient iteration (RQI) for solving the right eigenpairs of…

Numerical Analysis · Mathematics 2024-09-25 Shan-Qi Duan , Qing-Wen Wang , Xue-Feng Duan

In this article we show how to compute a matrix representation and the implicit equation by means of the method developed in [Botbol: arXiv:1007.3437], using the computer algebra system Macaulay2 \cite{M2}. As it is probably the most…

Algebraic Geometry · Mathematics 2010-07-22 Nicolas Botbol

Matrix multiplication is a fundamental classical computing operation whose efficiency becomes a major challenge at scale, especially for machine learning applications. Quantum computing, with its inherent parallelism and exponential storage…

Quantum Physics · Physics 2026-02-10 Jiaqi Yao , Ding Liu

Linear regression is a widely used technique to fit linear models and finds widespread applications across different areas such as machine learning and statistics. In most real-world scenarios, however, linear regression problems are often…

Quantum Physics · Physics 2023-05-02 Shantanav Chakraborty , Aditya Morolia , Anurudh Peduri

In this work, we develop a new fast algorithm, spaQR -- sparsified QR, for solving large, sparse linear systems. The key to our approach is using low-rank approximations to sparsify the separators in a Nested Dissection based Householder QR…

Numerical Analysis · Mathematics 2020-10-15 Abeynaya Gnanasekaran , Eric Darve

We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms. The proposed scheme, called QNing can be notably applied to incremental first-order methods such as the stochastic…

Machine Learning · Statistics 2019-01-30 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

QR factorisation plays an important role in matrix computations. Within the context of optimisation and of automatic differentiation of such computations, we need to compute the derivative of this factorisation. For tall matrices, however,…

Numerical Analysis · Mathematics 2025-05-27 Stefanos-Aldo Papanicolopulos

We propose a method for low-rank semidefinite programming in application to the semidefinite relaxation of unconstrained binary quadratic problems. The method improves an existing solution of the semidefinite programming relaxation to…

Optimization and Control · Mathematics 2021-12-07 Roman Pogodin , Mikhail Krechetov , Yury Maximov

The problem of computing recurrence coefficients of sequences of rational functions orthogonal with respect to a discrete inner product is formulated as an inverse eigenvalue problem for a pencil of Hessenberg matrices. Two procedures are…

Numerical Analysis · Mathematics 2021-05-24 Niel Van Buggenhout , Marc Van Barel , Raf Vandebril

Linear Quadratic Regulators (LQR) achieve enormous successful real-world applications. Very recently, people have been focusing on efficient learning algorithms for LQRs when their dynamics are unknown. Existing results effectively learn to…

Machine Learning · Computer Science 2021-02-15 Tianyu Wang , Lin F. Yang

We present a new algorithm that computes eigenvalues and eigenvectors of a Hermitian positive definite matrix while solving a linear system of equations with Conjugate Gradient (CG). Traditionally, all the CG iteration vectors could be…

High Energy Physics - Lattice · Physics 2011-10-12 Andreas Stathopoulos , Kostas Orginos