English
Related papers

Related papers: Spectral Condition-Number Estimation of Large Spar…

200 papers

In this paper, we derive the mixed and componentwise condition numbers for a linear function of the solution to the total least squares with linear equality constraint (TLSE) problem. The explicit expressions of the mixed and componentwise…

Numerical Analysis · Mathematics 2021-11-09 Mahvish Samar

We consider the linear least squares problem with linear equality constraints (LSE problem) formulated as $\min_{x\in\mathbb{R}^{n}}\|Ax-b\|_2 \ \mathrm{s.t.} \ Cx = d$. Although there are some classical methods available to solve this…

Numerical Analysis · Mathematics 2025-01-06 Haibo Li

We provide convergence rates for Krylov subspace solutions to the trust-region and cubic-regularized (nonconvex) quadratic problems. Such solutions may be efficiently computed by the Lanczos method and have long been used in practice. We…

Optimization and Control · Mathematics 2019-01-03 Yair Carmon , John C. Duchi

In this paper, we consider the explicit expressions of the normwise condition number for the scaled total least squares problem. Some techniques are introduced to simplify the expression of the condition number, and some new results are…

Numerical Analysis · Mathematics 2019-07-08 Shaoxin Wang , Hanyu Li , Hu Yang

For large scale electronic structure calculation, the Krylov subspace method is introduced to calculate the one-body density matrix instead of the eigenstates of given Hamiltonian. This method provides an efficient way to extract the…

Materials Science · Physics 2009-11-10 Ryu Takayama , Takeo Hoshi , Takeo Fujiwara

In recent years two Krylov subspace methods have been proposed for solving skew symmetric linear systems, one based on the minimum residual condition, the other on the Galerkin condition. We give new, algorithm-independent proofs that in…

Numerical Analysis · Mathematics 2015-12-02 Stanley C. Eisenstat

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

The solution of sequences of shifted linear systems is a classic problem in numerical linear algebra, and a variety of efficient methods have been proposed over the years. Nevertheless, there still exist challenging scenarios witnessing a…

Numerical Analysis · Mathematics 2026-01-28 Hussam Al Daas , Davide Palitta

In this paper, the normwise condition number of a linear function of the equality constrained linear least squares solution called the partial condition number is considered. Its expression and closed formulae are first presented when the…

Numerical Analysis · Mathematics 2016-03-29 Hanyu Li , Shaoxin Wang

This work is concerned with the computation of the action of a matrix function f(A), such as the matrix exponential or the matrix square root, on a vector b. For a general matrix A, this can be done by computing the compression of A onto a…

Numerical Analysis · Mathematics 2023-06-06 Alice Cortinovis , Daniel Kressner , Yuji Nakatsukasa

The algorithmic Markov condition states that the most likely causal direction between two random variables X and Y can be identified as that direction with the lowest Kolmogorov complexity. Due to the halting problem, however, this notion…

Machine Learning · Computer Science 2017-02-23 Kailash Budhathoki , Jilles Vreeken

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

I revisit the condition number of computing left and right singular subspaces from [J.-G. Sun, Perturbation analysis of singular subspaces and deflating subspaces, Numer. Math. 73(2), pp. 235--263, 1996]. For real and complex matrices, I…

Numerical Analysis · Mathematics 2024-07-02 Nick Vannieuwenhoven

We study the Sparse Plus Low-Rank decomposition problem (SLR), which is the problem of decomposing a corrupted data matrix into a sparse matrix of perturbations plus a low-rank matrix containing the ground truth. SLR is a fundamental…

Machine Learning · Statistics 2023-11-15 Dimitris Bertsimas , Ryan Cory-Wright , Nicholas A. G. Johnson

Estimating singular subspaces from noisy matrices is a fundamental problem with wide-ranging applications across various fields. Driven by the challenges of data integration and multi-view analysis, this study focuses on estimating shared…

Statistics Theory · Mathematics 2024-11-27 Zhengchi Ma , Rong Ma

A constrained L1 minimization method is proposed for estimating a sparse inverse covariance matrix based on a sample of $n$ iid $p$-variate random variables. The resulting estimator is shown to enjoy a number of desirable properties. In…

Methodology · Statistics 2011-02-14 Tony Cai , Weidong Liu , Xi Luo

In spatial statistics and machine learning, the kernel matrix plays a pivotal role in prediction, classification, and maximum likelihood estimation. A thorough examination reveals that for large sample sizes, the kernel matrix becomes…

Machine Learning · Statistics 2023-11-07 Hao Zhang

Weakly supervised named entity recognition methods train label models to aggregate the token annotations of multiple noisy labeling functions (LFs) without seeing any manually annotated labels. To work well, the label model needs to…

Computation and Language · Computer Science 2022-06-08 Yinghao Li , Le Song , Chao Zhang

In this paper, we propose a unified non-conforming least-squares spectral element approach for solving Stokes equations with various non-standard boundary conditions. Existing least-squares formulations mostly deal with Dirichlet boundary…

Numerical Analysis · Mathematics 2022-09-07 Subhashree Mohapatra , N. Kishore Kumar , Shivangi Joshi