English
Related papers

Related papers: Efficiently updating a covariance matrix and its L…

200 papers

Many data-analysis problems involve large dense matrices that describe the covariance of stationary noise processes; the computational cost of inverting these matrices, or equivalently of solving linear systems that contain them, is often a…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Rutger van Haasteren , Michele Vallisneri

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

We present an efficient low-rank updating algorithm for updating the trial wavefunctions used in Quantum Monte Carlo (QMC) simulations. The algorithm is based on low-rank updating of the Slater determinants. In particular, the computational…

Materials Science · Physics 2009-06-25 Phani K. V. V. Nukala , P. R. C. Kent

A novel method is proposed for detecting changes in the covariance structure of moderate dimensional time series. This non-linear test statistic has a number of useful properties. Most importantly, it is independent of the underlying…

Methodology · Statistics 2021-08-18 Sean Ryan , Rebecca Killick

In this paper, we present Delta-LoRA, which is a novel parameter-efficient approach to fine-tune large language models (LLMs). In contrast to LoRA and other low-rank adaptation methods such as AdaLoRA, Delta-LoRA not only updates the…

Machine Learning · Computer Science 2023-09-06 Bojia Zi , Xianbiao Qi , Lingzhi Wang , Jianan Wang , Kam-Fai Wong , Lei Zhang

This paper revisits the problem of decomposing a positive semidefinite matrix as a sum of a matrix with a given rank plus a sparse matrix. An immediate application can be found in portfolio optimization, when the matrix to be decomposed is…

Optimization and Control · Mathematics 2021-06-16 Michel Baes , Calypso Herrera , Ariel Neufeld , Pierre Ruyssen

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

Methodology · Statistics 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

This work is concerned with linear matrix equations that arise from the space-time discretization of time-dependent linear partial differential equations (PDEs). Such matrix equations have been considered, for example, in the context of…

Numerical Analysis · Mathematics 2023-06-16 Daniel Kressner , Stefano Massei , Junli Zhu

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

This work develops novel rational Krylov methods for updating a large-scale matrix function f(A) when A is subject to low-rank modifications. It extends our previous work in this context on polynomial Krylov methods, for which we present a…

Numerical Analysis · Mathematics 2020-08-27 Bernhard Beckermann , Alice Cortinovis , Daniel Kressner , Marcel Schweitzer

We study the problem of detecting an abrupt change to the signal covariance matrix. In particular, the covariance changes from a "white" identity matrix to an unknown spiked or low-rank matrix. Two sequential change-point detection…

Statistics Theory · Mathematics 2017-06-16 Liyan Xie , Yao Xie

Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In…

Machine Learning · Computer Science 2022-10-19 Steffen Schotthöfer , Emanuele Zangrando , Jonas Kusch , Gianluca Ceruti , Francesco Tudisco

We consider processing an n x d matrix A in a stream with row-wise updates according to a recent algorithm called Frequent Directions (Liberty, KDD 2013). This algorithm maintains an l x d matrix Q deterministically, processing each row in…

Data Structures and Algorithms · Computer Science 2013-08-23 Mina Ghashami , Jeff M. Phillips

Detecting emergence of a low-rank signal from high-dimensional data is an important problem arising from many applications such as camera surveillance and swarm monitoring using sensors. We consider a procedure based on the largest…

Machine Learning · Statistics 2016-10-10 Yao Xie , Lee Seversky

An efficient Singular Value Decomposition (SVD) algorithm is an important tool for distributed and streaming computation in big data problems. It is observed that update of singular vectors of a rank-1 perturbed matrix is similar to a…

Machine Learning · Computer Science 2017-07-27 Ratnik Gandhi , Amoli Rajgor

Large spatial datasets are becoming ubiquitous in environmental sciences with the explosion in the amount of data produced by sensors that monitor and measure the Earth system. Consequently, the geostatistical analysis of these data…

Statistics Theory · Mathematics 2018-06-06 Thomas Romary , Nicolas Desassis

Multivariate time series can often have a large number of dimensions, whether it is due to the vast amount of collected features or due to how the data sources are processed. Frequently, the main structure of the high-dimensional time…

Methodology · Statistics 2021-10-11 Euan Thomas McGonigle , Hankui Peng

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

Within ab initio Quantum Monte Carlo simulations, the leading numerical cost for large systems is the computation of the values of the Slater determinants in the trial wavefunction. Each Monte Carlo step requires finding the determinant of…

Computational Physics · Physics 2017-11-22 T. McDaniel , E. F. D'Azevedo , Y. W. Li , K. Wong , P. R. C. Kent

In this paper, we consider optimal low-rank regularized inverse matrix approximations and their applications to inverse problems. We give an explicit solution to a generalized rank-constrained regularized inverse approximation problem,…

Numerical Analysis · Mathematics 2016-03-21 Julianne Chung , Matthias Chung