中文
相关论文

相关论文: Efficiently updating a covariance matrix and its L…

200 篇论文

Many data-analysis problems involve large dense matrices that describe the covariance of stationary noise processes; the computational cost of inverting these matrices, or equivalently of solving linear systems that contain them, is often a…

天体物理仪器与方法 · 物理学 2015-06-22 Rutger van Haasteren , Michele Vallisneri

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

机器学习 · 统计学 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

We present an efficient low-rank updating algorithm for updating the trial wavefunctions used in Quantum Monte Carlo (QMC) simulations. The algorithm is based on low-rank updating of the Slater determinants. In particular, the computational…

材料科学 · 物理学 2009-06-25 Phani K. V. V. Nukala , P. R. C. Kent

A novel method is proposed for detecting changes in the covariance structure of moderate dimensional time series. This non-linear test statistic has a number of useful properties. Most importantly, it is independent of the underlying…

统计方法学 · 统计学 2021-08-18 Sean Ryan , Rebecca Killick

In this paper, we present Delta-LoRA, which is a novel parameter-efficient approach to fine-tune large language models (LLMs). In contrast to LoRA and other low-rank adaptation methods such as AdaLoRA, Delta-LoRA not only updates the…

机器学习 · 计算机科学 2023-09-06 Bojia Zi , Xianbiao Qi , Lingzhi Wang , Jianan Wang , Kam-Fai Wong , Lei Zhang

This paper revisits the problem of decomposing a positive semidefinite matrix as a sum of a matrix with a given rank plus a sparse matrix. An immediate application can be found in portfolio optimization, when the matrix to be decomposed is…

最优化与控制 · 数学 2021-06-16 Michel Baes , Calypso Herrera , Ariel Neufeld , Pierre Ruyssen

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

统计方法学 · 统计学 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

This work is concerned with linear matrix equations that arise from the space-time discretization of time-dependent linear partial differential equations (PDEs). Such matrix equations have been considered, for example, in the context of…

数值分析 · 数学 2023-06-16 Daniel Kressner , Stefano Massei , Junli Zhu

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

统计方法学 · 统计学 2017-12-12 Yi-Hui Zhou

This work develops novel rational Krylov methods for updating a large-scale matrix function f(A) when A is subject to low-rank modifications. It extends our previous work in this context on polynomial Krylov methods, for which we present a…

数值分析 · 数学 2020-08-27 Bernhard Beckermann , Alice Cortinovis , Daniel Kressner , Marcel Schweitzer

We study the problem of detecting an abrupt change to the signal covariance matrix. In particular, the covariance changes from a "white" identity matrix to an unknown spiked or low-rank matrix. Two sequential change-point detection…

统计理论 · 数学 2017-06-16 Liyan Xie , Yao Xie

Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In…

机器学习 · 计算机科学 2022-10-19 Steffen Schotthöfer , Emanuele Zangrando , Jonas Kusch , Gianluca Ceruti , Francesco Tudisco

We consider processing an n x d matrix A in a stream with row-wise updates according to a recent algorithm called Frequent Directions (Liberty, KDD 2013). This algorithm maintains an l x d matrix Q deterministically, processing each row in…

数据结构与算法 · 计算机科学 2013-08-23 Mina Ghashami , Jeff M. Phillips

Detecting emergence of a low-rank signal from high-dimensional data is an important problem arising from many applications such as camera surveillance and swarm monitoring using sensors. We consider a procedure based on the largest…

机器学习 · 统计学 2016-10-10 Yao Xie , Lee Seversky

An efficient Singular Value Decomposition (SVD) algorithm is an important tool for distributed and streaming computation in big data problems. It is observed that update of singular vectors of a rank-1 perturbed matrix is similar to a…

机器学习 · 计算机科学 2017-07-27 Ratnik Gandhi , Amoli Rajgor

Large spatial datasets are becoming ubiquitous in environmental sciences with the explosion in the amount of data produced by sensors that monitor and measure the Earth system. Consequently, the geostatistical analysis of these data…

统计理论 · 数学 2018-06-06 Thomas Romary , Nicolas Desassis

Multivariate time series can often have a large number of dimensions, whether it is due to the vast amount of collected features or due to how the data sources are processed. Frequently, the main structure of the high-dimensional time…

统计方法学 · 统计学 2021-10-11 Euan Thomas McGonigle , Hankui Peng

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

数值分析 · 数学 2016-06-07 Victor Y. Pan , Liang Zhao

Within ab initio Quantum Monte Carlo simulations, the leading numerical cost for large systems is the computation of the values of the Slater determinants in the trial wavefunction. Each Monte Carlo step requires finding the determinant of…

计算物理 · 物理学 2017-11-22 T. McDaniel , E. F. D'Azevedo , Y. W. Li , K. Wong , P. R. C. Kent

In this paper, we consider optimal low-rank regularized inverse matrix approximations and their applications to inverse problems. We give an explicit solution to a generalized rank-constrained regularized inverse approximation problem,…

数值分析 · 数学 2016-03-21 Julianne Chung , Matthias Chung