English
Related papers

Related papers: Sequential Low-Rank Change Detection

200 papers

Inspired by graph-based methodologies, we introduce a novel graph-spanning algorithm designed to identify changes in both offline and online data across low to high dimensions. This versatile approach is applicable to Euclidean and…

Machine Learning · Statistics 2026-01-09 Yang-Wen Sun , Katerina Papagiannouli , Vladimir Spokoiny

The statistical modeling of random networks has been widely used to uncover interaction mechanisms in complex systems and to predict unobserved links in real-world networks. In many applications, network connections are collected via…

Social and Information Networks · Computer Science 2023-03-21 Angus Chan , Tianxi Li

Evanescent random fields arise as a component of the 2-D Wold decomposition of homogenous random fields. Besides their theoretical importance, evanescent random fields have a number of practical applications, such as in modeling the…

Methodology · Statistics 2009-10-05 M. Kliger , J. M. Francos

In data mining, estimating the number of distinct values (NDV) is a fundamental problem with various applications. Existing methods for estimating NDV can be broadly classified into two categories: i) scanning-based methods, which scan the…

Databases · Computer Science 2022-06-14 Jiajun Li , Zhewei Wei , Bolin Ding , Xiening Dai , Lu Lu , Jingren Zhou

We consider the recovery of a low rank and jointly sparse matrix from under sampled measurements of its columns. This problem is highly relevant in the recovery of dynamic MRI data with high spatio-temporal resolution, where each column of…

Numerical Analysis · Computer Science 2015-06-03 Sampurna Biswas , Sunrita Poddar , Soura Dasgupta , Raghuraman Mudumbai , Mathews Jacob

Sketching is a stochastic dimension reduction method that preserves geometric structures of data and has applications in high-dimensional regression, low rank approximation and graph sparsification. In this work, we show that sketching can…

Machine Learning · Statistics 2021-09-17 Zhishen Huang , Stephen Becker

We study the problem of detecting and locating change points in high-dimensional Vector Autoregressive (VAR) models, whose transition matrices exhibit low rank plus sparse structure. We first address the problem of detecting a single change…

Methodology · Statistics 2021-10-01 Peiliang Bai , Abolfazl Safikhani , George Michailidis

We present a windowed technique to learn parsimonious time-varying autoregressive models from multivariate timeseries. This unsupervised method uncovers interpretable spatiotemporal structure in data via non-smooth and non-convex…

Machine Learning · Statistics 2020-05-21 Kameron Decker Harris , Aleksandr Aravkin , Rajesh Rao , Bingni Wen Brunton

A randomized Gram-Schmidt algorithm is developed for orthonormalization of high-dimensional vectors or QR factorization. The proposed process can be less computationally expensive than the classical Gram-Schmidt process while being at least…

Numerical Analysis · Mathematics 2022-01-20 Oleg Balabanov , Laura Grigori

The configuration model is a standard tool for uniformly generating random graphs with a specified degree sequence, and is often used as a null model to evaluate how much of an observed network's structure can be explained by its degree…

Social and Information Networks · Computer Science 2023-05-31 Upasana Dutta , Bailey K. Fosdick , Aaron Clauset

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we study the spectral…

Social and Information Networks · Computer Science 2022-01-07 Hai Zhang , Xiao Guo , Xiangyu Chang

We study the rank of the instantaneous or spot covariance matrix $\Sigma_X(t)$ of a multidimensional continuous semi-martingale $X(t)$. Given high-frequency observations $X(i/n)$, $i=0,\ldots,n$, we test the null hypothesis…

Statistics Theory · Mathematics 2021-10-04 Markus Reiß , Lars Winkelmann

Complex systems are high-dimensional nonlinear dynamical systems with intricate interactions among their constituents. To make interpretable predictions about their large-scale behavior, it is typically assumed, without a clear statement,…

Adaptation and Self-Organizing Systems · Physics 2024-11-07 Vincent Thibeault , Antoine Allard , Patrick Desrosiers

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

In this paper, we develop an efficient sketchy empirical natural gradient method (SENG) for large-scale deep learning problems. The empirical Fisher information matrix is usually low-rank since the sampling is only practical on a small…

Optimization and Control · Mathematics 2021-03-26 Minghan Yang , Dong Xu , Zaiwen Wen , Mengyun Chen , Pengxiang Xu

The acquisition of the channel covariance matrix is of paramount importance to many strategies in multiple-input-multiple-output (MIMO) communications, such as the minimum mean-square error (MMSE) channel estimation. Therefore, plenty of…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Runnan Liu , Liang Liu , Dazhi He , Wenjun Zhang , Erik G. Larsson

We develop a monitoring procedure to detect changes in a large approximate factor model. Letting $r$ be the number of common factors, we base our statistics on the fact that the $\left( r+1\right) $-th eigenvalue of the sample covariance…

Methodology · Statistics 2022-02-03 Matteo Barigozzi , Lorenzo Trapani

Accounting for the uncertainty in the predictions of modern neural networks is a challenging and important task in many domains. Existing algorithms for uncertainty estimation require modifying the model architecture and training procedure…

Machine Learning · Statistics 2022-05-09 Alexander Fishkov , Maxim Panov

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu