English
Related papers

Related papers: Sketching for Simultaneously Sparse and Low-Rank C…

200 papers

Finite Gaussian mixture models are widely used for model-based clustering of continuous data. Nevertheless, since the number of model parameters scales quadratically with the number of variables, these models can be easily…

Methodology · Statistics 2018-09-25 Michael Fop , Thomas Brendan Murphy , Luca Scrucca

Gaussian covariance graph model is a popular model in revealing underlying dependency structures among random variables. A Bayesian approach to the estimation of covariance structures uses priors that force zeros on some off-diagonal…

Methodology · Statistics 2021-12-07 Bongjung Sung , Jaeyong Lee

The past few years have witnessed increasing research interest on covariance-based feature representation. A variety of methods have been proposed to boost its efficacy, with some recent ones resorting to nonlinear kernel technique. Noting…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Jianjia Zhang , Lei Wang , Luping Zhou , Wanqing Li

Network modeling of high-dimensional time series data is a key learning task due to its widespread use in a number of application areas, including macroeconomics, finance and neuroscience. While the problem of sparse modeling based on…

Methodology · Statistics 2019-03-27 Sumanta Basu , Xianqi Li , George Michailidis

In sketched clustering, a dataset of $T$ samples is first sketched down to a vector of modest size, from which the centroids are subsequently extracted. Advantages include i) reduced storage complexity and ii) centroid extraction complexity…

Information Theory · Computer Science 2019-05-21 Evan Byrne , Antoine Chatalic , Remi Gribonval , Philip Schniter

Motivated by the study of matrix elimination orderings in combinatorial scientific computing, we utilize graph sketching and local sampling to give a data structure that provides access to approximate fill degrees of a matrix undergoing…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Gary L. Miller , Richard Peng , Saurabh Sawlani , Junxing Wang , Shen Chen Xu

Consider a linear model $Y=X\beta+z$, where $X=X_{n,p}$ and $z\sim N(0,I_n)$. The vector $\beta$ is unknown but is sparse in the sense that most of its coordinates are $0$. The main interest is to separate its nonzero coordinates from the…

Statistics Theory · Mathematics 2015-03-20 Zheng Tracy Ke , Jiashun Jin , Jianqing Fan

Sketching is a stochastic dimension reduction method that preserves geometric structures of data and has applications in high-dimensional regression, low rank approximation and graph sparsification. In this work, we show that sketching can…

Machine Learning · Statistics 2021-09-17 Zhishen Huang , Stephen Becker

The use of sparse precision (inverse covariance) matrices has become popular because they allow for efficient algorithms for joint inference in high-dimensional models. Many applications require the computation of certain elements of the…

Computation · Statistics 2017-12-06 Per Sidén , Finn Lindgren , David Bolin , Mattias Villani

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

The pattern of zero entries in the inverse covariance matrix of a multivariate normal distribution corresponds to conditional independence restrictions between variables. Covariance selection aims at estimating those structural zeros from…

Statistics Theory · Mathematics 2016-08-16 Nicolai Meinshausen , Peter Bühlmann

Scalable algorithms to solve optimization and regression tasks even approximately, are needed to work with large datasets. In this paper we study efficient techniques from matrix sketching to solve a variety of convex constrained regression…

Machine Learning · Computer Science 2019-11-01 Graham Cormode , Charlie Dickens

This paper develops the sketching (i.e., randomized dimension reduction) theory for real algebraic varieties and images of polynomial maps, including, e.g., the set of low rank tensors and tensor networks. Through the lens of norming sets,…

Numerical Analysis · Mathematics 2025-06-06 Yifan Zhang , Joe Kileel

We consider a sketched implementation of the finite element method for elliptic partial differential equations on high-dimensional models. Motivated by applications in real-time simulation and prediction we propose an algorithm that…

Numerical Analysis · Mathematics 2020-04-22 Robert Lung , Yue Wu , Dimitris Kamilis , Nick Polydorides

For an overdetermined system $\mathsf{A}\mathsf{x} \approx \mathsf{b}$ with $\mathsf{A}$ and $\mathsf{b}$ given, the least-square (LS) formulation $\min_x \, \|\mathsf{A}\mathsf{x}-\mathsf{b}\|_2$ is often used to find an acceptable…

Numerical Analysis · Mathematics 2020-06-04 Ke Chen , Qin Li , Kit Newton , Steve Wright

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

Gaussian graphical models are widely utilized to infer and visualize networks of dependencies between continuous variables. However, inferring the graph is difficult when the sample size is small compared to the number of variables. To…

Statistics Theory · Mathematics 2016-09-30 Emilie Devijver , Mélina Gallopin

Recent advancement of the WWW, IOT, social network, e-commerce, etc. have generated a large volume of data. These datasets are mostly represented by high dimensional and sparse datasets. Many fundamental subroutines of common data analytic…

Information Retrieval · Computer Science 2019-10-11 Rameshwar Pratap , Debajyoti Bera , Karthik Revanuru

In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer…

Instrumentation and Methods for Astrophysics · Physics 2017-01-11 Benjamin Joachimi

We introduce a random matrix framework for studying statistical-mechanical lattice systems through spectral observables. Equilibrium configurations sampled from a Boltzmann measure are mapped to matrix ensembles whose covariance structure…

Disordered Systems and Neural Networks · Physics 2026-05-21 Yaprak Önder , Abbas Ali Saberi , Roderich Moessner