English
Related papers

Related papers: On Block Cholesky Decomposition for Sparse Inverse…

200 papers

We present an algorithm where only the Cholesky basis is determined in the decomposition procedure. This allows for improved screening and a partitioned matrix decomposition scheme, both of which significantly reduce memory usage and…

Chemical Physics · Physics 2019-06-05 Sarai D. Folkestad , Eirik F. Kjønstad , Henrik Koch

This paper focuses on variable selection for a partially linear single-index varying-coefficient model. A regularized variable selection procedure by combining basis function approximations with SCAD penalty is proposed. It can…

Statistics Theory · Mathematics 2024-12-19 Lijuan Han , Liugen Xue , Junshan Xie

How can we compute the pseudoinverse of a sparse feature matrix efficiently and accurately for solving optimization problems? A pseudoinverse is a generalization of a matrix inverse, which has been extensively utilized as a fundamental…

Machine Learning · Computer Science 2020-11-10 Jinhong Jung , Lee Sael

This paper introduces a subspace method for the estimation of an array covariance matrix. It is shown that when the received signals are uncorrelated, the true array covariance matrices lie in a specific subspace whose dimension is…

Numerical Analysis · Computer Science 2014-11-04 Mostafa Rahmani , George Atia

We present a novel and efficient implementation of coupled-cluster with singles and doubles (CCSD) analytic gradients that combines the Cholesky decomposition (CD) of electron-repulsion integrals with the exploitation of Abelian point-group…

Chemical Physics · Physics 2025-12-29 Luca Melega , Tommaso Nottoli , Jürgen Gauss , Filippo Lipparini

Learning algorithms for energy based Boltzmann architectures that rely on gradient descent are in general computationally prohibitive, typically due to the exponential number of terms involved in computing the partition function. In this…

Machine Learning · Computer Science 2018-07-13 Enrique Romero Merino , Ferran Mazzanti Castrillejo , Jordi Delgado Pin , David Buchaca Prats

Convolutional sparse coding (CSC) has been popularly used for the learning of shift-invariant dictionaries in image and signal processing. However, existing methods have limited scalability. In this paper, instead of convolving with a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

Clustering, like covariate selection for classification, is an important step to compress and interpret the data. However, clustering of covariates is often performed independently of the classification step, which can lead to undesirable…

Computation · Statistics 2020-04-08 Daniel Andrade , Kenji Fukumizu , Yuzuru Okajima

It is now widely accepted that knowledge can be acquired from networks by clustering their vertices according to connection profiles. Many methods have been proposed and in this paper we concentrate on the Stochastic Block Model (SBM). The…

Applications · Statistics 2010-07-27 Pierre Latouche , Etienne Birmele , Christophe Ambroise

Reduced-rank regression recognises the possibility of a rank-deficient matrix of coefficients. We propose a novel Bayesian model for estimating the rank of the coefficient matrix, which obviates the need for post-processing steps and allows…

Methodology · Statistics 2024-02-14 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

The multilevel model (MLM) is the popular approach to describe dependences of hierarchically clustered observations. A main feature is the capability to estimate (cluster-specific) random effect parameters, while their distribution…

Methodology · Statistics 2021-06-21 Jean-Paul Fox , Wouter Smink

In this paper we present a novel randomized block coordinate descent method for the minimization of a convex composite objective function. The method uses (approximate) partial second-order (curvature) information, so that the algorithm…

Optimization and Control · Mathematics 2015-05-11 Kimon Fountoulakis , Rachael Tappenden

In this paper, direction-of-arrival estimation using nested array is studied in the framework of sparse signal representation. With the vectorization operator, a new real-valued nonnegative sparse signal recovery model which has a wider…

Signal Processing · Electrical Eng. & Systems 2019-04-12 Yunmei Shi , Xing-Peng Mao , Chunlei Zhao , Yong-Tan Liu

An algorithm is developed to compute the complete CS decomposition (CSD) of a partitioned unitary matrix. Although the existence of the CSD has been recognized since 1977, prior algorithms compute only a reduced version (the 2-by-1 CSD)…

Numerical Analysis · Mathematics 2008-05-19 Brian D. Sutton

In this paper, we present a novel framework incorporating a combination of sparse models in different domains. We posit the observed data as generated from a linear combination of a sparse Gaussian Markov model (with a sparse precision…

Machine Learning · Computer Science 2012-07-03 Majid Janzamin , Animashree Anandkumar

In many biomedical research, multiple views of data (e.g., genomics, proteomics) are available, and a particular interest might be the detection of sample subgroups characterized by specific groups of variables. Biclustering methods are…

Methodology · Statistics 2021-11-12 W. Zhang , C. Wendt , R. Bowler , C. P. Hersh , S. E. Safo

In this paper, we propose a new approach to justify a round-off error impact on the accuracy of the linear least squares (LS) solution using Cholesky decomposition. This decomposition is widely employed to inverse a matrix in the linear…

Information Theory · Computer Science 2024-04-09 Alexander Osinsky , Roman Bychkov , Mikhail Trefilov , Vladimir Lyashev , Andrey Ivanov

Estimating the log-likelihood gradient with respect to the parameters of a Restricted Boltzmann Machine (RBM) typically requires sampling using Markov Chain Monte Carlo (MCMC) techniques. To save computation time, the Markov chains are only…

Machine Learning · Computer Science 2017-06-29 Oswin Krause , Asja Fischer , Christian Igel

In the era of Big Data, scalable and accurate clustering algorithms for high-dimensional data are essential. We present new Bayesian Distance Clustering (BDC) models and inference algorithms with improved scalability while maintaining the…

Methodology · Statistics 2024-09-02 Rafael Cabral , Maria de Iorio , Andrew Harris

Through the Bayesian lens of data assimilation, uncertainty on model parameters is traditionally quantified through the posterior covariance matrix. However, in modern settings involving high-dimensional and computationally expensive…

Computation · Statistics 2023-11-16 Michael Stanley , Mikael Kuusela , Brendan Byrne , Junjie Liu