English
Related papers

Related papers: Parallel Matrix Condensation for Calculating Log-D…

200 papers

As training deep learning models on large dataset takes a lot of time and resources, it is desired to construct a small synthetic dataset with which we can train deep learning models sufficiently. There are recent works that have explored…

Machine Learning · Computer Science 2022-09-12 Wei Jin , Xianfeng Tang , Haoming Jiang , Zheng Li , Danqing Zhang , Jiliang Tang , Bing Yin

This paper introduces a fast algorithm for simultaneous inversion and determinant computation of small sized matrices in the context of fully Polarimetric Synthetic Aperture Radar (PolSAR) image processing and analysis. The proposed fast…

Numerical Analysis · Computer Science 2018-07-24 D. F. G. Coelho , R. J. Cintra , A. C. Frery , V. S. Dimitrov

A number of problems in probability and statistics can be addressed using the multivariate normal (Gaussian) distribution. In the one-dimensional case, computing the probability for a given mean and variance simply requires the evaluation…

Numerical Analysis · Mathematics 2015-04-07 Sivaram Ambikasaran , Daniel Foreman-Mackey , Leslie Greengard , David W. Hogg , Michael O'Neil

Frugal computing is becoming an important topic for environmental reasons. In this context, several techniques have been proposed to reduce the storage of scientific data by dedicated compression methods specially tailored for arrays of…

Data Structures and Algorithms · Computer Science 2022-03-01 Matthieu Martel

The generic matrix multiply (GEMM) function is the core element of high-performance linear algebra libraries used in many computationally-demanding digital signal processing (DSP) systems. We propose an acceleration technique for GEMM based…

Mathematical Software · Computer Science 2015-05-30 Davide Anastasia , Yiannis Andreopoulos

The Graphical Lasso (GLasso) algorithm is fast and widely used for estimating sparse precision matrices (Friedman et al., 2008). Its central role in the literature of high-dimensional covariance estimation rivals that of Lasso regression…

Computation · Statistics 2024-03-20 Aramayis Dallakyan , Mohsen Pourahmadi

The biggest cost of computing with large matrices in any modern computer is related to memory latency and bandwidth. The average latency of modern RAM reads is 150 times greater than a clock step of the processor. Throughput is a little…

Data Structures and Algorithms · Computer Science 2013-03-04 Crysttian Arantes Paixão , Flávio Codeço Coelho

The scalable calculation of matrix determinants has been a bottleneck to the widespread application of many machine learning methods such as determinantal point processes, Gaussian processes, generalised Markov random fields, graph models…

Numerical Analysis · Computer Science 2017-04-25 Jack Fitzsimons , Diego Granziol , Kurt Cutajar , Michael Osborne , Maurizio Filippone , Stephen Roberts

A novel parallel algorithm for matrix multiplication is presented. The hyper-systolic algorithm makes use of a one-dimensional processor abstraction. The procedure can be implemented on all types of parallel systems. It can handle…

Mathematical Software · Computer Science 2007-05-23 Thomas Lippert , Nikolay Petkov , Paolo Palazzari , Klaus Schilling

In 1866, Charles Ludwidge Dodgson published a paper concerning a method for evaluating determinants called the condensation method. His paper documented a new method to calculate determinants that was based on Jacobi's Theorem. The…

History and Overview · Mathematics 2016-07-20 Mitch Main , Micah Donor , R. Corban Harwood

Matrix decomposition is one of the fundamental tools to discover knowledge from big data generated by modern applications. However, it is still inefficient or infeasible to process very big data using such a method in a single machine.…

Machine Learning · Computer Science 2020-02-11 Chihao Zhang , Yang Yang , Wei Zhang , Shihua Zhang

This work presents a new algorithm to compute the matrix exponential within a given tolerance. Combined with the scaling and squaring procedure, the algorithm incorporates Taylor, partitioned and classical Pad\'e methods shown to be…

Numerical Analysis · Mathematics 2024-04-22 Sergio Blanes , Nikita Kopylov , Muaz Seydaoğlu

Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix…

Information Theory · Computer Science 2019-05-17 Wei-Ting Chang , Ravi Tandon

The ability of many powerful machine learning algorithms to deal with large data sets without compromise is often hampered by computationally expensive linear algebra tasks, of which calculating the log determinant is a canonical example.…

Machine Learning · Statistics 2017-09-11 Diego Granziol , Stephen Roberts

In various areas of applied numerics, the problem of calculating the logarithm of a matrix A emerges. Since series expansions of the logarithm usually do not converge well for matrices far away from the identity, the standard numerical…

Numerical Analysis · Computer Science 2007-07-19 Gernot Schaller

One of the most significant challenges in Computing Determinant of Rectangular Matrices is high time complexity of its algorithm. Among all definitions of determinant of rectangular matrices, used definition has special features which make…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-07 Neda Abdollahi , Mohammad Jafari , Morteza Bayat , Ali Amiri , Mahmood Fathy

We present an algorithm computing the determinant of an integer matrix A. The algorithm is introspective in the sense that it uses several distinct algorithms that run in a concurrent manner. During the course of the algorithm partial…

Symbolic Computation · Computer Science 2008-09-04 Jean-Guillaume Dumas , Anna Urbanska

Convergence is a crucial issue in iterative algorithms. Damping is commonly employed to ensure the convergence of iterative algorithms. The conventional ways of damping are scalar-wise, and either heuristic or empirical. Recently, an…

Signal Processing · Electrical Eng. & Systems 2023-11-16 Shunqi Huang , Lei Liu , Brian M. Kurkoski

The object of this paper is to introduce a new and fascinating method of solving large linear equations, based on Cramer's rule or Gaussian elimination but employing Sylvester's determinant identity in its computation process. In addition,…

Numerical Analysis · Mathematics 2014-07-08 Hou-biao Li , Ting-Zhu Huang , Tong-xiang Gu , Xing-Ping Liu

The computation of the Log-determinant of large, sparse, symmetric positive definite (SPD) matrices is essential in many scientific computational fields such as numerical linear algebra and machine learning. In low dimensions, Cholesky is…

Numerical Analysis · Mathematics 2026-03-19 Verlon Roel Mbingui , Antoine Tambue , Issa Karambal