English
Related papers

Related papers: Efficient implementations of the modified Gram-Sch…

200 papers

In recent years, a new kind of accelerated hardware has gained popularity in the Artificial Intelligence (AI) and Machine Learning (ML) communities which enables extremely high-performance tensor contractions in reduced precision for deep…

Computational Physics · Physics 2024-05-01 Adela Habib , Joshua Finkelstein , Anders M. N. Niklasson

Approximate full mass matrix methods for the material point method, known as FMPM(k) of order k, can improve the calculation of grid velocities from grid momentum. It can be implemented in any MPM code by inserting a new calculation task…

Computational Engineering, Finance, and Science · Computer Science 2026-04-09 John A. Nairn

A q-Gauss-Newton algorithm is an iterative procedure that solves nonlinear unconstrained optimization problems based on minimization of the sum squared errors of the objective function residuals. Main advantage of the algorithm is that it…

Optimization and Control · Mathematics 2021-05-28 Danijela Protic , Miomir Stankovic

Traditional MCMC algorithms are computationally intensive and do not scale well to large data. In particular, the Metropolis-Hastings (MH) algorithm requires passing over the entire dataset to evaluate the likelihood ratio in each…

Machine Learning · Statistics 2019-08-29 Tung-Yu Wu , Y. X. Rachel Wang , Wing H. Wong

The geometric multigrid method (GMG) is one of the most efficient solving techniques for discrete algebraic systems arising from elliptic partial differential equations. GMG utilizes a hierarchy of grids or discretizations and reduces the…

Numerical Analysis · Mathematics 2013-01-14 Chunsheng Feng , Shi Shu , Jinchao Xu , Chen-Song Zhang

This work presents a novel approach to compute the eigenvalues of non-Hermitian matrices using an enhanced shifted QR algorithm. The existing QR algorithms fail to converge early in the case of non-hermitian matrices, and our approach shows…

Numerical Analysis · Mathematics 2025-10-16 Chahat Ahuja , Partha Chowdhury , Subhashree Mohapatra

Nonnegative matrix factorization (NMF) has been widely used to dimensionality reduction in machine learning. However, the traditional NMF does not properly handle outliers, so that it is sensitive to noise. In order to improve the…

Machine Learning · Computer Science 2022-06-08 Tingting Shen , Junhang Li , Can Tong , Qiang He , Chen Li , Yudong Yao , Yueyang Teng

Iterative majorize-minimize (MM) (also called optimization transfer) algorithms solve challenging numerical optimization problems by solving a series of "easier" optimization problems that are constructed to guarantee monotonic descent of…

Computation · Statistics 2015-10-23 Madison G. McGaffin , Jeffrey A. Fessler

Nonnegative matrix factorization (NMF) is a data analysis technique used in a great variety of applications such as text mining, image processing, hyperspectral data analysis, computational biology, and clustering. In this paper, we…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

Gaussian Mixture Models (GMMs) are a standard tool in data analysis. However, they face problems when applied to high-dimensional data (e.g., images) due to the size of the required full covariance matrices (CMs), whereas the use of…

Machine Learning · Computer Science 2023-08-29 Alexander Gepperth

Maximum entropy inference and learning of graphical models are pivotal tasks in learning theory and optimization. This work extends algorithms for these problems, including generalized iterative scaling (GIS) and gradient descent (GD), to…

Machine Learning · Computer Science 2024-07-17 Minbo Gao , Zhengfeng Ji , Fuchao Wei

Kernel design for Multi-output Gaussian Processes (MOGP) has received increased attention recently. In particular, the Multi-Output Spectral Mixture kernel (MOSM) arXiv:1709.01298 approach has been praised as a general model in the sense…

Machine Learning · Statistics 2022-02-21 Matías Altamirano , Felipe Tobar

In quantum computing, error mitigation is a method to improve the results of an error-prone quantum processor by post-processing them on a classical computer. In this work, we improve the General Error Mitigation (GEM) method for…

A neighborhood restricted Mixed Gibbs Sampling (MGS) based approach is proposed for low-complexity high-order modulation large-scale Multiple-Input Multiple-Output (LS-MIMO) detection. The proposed LS-MIMO detector applies a neighborhood…

Information Theory · Computer Science 2021-04-20 Alex Mussi , Taufik Abrão

Matrix multiplication (GEMM) is a core operation to numerous scientific applications. Traditional implementations of Strassen-like fast matrix multiplication (FMM) algorithms often do not perform well except for very large matrix sizes, due…

Mathematical Software · Computer Science 2016-11-04 Jianyu Huang , Leslie Rice , Devin A. Matthews , Robert A. van de Geijn

Symmetric nonnegative matrix factorization (SymNMF) is a powerful tool for clustering, which typically uses the $k$-nearest neighbor ($k$-NN) method to construct similarity matrix. However, $k$-NN may mislead clustering since the neighbors…

Machine Learning · Computer Science 2024-12-06 Wenlong Lyu , Yuheng Jia

We present a space-efficient implementation of the quantum verification of matrix products (QVMP) algorithm and demonstrate its functionality by running it on the Aer simulator with two simulation methods: statevector and matrix product…

Quantum Physics · Physics 2022-08-23 Elton Pinto

Post-Training Quantization (PTQ) is pivotal for deploying large language models (LLMs) within resource-limited settings by significantly reducing resource demands. However, existing PTQ strategies underperform at low bit levels < 3 bits due…

Computation and Language · Computer Science 2025-01-31 Wanlong Liu , Yichen Xiao , Dingyi Zeng , Hongyang Zhao , Wenyu Chen , Malu Zhang

Exact diagonalization is a powerful tool to study fractional quantum Hall (FQH) systems. However, its capability is limited by the exponentially increasing computational cost. In order to overcome this difficulty,…

Strongly Correlated Electrons · Physics 2015-10-01 Zhao Liu , R. N. Bhatt

The nonnegative matrix factorization is a widely used, flexible matrix decomposition, finding applications in biology, image and signal processing and information retrieval, among other areas. Here we present a related matrix factorization.…

Machine Learning · Statistics 2017-12-12 David W Dreisigmeyer