English
Related papers

Related papers: Cascading GEMM: High Precision from Low Precision

200 papers

In sparse Bayesian learning (SBL), Gaussian scale mixtures (GSMs) have been used to model sparsity-inducing priors that realize a class of concave penalty functions for the regression task in real-valued signal models. Motivated by the…

We present a novel approach for accelerating convolutions during inference for CPU-based architectures. The most common method of computation involves packing the image into the columns of a matrix (im2col) and performing general matrix…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Amir Ofir , Gil Ben-Artzi

Neural Radiance Fields (NeRF) enables 3D scene reconstruction from several 2D images but incurs high rendering latency via its point-sampling design. 3D Gaussian Splatting (3DGS) improves on NeRF with explicit scene representation and an…

Hardware Architecture · Computer Science 2026-04-07 Haomin Li , Bowen Zhu , Fangxin Liu , Zongwu Wang , Xinran Liang , Li Jiang , Haibing Guan

Sparse general matrix multiplication (SpGEMM) is a fundamental building block in numerous scientific applications. One critical task of SpGEMM is to compute or predict the structure of the output matrix (i.e., the number of nonzero elements…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-29 Zhaoyang Du , Yijin Guan , Tianchan Guan , Dimin Niu , Nianxiong Tan , Xiaopeng Yu , Hongzhong Zheng , Jianyi Meng , Xiaolang Yan , Yuan Xie

Mixed-precision quantization improves the budget--accuracy trade-off for large language models (LLMs) by allocating more bits to sensitive modules. However, automating this allocation at LLM scale faces a unique combination of constraints:…

Machine Learning · Computer Science 2026-05-19 Zhangyang Yao , Haiyan Zhao , Haoyu Wang , Tianbo Huang , Lihua Zhang , Xu Han

Stereo depth estimation is used for many computer vision applications. Though many popular methods strive solely for depth quality, for real-time mobile applications (e.g. prosthetic glasses or micro-UAVs), speed and power efficiency are…

Image and Video Processing · Electrical Eng. & Systems 2019-08-09 Oscar Rahnama , Tommaso Cavallari , Stuart Golodetz , Simon Walker , Philip H. S. Torr

Large language models (LLMs) face significant inference latency due to inefficiencies in GEMM operations, weight access, and KV cache access, especially in real-time scenarios. This highlights the need for a versatile compute-memory…

Hardware Architecture · Computer Science 2025-09-15 Huizheng Wang , Zichuan Wang , Zhiheng Yue , Yousheng Long , Taiquan Wei , Jianxun Yang , Yang Wang , Chao Li , Shaojun Wei , Yang Hu , Shouyi Yin

MIMO systems can simultaneously transmit multiple data streams within the same frequency band, thus exploiting the spatial dimension to enhance performance. MIMO detection poses considerable challenges due to the interference and noise…

Information Theory · Computer Science 2024-12-13 Shachar Shayovitz , Doron Ezri , Yoav Levinbook

Mathematical operators whose transformation rules constitute the building blocks of a multi-linear algebra are widely used in physics and engineering applications where they are very often represented as tensors. In the last century, thanks…

Mathematical Software · Computer Science 2013-07-09 Edoardo Di Napoli , Diego Fabregat-Traver , Gregorio Quintana-Ortì , Paolo Bientinesi

Matrix multiplication is a fundamental operation in both training of neural networks and inference. To accelerate matrix multiplication, Graphical Processing Units (GPUs) provide it implemented in hardware. Due to the increased throughput…

Mathematical Software · Computer Science 2026-04-07 Faizan A. Khattak , Mantas Mikaitis

Recently, a so-called E-MS algorithm was developed for model selection in the presence of missing data. Specifically, it performs the Expectation step (E step) and Model Selection step (MS step) alternately to find the minimum point of the…

Methodology · Statistics 2021-06-22 Ping-Feng Xu , Lai-Xu Shang , Man-Lai Tang , Na Shan , Guoliang Tian

Gaussian Mixture Models are a powerful tool in Data Science and Statistics that are mainly used for clustering and density approximation. The task of estimating the model parameters is in practice often solved by the Expectation…

Machine Learning · Statistics 2022-08-25 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Do all instances need inference through the big models for a correct prediction? Perhaps not; some instances are easy and can be answered correctly by even small capacity models. This provides opportunities for improving the computational…

Computation and Language · Computer Science 2022-10-12 Neeraj Varshney , Chitta Baral

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian…

Machine Learning · Statistics 2023-03-28 Pierre Houdouin , Esa Ollila , Frederic Pascal

Approximate computing is a promising approach to reduce the power, delay, and area in hardware design for many error-resilient applications such as machine learning (ML) and digital signal processing (DSP) systems, in which multipliers…

Hardware Architecture · Computer Science 2023-10-31 Zhen Li , Hao Zhou , Lingli Wang

The Gaussian Process Latent Variable Model (GP-LVM) is a non-linear probabilistic method of embedding a high dimensional dataset in terms low dimensional `latent' variables. In this paper we illustrate that maximum a posteriori (MAP)…

Machine Learning · Statistics 2013-07-02 James Barrett , Anthony C. C. Coolen

This paper investigates Gaussian copula mixture models (GCMM), which are an extension of Gaussian mixture models (GMM) that incorporate copula concepts. The paper presents the mathematical definition of GCMM and explores the properties of…

Machine Learning · Computer Science 2023-05-25 Ke Wan , Alain Kornhauser

Low-precision arithmetic has had a transformative effect on the training of neural networks, reducing computation, memory and energy requirements. However, despite its promise, low-precision arithmetic has received little attention for…

Machine Learning · Computer Science 2022-07-15 Wesley J. Maddox , Andres Potapczynski , Andrew Gordon Wilson

Gaussian mixture models (GMM) and support vector machines (SVM) are introduced to classify faults in a population of cylindrical shells. The proposed procedures are tested on a population of 20 cylindrical shells and their performance is…

Artificial Intelligence · Computer Science 2007-05-23 Tshilidzi Marwala , Unathi Mahola , Snehashish Chakraverty

In recent years Gas Electron Multipliers have proven to be reliable amplification stages at high beam rates, and can be used also in Time Projection Chambers. Our group developed a 1 dm$^3$ active volume double-GEM TPC, with spatial…

Instrumentation and Detectors · Physics 2020-09-07 Gábor Galgóczi , Gergő Hamar , Péter Pázmándi , Dezső Varga