English
Related papers

Related papers: Using Mixed Precision in Low-Synchronization Reort…

200 papers

We consider robust submodular maximization problems (RSMs), where given a set of $m$ monotone submodular objective functions, the robustness is with respect to the worst-case (scaled) objective function. The model we consider generalizes…

Optimization and Control · Mathematics 2023-06-12 Hsin-Yi Huang , Hao-Hsiang Wu , Simge Kucukyavuz

Numerous applications require algorithms that can align partially overlapping point sets while maintaining invariance to geometric transformations (e.g., similarity, affine, rigid). This paper introduces a novel global optimization method…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wei Lian , Zhesen Cui , Fei Ma , Hang Pan , Wangmeng Zuo , Jianmei Zhang

We study the computational phase transition in a multi-frequency group synchronization problem, where pairwise relative measurements of group elements are observed across multiple frequency channels and corrupted by Gaussian noise. Using…

Statistics Theory · Mathematics 2026-01-29 Zhangsong Li

Guessing random additive noise decoding (GRAND) is a recently proposed decoding paradigm particularly suitable for codes with short length and high rate. Among its variants, ordered reliability bits GRAND (ORBGRAND) exploits soft…

Information Theory · Computer Science 2024-04-30 Li Wan , Wenyi Zhang

Lossy compression, widely used by scientists to reduce data from simulations, experiments, and observations, can distort features of interest even under bounded error. Such distortions may compromise downstream analyses and lead to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Yuxiao Li , Mingze Xia , Xin Liang , Bei Wang , Robert Underwood , Sheng Di , Hemant Sharma , Dishant Beniwal , Franck Cappello , Hanqi Guo

Although mixed precision arithmetic has recently garnered interest for training dense neural networks, many other applications could benefit from the speed-ups and lower storage cost if applied appropriately. The growing interest in…

Numerical Analysis · Mathematics 2021-03-02 L. Minah Yang , Alyson Fox , Geoffrey Sanders

Orthogonal time frequency space (OTFS) modulation has recently emerged as a potential 6G candidate waveform which provides improved performance in high-mobility scenarios. In this paper we investigate the combination of OTFS with…

Signal Processing · Electrical Eng. & Systems 2022-11-15 Stephen McWade , Mark F. Flanagan , Arman Farhang

Locally Optimal Block Preconditioned Conjugate Gradient (LOBPCG) is widely used to compute eigenvalues of large sparse symmetric matrices. The algorithm can suffer from numerical instability if it is not implemented with care. This is…

Numerical Analysis · Mathematics 2018-10-05 Jed A. Duersch , Meiyue Shao , Chao Yang , Ming Gu

Binaural reproduction is gaining increasing attention with the rise of devices such as virtual reality headsets, smart glasses, and head-tracked headphones. Achieving accurate binaural signals with these systems is challenging, as they…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-24 Dor Shamay , Boaz Rafaely

The bulk synchronous parallel (BSP) model struggles with irregular workloads due to rigid global communication. While fine-grained asynchronous BSP (FA-BSP) improves overlap, existing implementations typically rely on a limiting…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Minyu Cheng , Jiakun Yan , Marc Snir

Variance reduction techniques such as SPIDER/SARAH/STORM have been extensively studied to improve the convergence rates of stochastic non-convex optimization, which usually maintain and update a sequence of estimators for a single function…

Machine Learning · Computer Science 2023-01-02 Wei Jiang , Gang Li , Yibo Wang , Lijun Zhang , Tianbao Yang

Orthogonal polynomials of several variables have a vector-valued three-term recurrence relation, much like the corresponding one-dimensional relation. This relation requires only knowledge of certain recurrence matrices, and allows simple…

Numerical Analysis · Mathematics 2022-02-17 Zexin Liu , Akil Narayan

This paper introduces the multiplicative variant of the recently proposed asynchronous additive coarse-space correction method. Definition of an asynchronous extension of multiplicative correction is not straightforward, however, our…

Numerical Analysis · Mathematics 2023-12-20 Guillaume Gbikpi-Benissan , Frédéric Magoulès

Orthogonal least square (OLS) is an important sparse signal recovery algorithm for compressive sensing, which enjoys superior probability of success over other well-known recovery algorithms under conditions of correlated measurement…

Information Theory · Computer Science 2018-08-02 Samrat Mukhopadhyay , Siddhartha Satpathi , Mrityunjoy Chakraborty

Support for lower precision computation is becoming more common in accelerator hardware due to lower power usage, reduced data movement and increased computational performance. However, computational science and engineering (CSE) problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-06 Jennifer A. Loe , Christian A. Glusa , Ichitaro Yamazaki , Erik G. Boman , Sivasankaran Rajamanickam

Orthogonal matching pursuit (OMP) and orthogonal least squares (OLS) are widely used for sparse signal reconstruction in under-determined linear regression problems. The performance of these compressed sensing (CS) algorithms depends…

Machine Learning · Statistics 2017-07-28 Sreejith Kallummil , Sheetal Kalyani

This paper addresses the problem of blind demixing of instantaneous mixtures in a multiple-input multiple-output communication system. The main objective is to present efficient blind source separation (BSS) algorithms dedicated to moderate…

Information Theory · Computer Science 2016-06-30 Syed A. W. Shah , Karim Abed-Meraim , Tareq Y. Al-Naffouri

We present a convergence rate analysis for biased stochastic gradient descent (SGD), where individual gradient updates are corrupted by computation errors. We develop stochastic quadratic constraints to formulate a small linear matrix…

Optimization and Control · Mathematics 2020-03-31 Bin Hu , Peter Seiler , Laurent Lessard

Various numerical linear algebra problems can be formulated as evaluating bivariate function of matrices. The most notable examples are the Fr\'echet derivative along a direction, the evaluation of (univariate) functions of…

Numerical Analysis · Mathematics 2021-04-02 Stefano Massei , Leonardo Robol

In many applications, we need algorithms which can align partially overlapping point sets and are invariant to the corresponding transformations. In this work, a method possessing such properties is realized by minimizing the objective of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Wei Lian , Wangmeng Zuo