English
Related papers

Related papers: Three-precision iterative refinement with paramete…

200 papers

The main objective of this work consists in analyzing sub-structuring method for the parallel solution of sparse linear systems with matrices arising from the discretization of partial differential equations such as finite element, finite…

Numerical Analysis · Mathematics 2021-08-31 Abal-Kassim Cheik Ahamed , Frédéric Magoulès

In this paper we develop the Greedy Recombination Interpolation Method (GRIM) for finding sparse approximations of functions initially given as linear combinations of some (large) number of simpler functions. In a similar spirit to the…

Numerical Analysis · Mathematics 2024-03-11 Terry Lyons , Andrew D. McLeod

The computation of generalized inverses of quaternion matrices is a fundamental problem in quaternion linear algebra, with wide-ranging applications in signal processing, image restoration, and multidimensional data analysis. This paper…

Numerical Analysis · Mathematics 2026-05-05 Biswarup Karmakar , Neha Bhadala , Ratikanta Behera

Recently, several studies proposed methods to utilize some classes of optimization problems in designing deep neural networks to encode constraints that conventional layers cannot capture. However, these methods are still in their infancy…

Machine Learning · Computer Science 2020-06-16 Younghan Jeon , Minsik Lee , Jin Young Choi

Particle-based Variational Inference (ParVI) methods approximate the target distribution by iteratively evolving finite weighted particle systems. Recent advances of ParVI methods reveal the benefits of accelerated position update…

Machine Learning · Computer Science 2023-12-29 Fangyikang Wang , Huminhao Zhu , Chao Zhang , Hanbin Zhao , Hui Qian

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data…

Machine Learning · Computer Science 2023-07-11 Vanessa Gómez-Verdejo , Emilio Parrado-Hernández , Manel Martínez-Ramón

In industrial big data scenarios, high-dimensional sparse matrices (HDI) are widely used to characterize high-order interaction relationships among massive nodes. The stochastic gradient descent-based latent factor analysis (SGD-LFA) method…

Machine Learning · Computer Science 2025-08-26 Jinli Li , Shiyu Long , Minglian Han

As deep neural networks become the state-of-the-art approach in the field of computer vision for dense prediction tasks, many methods have been developed for automatic estimation of the target outputs given the visual inputs. Although the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Fanqing Lin , Brian Price , Tony Martinez

We apply mixed-precision to the low-rank Lyapunov ADI (LR-ADI) by performing certain aspects of the algorithm in a lower working precision. Namely, we accumulate the overall solution, solve the linear systems comprising the ADI iteration,…

Numerical Analysis · Mathematics 2026-02-11 Jonas Schulze , Jens Saak

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

We analyse and explain the increased generalisation performance of iterate averaging using a Gaussian process perturbation model between the true and batch risk surface on the high dimensional quadratic. We derive three phenomena…

Machine Learning · Statistics 2021-11-02 Diego Granziol , Xingchen Wan , Samuel Albanie , Stephen Roberts

We consider the low-rank alternating directions implicit (ADI) iteration for approximately solving large-scale algebraic Sylvester equations. Inside every iteration step of this iterative process a pair of linear systems of equations has to…

Numerical Analysis · Mathematics 2023-12-06 Patrick Kürschner

Gaussian splatting has gained attention for its efficient representation and rendering of 3D scenes using continuous Gaussian primitives. However, it struggles with sparse-view inputs due to limited geometric and photometric information,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Jianing Zhang , Yuchao Zheng , Ziwei Li , Qionghai Dai , Xiaoyun Yuan

We propose a randomized first order optimization algorithm Gradient Projection Iterative Sketch (GPIS) and an accelerated variant for efficiently solving large scale constrained Least Squares (LS). We provide theoretical convergence…

Optimization and Control · Mathematics 2017-07-18 Junqi Tang , Mohammad Golbabaee , Mike Davies

This paper explores the application of kernel learning methods for parameter prediction and evaluation in the Algebraic Multigrid Method (AMG), focusing on several Partial Differential Equation (PDE) problems. AMG is an efficient iterative…

Numerical Analysis · Mathematics 2025-10-31 Junyue Luo , Xiaoqiang Yue , Fangfang Zhang , Juan Zhang

Sparse-view Computed Tomography (CT) is an emerging protocol designed to reduce X-ray dose radiation in medical imaging. Traditional Filtered Back Projection algorithm reconstructions suffer from severe artifacts due to sparse data. In…

Numerical Analysis · Mathematics 2024-12-03 Elena Loli Piccolomini , Davide Evangelista , Elena Morotti

A fast multilevel algorithm based on directionally scaled tensor-product Gaussian kernels on structured sparse grids is proposed for interpolation of high-dimensional functions and for the numerical integration of high-dimensional…

Numerical Analysis · Mathematics 2015-01-15 Zhaonan Dong , Emmanuil H. Georgoulis , Jeremy Levesley , Fuat Usta

A new concept is introduced for the adaptive finite element discretization of partial differential equations that have a sparsely representable solution. Motivated by recent work on compressed sensing, a recursive mesh refinement procedure…

Numerical Analysis · Mathematics 2009-02-26 Sadegh Jokar , Volker Mehrmann , Marc Pfetsch , Harry Yserentant

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression. The algorithm estimates an inducing set and the hyperparameters using a single objective, either the…

Machine Learning · Computer Science 2013-11-12 Yanshuai Cao , Marcus A. Brubaker , David J. Fleet , Aaron Hertzmann