English
Related papers

Related papers: Bi-fidelity sparse-grid interpolation driven by a …

200 papers

We propose an efficient algorithm for sparse signal reconstruction problems. The proposed algorithm is an augmented Lagrangian method based on the dual sparse reconstruction problem. It is efficient when the number of unknown variables is…

Machine Learning · Statistics 2010-10-06 Ryota Tomioka , Masashi Sugiyama

Sparse grids are popular tools for high-dimensional function approximation. In this work, we study the use of sparse grids for interpolation using separable Mat\'ern kernels…

Numerical Analysis · Mathematics 2026-04-14 Elliot J. Addy , Aretha L. Teckentrup

Presented in this paper is a new sparse linear solver methodology motivated by multigrid principles and based around general local transformations that diagonalize a matrix while maintaining its sparsity. These transformations are…

Numerical Analysis · Mathematics 2007-05-23 Jonathan E. Moussa

We introduce a sparse estimation in the ordinary kriging for functional data. The functional kriging predicts a feature given as a function at a location where the data are not observed by a linear combination of data observed at other…

Methodology · Statistics 2025-10-28 Hidetoshi Matsui , Yuya Yamakawa

A fast algorithm for the approximation of a low rank LU decomposition is presented. In order to achieve a low complexity, the algorithm uses sparse random projections combined with FFT-based random projections. The asymptotic approximation…

Numerical Analysis · Mathematics 2016-01-19 Yariv Aizenbud , Gil Shabat , Amir Averbuch

Graph sparsification is a well-established technique for accelerating graph-based learning algorithms, which uses edge sampling to approximate dense graphs with sparse ones. Because the sparsification error is random and unknown, users must…

Machine Learning · Computer Science 2025-03-12 Siyao Wang , Miles E. Lopes

This paper is concerned with developing an efficient numerical algorithm for fast implementation of the sparse grid method for computing the $d$-dimensional integral of a given function. The new algorithm, called the MDI-SG ({\em multilevel…

Numerical Analysis · Mathematics 2022-10-27 Huicong Zhong , Xiaobing Feng

This paper introduces the localized sparsifying preconditioner for the pseudospectral approximations of indefinite systems on periodic structures. The work is built on top of the recently proposed sparsifying preconditioner with two major…

Numerical Analysis · Mathematics 2017-05-22 Fei Liu , Lexing Ying

Embedding parameterized optimization problems as layers into machine learning architectures serves as a powerful inductive bias. Training such architectures with stochastic gradient descent requires care, as degenerate derivatives of the…

Machine Learning · Computer Science 2024-12-16 Anselm Paulus , Georg Martius , Vít Musil

Kernel based regularized interpolation is a well known technique to approximate a continuous multivariate function using a set of scattered data points and the corresponding function evaluations, or data values. This method has some…

Numerical Analysis · Mathematics 2018-07-26 Gabriele Santin , Dominik Wittwar , Bernard Haasdonk

We present a hybrid particle/grid approach for simulating incompressible fluids on collocated velocity grids. We interchangeably use particle and grid representations of transported quantities to balance efficiency and accuracy. A novel…

This paper proposes a new framework for providing approximation guarantees of local search algorithms. Local search is a basic algorithm design technique and is widely used for various combinatorial optimization problems. To analyze local…

Data Structures and Algorithms · Computer Science 2020-06-03 Kaito Fujii

Stochastic optimisation problems minimise expectations of random cost functions. We use 'optimise then discretise' method to solve stochastic optimisation. In our approach, accurate quadrature methods are required to calculate the…

Numerical Analysis · Mathematics 2022-02-22 Yuancheng Zhou

We study the proximal gradient descent (PGD) method for $\ell^{0}$ sparse approximation problem as well as its accelerated optimization with randomized algorithms in this paper. We first offer theoretical analysis of PGD showing the bounded…

Optimization and Control · Mathematics 2017-09-06 Yingzhen Yang , Jiashi Feng , Nebojsa Jojic , Jianchao Yang , Thomas S. Huang

Interpolation-based trust-region methods are an important class of algorithms for Derivative-Free Optimization which rely on locally approximating an objective function by quadratic polynomial interpolation models, frequently built from…

Optimization and Control · Mathematics 2013-06-25 Afonso S. Bandeira , Katya Scheinberg , Luis Nunes Vicente

We focus on the study of multigrid methods with aggressive coarsening and polynomial smoothers for the solution of the linear systems corresponding to finite difference/element discretizations of the Laplace equation. Using local Fourier…

Numerical Analysis · Mathematics 2014-12-02 James Brannick , Xiaozhe Hu , Carmen Rodrigo , Ludmil Zikatanov

Sparse grids are tailored to the approximation of smooth high-dimensional functions. On a $d$-dimensional tensor product space, the number of grid points is $N = \mathcal O(h^{-1} |\log h|^{d-1})$, where $h$ is a mesh parameter. The…

Numerical Analysis · Mathematics 2011-06-09 Christoph Reisinger

We consider the problem of uncertainty quantification in change point regressions, where the signal can be piecewise polynomial of arbitrary but fixed degree. That is we seek disjoint intervals which, uniformly at a given confidence level,…

Methodology · Statistics 2024-12-12 Shakeel Gavioli-Akilagun , Piotr Fryzlewicz

We study the acceleration of the Local Polynomial Interpolation-based Gradient Descent method (LPI-GD) recently proposed for the approximate solution of empirical risk minimization problems (ERM). We focus on loss functions that are…

Optimization and Control · Mathematics 2022-04-19 Ekaterina Trimbach , Edward Duc Hien Nguyen , César A. Uribe

The aim of sparse approximation is to estimate a sparse signal according to the measurement matrix and an observation vector. It is widely used in data analytics, image processing, and communication, etc. Up to now, a lot of research has…

Signal Processing · Electrical Eng. & Systems 2018-05-31 Hao Wang , Ruibin Feng , Chi-Sing Leung