English
Related papers

Related papers: Bi-fidelity sparse-grid interpolation driven by a …

200 papers

A new sparse semiparametric model is proposed, which incorporates the influence of two functional random variables in a scalar response in a flexible and interpretable manner. One of the functional covariates is included through a…

Methodology · Statistics 2024-01-29 Silvia Novo , Philippe Vieu , Germán Aneiros

Incorporating sparsity priors in learning tasks can give rise to simple, and interpretable models for complex high dimensional data. Sparse models have found widespread use in structure discovery, recovering data from corruptions, and a…

Machine Learning · Statistics 2014-03-27 Karthikeyan Natesan Ramamurthy , Aleksandr Y. Aravkin , Jayaraman J. Thiagarajan

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

Using characteristics to treat advection terms in time-dependent PDEs leads to a class of schemes, e.g., semi-Lagrangian and Lagrange-Galerkin schemes, which preserve stability under large Courant numbers, and may therefore be appealing in…

Numerical Analysis · Mathematics 2021-04-20 Simone Cacace , Roberto Ferretti

Many recent problems in signal processing and machine learning such as compressed sensing, image restoration, matrix/tensor recovery, and non-negative matrix factorization can be cast as constrained optimization. Projected gradient descent…

Optimization and Control · Mathematics 2022-09-07 Trung Vu , Raviv Raich

In this paper we show that inverses of well-conditioned, finite-time Gramians and impulse response matrices of large-scale interconnected systems described by sparse state-space models, can be approximated by sparse matrices. The…

Systems and Control · Computer Science 2014-05-13 Aleksandar Haber , Michel Verhaegen

Most numerical schemes proposed for solving BGK models for rarefied gas dynamics are based on the discrete velocity approximation. Since such approach uses fixed velocity grids, one must secure a sufficiently large domain with fine velocity…

Numerical Analysis · Mathematics 2022-04-20 Sebastiano Boscarino , Seung Yeon Cho , Giovanni Russo

In order to improve the performance of Least Mean Square (LMS) based system identification of sparse systems, a new adaptive algorithm is proposed which utilizes the sparsity property of such systems. A general approximating approach on…

Information Theory · Computer Science 2015-06-15 Yuantao Gu , Jian Jin , Shunliang Mei

We propose a new approach for metric learning by framing it as learning a sparse combination of locally discriminative metrics that are inexpensive to generate from the training data. This flexible framework allows us to naturally derive…

Machine Learning · Computer Science 2019-01-25 Yuan Shi , Aurélien Bellet , Fei Sha

Our goal is to present an elementary approach to the analysis and programming of sparse grid finite element methods. This family of schemes can compute accurate solutions to partial differential equations, but using far fewer degrees of…

Numerical Analysis · Mathematics 2015-11-24 Stephen Russell , Niall Madden

We consider a sparse grid collocation method in conjunction with a time discretization of the differential equations for computing expectations of functionals of solutions to differential equations perturbed by time-dependent white noise.…

Numerical Analysis · Mathematics 2015-05-18 Z. Zhang , M. V. Tretyakov , B. Rozovskii , G. E. Karniadakis

Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. With high-dimensional…

Machine Learning · Statistics 2017-05-10 Yuting Ma , Tian Zheng

Graph sparsification is a powerful tool to approximate an arbitrary graph and has been used in machine learning over homogeneous graphs. In heterogeneous graphs such as knowledge graphs, however, sparsification has not been systematically…

Machine Learning · Computer Science 2022-11-15 Chandan Chunduru , Chun Jiang Zhu , Blake Gains , Jinbo Bi

This paper presents an algorithm tailored for the efficient recovery of sparse probability measures incorporating $\ell_0$-sparse regularization within the probability simplex constraint. Employing the Bregman proximal gradient method, our…

Optimization and Control · Mathematics 2024-11-26 Jianting Pan , Ming Yan

This paper discusses the error and cost aspects of ill-posed integral equations when given discrete noisy point evaluations on a fine grid. Standard solution methods usually employ discretization schemes that are directly induced by the…

Numerical Analysis · Mathematics 2025-04-04 Michael Griebel , Tim Jahn

We consider scattered data approximation on product regions of equal and different dimensionality. On each of these regions, we assume quasi-uniform but unstructured data sites and construct optimal sparse grids for scattered data…

Numerical Analysis · Mathematics 2026-04-24 Michael Griebel , Helmut Harbrecht , Michael Multerer

In this paper, we present a sparse grid-based Monte Carlo method for solving high-dimensional semi-linear nonlocal diffusion equations with volume constraints. The nonlocal model is governed by a class of semi-linear partial…

Numerical Analysis · Mathematics 2025-07-08 Changtao Sheng , Bihao Su , Chenglong Xu

This paper presents a parametric solution to piecewise linear regression through the Adaptive Block Gradient Descent (ABGD) algorithm. The heart of the method is the parametrization of piecewise linear functions as the difference of…

Machine Learning · Statistics 2026-05-11 Haitham Kanj , Kiryung Lee

We consider the isogeometric analysis for fractional PDEs involving the fractional Laplacian in two dimensions. An isogeometric collocation method is developed to discretize the fractional Laplacian and applied to the fractional Poisson…

Numerical Analysis · Mathematics 2020-05-12 Kailai Xu , Eric Darve

We examine and extend Sparse Grids as a discretization method for partial differential equations (PDEs). Solving a PDE in $D$ dimensions has a cost that grows as $O(N^D)$ with commonly used methods. Even for moderate $D$ (e.g. $D=3$), this…

Numerical Analysis · Computer Science 2017-10-26 Alexander B. Atanasov , Erik Schnetter