English
Related papers

Related papers: Sparse approximation of multilinear problems with …

200 papers

We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature…

Machine Learning · Statistics 2012-10-04 Krishnakumar Balasubramanian , Kai Yu , Guy Lebanon

Smolyak's method, also known as hyperbolic cross approximation or sparse grid method, is a powerful tool to tackle multivariate tensor product problems solely with the help of efficient algorithms for the corresponding univariate problem.…

Numerical Analysis · Mathematics 2021-09-21 Michael Gnewuch , Marcin Wnuk

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

Methodology · Statistics 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

We present a unified framework for quantum sensitivity sampling, extending the advantages of quantum computing to a broad class of classical approximation problems. Our unified framework provides a streamlined approach for constructing…

Data Structures and Algorithms · Computer Science 2025-09-23 Zhao Song , David P. Woodruff , Lichen Zhang

Semiparametric regression offers a flexible framework for modeling non-linear relationships between a response and covariates. A prime example are generalized additive models where splines (say) are used to approximate non-linear functional…

Statistics Theory · Mathematics 2018-10-05 Francis K. C. Hui , Chong You , Han Lin Shang , Samuel Müller

Inverse problems defined naturally on the sphere are becoming increasingly of interest. In this article we provide a general framework for evaluation of inverse problems on the sphere, with a strong emphasis on flexibility and scalability.…

Information Theory · Computer Science 2021-05-17 Matthew A. Price , Luke Pratley , Jason D. McEwen

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and…

Machine Learning · Computer Science 2010-10-28 Marius Kloft , Ulf Brefeld , Soeren Sonnenburg , Alexander Zien

In spatial statistics and machine learning, the kernel matrix plays a pivotal role in prediction, classification, and maximum likelihood estimation. A thorough examination reveals that for large sample sizes, the kernel matrix becomes…

Machine Learning · Statistics 2023-11-07 Hao Zhang

Radial basis functions have become a popular tool for approximation and solution of partial differential equations (PDEs). The recently proposed multilevel sparse interpolation with kernels (MuSIK) algorithm proposed in \cite{Georgoulis}…

Numerical Analysis · Mathematics 2017-10-20 Yangzhang Zhao , Qi Zhang , Jeremy Levesley

This paper addresses matrix approximation problems for matrices that are large, sparse and/or that are representations of large graphs. To tackle these problems, we consider algorithms that are based primarily on coarsening techniques,…

Numerical Analysis · Computer Science 2018-10-03 Shashanka Ubaru , Yousef Saad

The structure uncertainty optimization problem is usually treated as double-loop optimization process, which is computation-intensive. In this paper, an efficient interval uncertainty optimization approach based on Quasi-sparse response…

Optimization and Control · Mathematics 2019-09-16 Kefeng Wang , Pu Li , Yanfeng Zhang , Yunbao Huang

We provide a general discussion of Smolyak's algorithm for the acceleration of scientific computations. The algorithm first appeared in Smolyak's work on multidimensional integration and interpolation. Since then, it has been generalized in…

Numerical Analysis · Mathematics 2018-07-17 Raul Tempone , Soeren Wolfers

We develop a novel framework for sparse multiscale kernel approximation of large scattered data problems based on a samplet representation. Samplets form a multiresolution analysis of localized discrete signed measures and enable…

Numerical Analysis · Mathematics 2026-04-03 Sara Avesani , Gaia Fumagalli , Michael Multerer , Chiara Segala

Information processing techniques based on sparseness have been actively studied in several disciplines. Among them, a mathematical framework to approximately express a given dataset by a combination of a small number of basis vectors of an…

Information Theory · Computer Science 2016-05-04 Tomoyuki Obuchi , Yoshiyuki Kabashima

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled

In this work, we study the problem of finding approximate, with minimum support set, solutions to matrix max-plus equations, which we call sparse approximate solutions. We show how one can obtain such solutions efficiently and in polynomial…

Optimization and Control · Mathematics 2020-12-22 Nikos Tsilivis , Anastasios Tsiamis , Petros Maragos

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

Kernel matrices, as well as weighted graphs represented by them, are ubiquitous objects in machine learning, statistics and other related fields. The main drawback of using kernel methods (learning and inference using kernel matrices) is…

Machine Learning · Computer Science 2022-12-02 Ainesh Bakshi , Piotr Indyk , Praneeth Kacham , Sandeep Silwal , Samson Zhou

Multigraph matching is a recent variant of the graph matching problem. In this framework, the optimization procedure considers several graphs and enforces the consistency of the matches along the graphs. This constraint can be formalized as…

Machine Learning · Computer Science 2022-10-12 François-Xavier Dupé , Rohit Yadav , Guillaume Auzias , S. Takerkart