English
Related papers

Related papers: Empirical sparse regression on quadratic manifolds

200 papers

Greedy approaches in general, and orthogonal matching pursuit in particular, are the most commonly used sparse recovery techniques in a wide range of applications. The complexity of these approaches is highly dependent on the size of the…

Signal Processing · Electrical Eng. & Systems 2022-08-25 Joan Palacios , Nuria González-Prelcic , Cristian Rusu

Sparse signal representations based on linear combinations of learned atoms have been used to obtain state-of-the-art results in several practical signal processing applications. Approximation methods are needed to process high-dimensional…

Machine Learning · Computer Science 2020-02-17 Fredrik Sandin , Sergio Martin-del-Campo

This paper introduces a sparse matrix discrete interpolation method to effectively compute matrix approximations in the reduced order modeling framework. The sparse algorithm developed herein relies on the discrete empirical interpolation…

Numerical Analysis · Mathematics 2015-06-16 Răzvan Ştefănescu , Adrian Sandu

A key challenge with controlling complex dynamical systems is to accurately model them. However, this requirement is very hard to satisfy in practice. Data-driven approaches such as Gaussian processes (GPs) have proved quite effective by…

Robotics · Computer Science 2022-03-08 Mouhyemen Khan , Akash Patel , Abhijit Chatterjee

We study the problem of variable selection in convex nonparametric regression. Under the assumption that the true regression function is convex and sparse, we develop a screening procedure to select a subset of variables that contains the…

Statistics Theory · Mathematics 2014-11-19 Min Xu , Minhua Chen , John Lafferty

After a decade of extensive study of the sparse representation synthesis model, we can safely say that this is a mature and stable field, with clear theoretical foundations, and appealing applications. Alongside this approach, there is an…

Numerical Analysis · Mathematics 2012-04-26 Sangnam Nam , Mike E. Davies , Michael Elad , Rémi Gribonval

We propose an extrinsic regression framework for modeling data with manifold valued responses and Euclidean predictors. Regression with manifold responses has wide applications in shape analysis, neuroscience, medical imaging and many other…

Statistics Theory · Mathematics 2015-08-11 Lizhen Lin , Brian St. Thomas , Hongtu Zhu , David B. Dunson

Graphical modeling explores dependences among a collection of variables by inferring a graph that encodes pairwise conditional independences. For jointly Gaussian variables, this translates into detecting the support of the precision…

Methodology · Statistics 2018-02-16 Shota Katayama , Hironori Fujisawa , Mathias Drton

Interpolation of sparse pixel information towards a dense target resolution finds its application across multiple disciplines in computer vision. State-of-the-art interpolation of motion fields applies model-based interpolation that makes…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 René Schuster , Oliver Wasenmüller , Christian Unger , Didier Stricker

Sparse autoencoders are a standard tool for uncovering interpretable latent representations in neural networks. Yet, their interpretation depends on the inputs, making their isolated study incomplete. Polynomials offer a solution; they…

Machine Learning · Computer Science 2025-10-21 Thomas Dooms , Ward Gauderis

Some elements of the theory and algorithmics corresponding to the computation of semilinear sparse models for discrete-time signals are presented. In this study, we will focus on approximately eventually periodic discrete-time signals, that…

Optimization and Control · Mathematics 2021-10-22 Fredy Vides

We develop a hierarchical Gaussian process model for forecasting and inference of functional time series data. Unlike existing methods, our approach is especially suited for sparsely or irregularly sampled curves and for curves sampled with…

Methodology · Statistics 2019-07-02 Daniel R. Kowal , David S. Matteson , David Ruppert

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

This paper describes a hierarchical learning strategy for generating sparse representations of multivariate datasets. The hierarchy arises from approximation spaces considered at successively finer scales. A detailed analysis of stability,…

Machine Learning · Statistics 2019-10-23 Prashant Shekhar , Abani Patra

Many models for sparse regression typically assume that the covariates are known completely, and without noise. Particularly in high-dimensional applications, this is often not the case. This paper develops efficient OMP-like algorithms to…

Statistics Theory · Mathematics 2015-03-31 Yudong Chen , Constantine Caramanis

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression. The algorithm estimates an inducing set and the hyperparameters using a single objective, either the…

Machine Learning · Computer Science 2013-11-12 Yanshuai Cao , Marcus A. Brubaker , David J. Fleet , Aaron Hertzmann

Causal structure learning, also known as causal discovery, aims to estimate causal relationships between variables as a form of a causal directed acyclic graph (DAG) from observational data. One of the major frameworks is the order-based…

Machine Learning · Statistics 2026-02-18 Kentaro Kanamori , Hirofumi Suzuki , Takuya Takagi

The sampling of graph signals has recently drawn much attention due to the wide applications of graph signal processing. While a lot of efficient methods and interesting results have been reported to the sampling of band-limited or smooth…

Signal Processing · Electrical Eng. & Systems 2025-01-01 Yingcheng Lai , Li Chai , Jinming Xu

A new statistical model designed for regression analysis with a sparse design matrix is proposed. This new model utilizes the positions of the limited non-zero elements in the design matrix to decompose the regression model into…

Applications · Statistics 2022-01-17 Hsien-Wei Chen

We introduce a novel procedure that, given sparse data generated from a stationary deterministic nonlinear dynamical system, can characterize specific local and/or global dynamic behavior with rigorous probability guarantees. More…

Dynamical Systems · Mathematics 2023-09-19 Bogdan Batko , Marcio Gameiro , Ying Hung , William Kalies , Konstantin Mischaikow , Ewerton Vieira