English
Related papers

Related papers: Sparse additive function decompositions facing bas…

200 papers

We consider the following multi-component sparse PCA problem: given a set of data points, we seek to extract a small number of sparse components with disjoint supports that jointly capture the maximum possible variance. These components can…

Sparse Principal Components Analysis aims to find principal components with few non-zero loadings. We derive such sparse solutions by adding a genuine sparsity requirement to the original Principal Components Analysis (PCA) objective…

Methodology · Statistics 2014-08-19 Giovanni Maria Merola

Signal models formed as linear combinations of few atoms from an over-complete dictionary or few frame vectors from a redundant frame have become central to many applications in high dimensional signal processing and data analysis. A core…

Information Theory · Computer Science 2024-08-30 Xuemei Chen , Christian Kümmerle , Rongrong Wang

Data is said to follow the transform (or analysis) sparsity model if it becomes sparse when acted on by a linear operator called a sparsifying transform. Several algorithms have been designed to learn such a transform directly from data,…

Machine Learning · Statistics 2019-01-30 Luke Pfister , Yoram Bresler

Large pre-trained transformers have revolutionized artificial intelligence across various domains, and fine-tuning remains the dominant approach for adapting these models to downstream tasks due to the cost of training from scratch.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Wei Chen , Jingxi Yu , Zichen Miao , Qiang Qiu

The use of tools from analysis to approach problems in graph theory has become an active area of research. Usually such methods are applied to problems involving dense graphs and hypergraphs; here we give the an extension of such methods to…

Combinatorics · Mathematics 2018-01-24 Henry Towsner

This paper proposes a subspace decomposition method based on an over-complete dictionary in sparse representation, called "Sparse Signal Subspace Decomposition" (or 3SD) method. This method makes use of a novel criterion based on the…

Machine Learning · Statistics 2016-10-28 Hong Sun , Chengwei Sang , Didier Le Ruyet

Functional principal component analysis (FPCA) is a fundamental tool and has attracted increasing attention in recent decades, while existing methods are restricted to data with a single or finite number of random functions (much smaller…

Methodology · Statistics 2021-01-22 Xiaoyu Hu , Fang Yao

This article presents two novel adaptive-sparse polynomial dimensional decomposition (PDD) methods for solving high-dimensional uncertainty quantification problems in computational science and engineering. The methods entail global…

Numerical Analysis · Mathematics 2015-06-18 Vaibhav Yadav , Sharif Rahman

In this paper an extension of the sparse decomposition problem is considered and an algorithm for solving it is presented. In this extension, it is known that one of the shifted versions of a signal s (not necessarily the original signal…

Multimedia · Computer Science 2008-09-23 Hamed Firouzi , Massoud Babaie-Zadeh , Aria Ghasemian , Christian Jutten

This paper focuses on the identification of graphical autoregressive models with dynamical latent variables. The dynamical structure of latent variables is described by a matrix polynomial transfer function. Taking account of the sparse…

Methodology · Statistics 2023-07-24 Junyao You , Chengpu Yu

In this work we study convergence properties of sparse polynomial approximations for a class of affine parametric saddle point problems. Such problems can be found in many computational science and engineering fields, including the Stokes…

Numerical Analysis · Mathematics 2018-09-28 Peng Chen , Omar Ghattas

Multiplication of a sparse matrix with another (dense or sparse) matrix is a fundamental operation that captures the computational patterns of many data science applications, including but not limited to graph algorithms, sparsely connected…

Numerical Analysis · Mathematics 2025-08-07 Aydın Buluç

The computational cost of many signal processing and machine learning techniques is often dominated by the cost of applying certain linear operators to high-dimensional vectors. This paper introduces an algorithm aimed at reducing the…

Machine Learning · Computer Science 2016-03-30 Luc Le Magoarou , Rémi Gribonval

Many high-dimensional data sets suffer from hidden confounding which affects both the predictors and the response of interest. In such situations, standard regression methods or algorithms lead to biased estimates. This paper substantially…

Methodology · Statistics 2024-12-17 Cyrill Scheidegger , Zijian Guo , Peter Bühlmann

An image super-resolution method from multiple observation of low-resolution images is proposed. The method is based on sub-pixel accuracy block matching for estimating relative displacements of observed images, and sparse signal…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Toshiyuki Kato , Hideitsu Hino , Noboru Murata

We consider linear dynamical systems of ordinary differential equations or differential algebraic equations. Physical parameters are substituted by random variables for an uncertainty quantification. We expand the state variables as well as…

Numerical Analysis · Mathematics 2016-05-24 Roland Pulch

Pose graph optimization is a special case of the simultaneous localization and mapping problem where the only variables to be estimated are pose variables and the only measurements are inter-pose constraints. The vast majority of pose graph…

Robotics · Computer Science 2022-12-09 Brendon Forsgren , Kevin Brink , Prashant Ganesh , Timothy McLain

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

Optimization and Control · Mathematics 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

We establish a general theory for subsampling network data generated by the sparse graphon model. In contrast to previous work for networks, we demonstrate validity under minimal assumptions; the main requirement is weak convergence of the…

Statistics Theory · Mathematics 2019-08-27 Robert Lunde , Purnamrita Sarkar