English
Related papers

Related papers: The height function of a sparse collection: a Bell…

200 papers

Many applications like audio and image processing show that sparse representations are a powerful and efficient signal modeling technique. Finding an optimal dictionary that generates at the same time the sparsest representations of data…

Machine Learning · Computer Science 2022-01-12 Paul Irofti , Cristian Rusu , Andrei Pătraşcu

We propose an efficient algorithm for sparse signal reconstruction problems. The proposed algorithm is an augmented Lagrangian method based on the dual sparse reconstruction problem. It is efficient when the number of unknown variables is…

Machine Learning · Statistics 2010-10-06 Ryota Tomioka , Masashi Sugiyama

In this note we give simple proofs of several results involving maximal truncated Calde\'on-Zygmund operators in the general setting of rearrangement invariant quasi-Banach function spaces by sparse domination. Our techniques allow us to…

Classical Analysis and ODEs · Mathematics 2019-10-29 Theresa C. Anderson , Bingyang Hu

Recently, sparse autoencoders (SAEs) have emerged as a promising technique for interpreting activations in foundation models by disentangling features into a sparse set of concepts. However, identifying the optimal level of sparsity for…

Machine Learning · Computer Science 2026-04-17 Dongsheng Wang , Jinsen Zhang , Dawei Su , Hui Huang

The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive and sum to one, and the corresponding loss function allows to…

Machine Learning · Computer Science 2021-12-24 Shaoshi Sun , Zhenyuan Zhang , BoCheng Huang , Pengbin Lei , Jianlin Su , Shengfeng Pan , Jiarun Cao

Distributed statistical learning has become a popular technique for large-scale data analysis. Most existing work in this area focuses on dividing the observations, but we propose a new algorithm, DDAC-SpAM, which divides the features under…

Machine Learning · Computer Science 2023-07-11 Yifan He , Ruiyang Wu , Yong Zhou , Yang Feng

We consider the problem of clustering functional data while jointly selecting the most relevant features for classification. This problem has never been tackled before in the functional data context, and it requires a proper definition of…

Methodology · Statistics 2015-01-21 Davide Floriello , Valeria Vitelli

Block sparsity is an important parameter in many algorithms to successfully recover block sparse signals under the framework of compressive sensing. However, it is often unknown and needs to be estimated. Recently there emerges a few…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Jianfeng Wang , Zhiyong Zhou , Jun Yu

Despite the importance of sparsity signal models and the increasing prevalence of high-dimensional streaming data, there are relatively few algorithms for dynamic filtering of time-varying sparse signals. Of the existing algorithms, fewer…

Statistics Theory · Mathematics 2016-11-03 Adam Charles , Aurele Balavoine , Christopher Rozell

Sparse tensor best rank-1 approximation (BR1Approx), which is a sparsity generalization of the dense tensor BR1Approx, and is a higher-order extension of the sparse matrix BR1Approx, is one of the most important problems in sparse tensor…

Numerical Analysis · Mathematics 2022-07-15 Xianpeng Mao , Yuning Yang

In this paper, using the Bregman distance, we introduce a new projection-type algorithm for finding a common element of the set of solutions of an equilibrium problem and the set of fixed points. Then the strong convergence of the sequence…

Optimization and Control · Mathematics 2021-12-28 Mostafa Ghadampour , Ebrahim Soori , Ravi P. Agarwal , Donal O'Regan

Sparse coding consists in representing signals as sparse linear combinations of atoms selected from a dictionary. We consider an extension of this framework where the atoms are further assumed to be embedded in a tree. This is achieved…

Machine Learning · Statistics 2011-08-18 Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski , Francis Bach

We investigate a generalized framework to estimate a latent low-rank plus sparse tensor, where the low-rank tensor often captures the multi-way principal components and the sparse tensor accounts for potential model mis-specifications or…

Methodology · Statistics 2022-04-15 Jian-Feng Cai , Jingyang Li , Dong Xia

The goal of this expository paper is to give a self-contained introduction to sparse domination. This is a method relying on techniques from dyadic Harmonic Analysis which has received a lot of attention in recent years. Essentially, it…

Classical Analysis and ODEs · Mathematics 2024-07-09 Rodrigo Duarte

We present and analyze a novel sparse polynomial technique for approximating high-dimensional Hilbert-valued functions, with application to parameterized partial differential equations (PDEs) with deterministic and stochastic inputs. Our…

Numerical Analysis · Mathematics 2020-01-22 Nick Dexter , Hoang Tran , Clayton Webster

A function $f: \mathbb{R}^d \rightarrow \mathbb{R}$ is a Sparse Additive Model (SPAM), if it is of the form $f(\mathbf{x}) = \sum_{l \in \mathcal{S}}\phi_{l}(x_l)$ where $\mathcal{S} \subset [d]$, $|\mathcal{S}| \ll d$. Assuming $\phi$'s,…

Machine Learning · Computer Science 2017-05-09 Hemant Tyagi , Anastasios Kyrillidis , Bernd Gärtner , Andreas Krause

We address $L^p(\mu)\rightarrow L^p(\lambda)$ bounds for paraproducts in the Bloom setting. We introduce certain "sparse BMO" functions associated with sparse collections with no infinitely increasing chains, and use these to express sparse…

Classical Analysis and ODEs · Mathematics 2022-01-19 Valentia Fragkiadaki , Irina Holmes Fay

We precisely evaluate Bellman type functions for the dyadic maximal opeator on $R^n$ and of maximal operators on martingales related to local Lorentz type estimates. Using a type of symmetrization principle, introduced for the dyadic…

Functional Analysis · Mathematics 2015-11-20 Antonios D. Melas , Eleftherios N. Nikolidakis

Sparsity is one of the key concepts that allows the recovery of signals that are subsampled at a rate significantly lower than required by the Nyquist-Shannon sampling theorem. Our proposed framework uses arbitrary multiscale transforms,…

Optimization and Control · Mathematics 2017-05-31 Jackie Ma , Maximilian März

In this paper, we focus on approximating a natural class of functions that are compositions of smooth functions. Unlike the low-dimensional support assumption on the covariate, we demonstrate that composition functions have an intrinsic…

Numerical Analysis · Mathematics 2023-04-24 Chenguang Duan , Yuling Jiao , Xiliang Lu , Jerry Zhijian Yang , Cheng Yuan