English
Related papers

Related papers: Social-sparsity brain decoders: faster spatial spa…

200 papers

Group sparse representation has shown promising results in image debulrring and image inpainting in GSR [3] , the main reason that lead to the success is by exploiting Sparsity and Nonlocal self-similarity (NSS) between patches on natural…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Luoyu Chen , Fei Wu

We propose a novel, efficient approach for distributed sparse learning in high-dimensions, where observations are randomly partitioned across machines. Computationally, at each round our method only requires the master machine to solve a…

Machine Learning · Statistics 2016-05-26 Jialei Wang , Mladen Kolar , Nathan Srebro , Tong Zhang

In this paper, we focus on how to locate the relevant or discriminative brain regions related with external stimulus or certain mental decease, which is also called support identification, based on the neuroimaging data. The main difficulty…

Computer Vision and Pattern Recognition · Computer Science 2015-06-09 Yilun Wang , Sheng Zhang , Junjie Zheng , Heng Chen , Huafu Chen

In many problem settings, parameter vectors are not merely sparse but dependent in such a way that non-zero coefficients tend to cluster together. We refer to this form of dependency as "region sparsity." Classical sparse regression…

Machine Learning · Statistics 2019-01-28 Anqi Wu , Oluwasanmi Koyejo , Jonathan W. Pillow

The problem of heterogeneous clients in federated learning has recently drawn a lot of attention. Spectral model sharding, i.e., partitioning the model parameters into low-rank matrices based on the singular value decomposition, has been…

Machine Learning · Computer Science 2024-11-01 Denis Korzhenkov , Christos Louizos

Functional brain networks are well described and estimated from data with Gaussian Graphical Models (GGMs), e.g. using sparse inverse covariance estimators. Comparing functional connectivity of subjects in two populations calls for…

Machine Learning · Statistics 2016-11-21 Eugene Belilovsky , Gaël Varoquaux , Matthew B. Blaschko

Neural network sparsification is a promising avenue to save computational time and memory costs, especially in an age where many successful AI models are becoming too large to na\"ively deploy on consumer hardware. While much work has…

Machine Learning · Computer Science 2024-11-06 Rayen Dhahri , Alexander Immer , Betrand Charpentier , Stephan Günnemann , Vincent Fortuin

Learning a generative model of visual information with sparse and compositional features has been a challenge for both theoretical neuroscience and machine learning communities. Sparse coding models have achieved great success in explaining…

Machine Learning · Computer Science 2021-01-26 Linxing Preston Jiang , Luciano de la Iglesia

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

A new sparse SOS decomposition algorithm is proposed based on a new sparsity pattern, called cross sparsity patterns. The new sparsity pattern focuses on the sparsity of terms and thus is different from the well-known correlative sparsity…

Optimization and Control · Mathematics 2019-01-23 Jie Wang , Haokun Li , Bican Xia

In graph sparsification, the goal has almost always been of {global} nature: compress a graph into a smaller subgraph ({sparsifier}) that maintains certain features of the original graph. Algorithms can then run on the sparsifier, which in…

Data Structures and Algorithms · Computer Science 2021-05-06 Shay Solomon

Covariance Neural Networks (VNNs) perform graph convolutions on the covariance matrix of input data to leverage correlation information as pairwise connections. They have achieved success in a multitude of applications such as neuroscience,…

Machine Learning · Computer Science 2025-09-30 Andrea Cavallo , Zhan Gao , Elvin Isufi

A key recent advance in face recognition models a test face image as a sparse linear combination of a set of training face images. The resulting sparse representations have been shown to possess robustness against a variety of distortions…

Computer Vision and Pattern Recognition · Computer Science 2011-11-09 Yi Chen , Umamahesh Srinivas , Thong T. Do , Vishal Monga , Trac D. Tran

Spatial-temporal graph convolutional networks (ST-GCNs) showcase impressive performance in skeleton-based human action recognition (HAR). However, despite the development of numerous models, their recognition performance does not differ…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Jianyang Xie , Yitian Zhao , Yanda Meng , He Zhao , Anh Nguyen , Yalin Zheng

State-of-the-art methods for Convolutional Sparse Coding usually employ Fourier-domain solvers in order to speed up the convolution operators. However, this approach is not without shortcomings. For example, Fourier-domain representations…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Jinhui Xiong , Peter Richtárik , Wolfgang Heidrich

Distributional models are derived from co-occurrences in a corpus, where only a small proportion of all possible plausible co-occurrences will be observed. This results in a very sparse vector space, requiring a mechanism for inferring…

Computation and Language · Computer Science 2016-08-25 Thomas Kober , Julie Weeds , Jeremy Reffin , David Weir

Balancing predictive power and interpretability has long been a challenging research area, particularly in powerful yet complex models like neural networks, where nonlinearity obstructs direct interpretation. This paper introduces a novel…

Machine Learning · Computer Science 2025-02-20 Antoine Ledent , Peng Liu

Although disentangled representations are often said to be beneficial for downstream tasks, current empirical and theoretical understanding is limited. In this work, we provide evidence that disentangled representations coupled with sparse…

We solve the analysis sparse coding problem considering a combination of convex and non-convex sparsity promoting penalties. The multi-penalty formulation results in an iterative algorithm involving proximal-averaging. We then unfold the…

In this paper, we present a new interpretation of non-negatively constrained convolutional coding problems as blind deconvolution problems with spatially variant point spread function. In this light, we propose an optimization framework…

Signal Processing · Electrical Eng. & Systems 2018-10-22 Pol del Aguila Pla , Joakim Jaldén