English
Related papers

Related papers: WARP-LCA: Efficient Convolutional Sparse Coding wi…

200 papers

A new approach to the sparse Canonical Correlation Analysis (sCCA)is proposed with the aim of discovering interpretable associations in very high-dimensional multi-view, i.e.observations of multiple sets of variables on the same subjects,…

Machine Learning · Statistics 2019-09-18 Omid S. Solari , James B. Brown , Peter J. Bickel

We consider the problem of maximizing the variance explained from a data matrix using orthogonal sparse principal components that have a support of fixed cardinality. While most existing methods focus on building principal components (PCs)…

Optimization and Control · Mathematics 2022-10-14 Dimitris Bertsimas , Driss Lahlou Kitane

This paper establishes several convergence results about flows of the dynamical system LCA (Locally Competitive Algorithm) to the mixed $\ell_2$-$\ell_1$ minimization problem LASSO and the constrained version, called CLASSO here, where the…

Numerical Analysis · Mathematics 2016-03-08 Ping Tak Peter Tang

Pixel-level labels are particularly expensive to acquire. Hence, pretraining is a critical step to improve models on a task like semantic segmentation. However, prominent algorithms for pretraining neural networks use image-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Mathilde Caron , Neil Houlsby , Cordelia Schmid

This paper introduces the use of single layer and deep convolutional networks for remote sensing data analysis. Direct application to multi- and hyper-spectral imagery of supervised (shallow or deep) convolutional networks is very…

Computer Vision and Pattern Recognition · Computer Science 2015-11-26 Adriana Romero , Carlo Gatta , Gustau Camps-Valls

Canonical Correlation Analysis (CCA) is a widely used statistical tool with both well established theory and favorable performance for a wide range of machine learning problems. However, computing CCA for huge datasets can be very slow…

Machine Learning · Statistics 2014-12-31 Yichao Lu , Dean P. Foster

End-to-end autonomous driving systems powered by Vision-Language-Action (VLA) models achieve strong performance on common driving scenarios, yet remain brittle in rare but safety-critical long-tail situations such as active construction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ruiyang Zhu , Yuehan He , Boyuan Zheng , Zesen Zhao , Ahmad Chalhoub , Qingzhao Zhang , Z. Morley Mao

There exist many well-established techniques to recover sparse signals from compressed measurements with known performance guarantees in the static case. However, only a few methods have been proposed to tackle the recovery of time-varying…

Dynamical Systems · Mathematics 2023-07-19 Aurele Balavoine , Christopher J. Rozell , Justin Romberg

Despite strong empirical performance for image classification, deep neural networks are often regarded as ``black boxes'' and they are difficult to interpret. On the other hand, sparse convolutional models, which assume that a signal can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xili Dai , Mingyang Li , Pengyuan Zhai , Shengbang Tong , Xingjian Gao , Shao-Lun Huang , Zhihui Zhu , Chong You , Yi Ma

Driven by the continuous development of models such as Multi-Layer Perceptron, Convolutional Neural Network (CNN), and Transformer, deep learning has made breakthrough progress in fields such as computer vision and natural language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Shuang Liu , Lina Zhao , Tian Wang , Huaqing Wang

Canonical correlation analysis (CCA) describes the associations between two sets of variables by maximizing the correlation between linear combinations of the variables in each data set. However, in high-dimensional settings where the…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

Convolutional sparse representations are a form of sparse representation with a dictionary that has a structure that is equivalent to convolution with a set of linear filters. While effective algorithms have recently been developed for the…

Machine Learning · Computer Science 2018-09-06 Cristina Garcia-Cardona , Brendt Wohlberg

Attention mechanisms have significantly advanced visual models by capturing global context effectively. However, their reliance on large-scale datasets and substantial computational resources poses challenges in data-scarce and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Chenghao Li , Chaoning Zhang , Boheng Zeng , Yi Lu , Pengbo Shi , Qingzi Chen , Jirui Liu , Lingyun Zhu , Yang Yang , Heng Tao Shen

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of…

Machine Learning · Computer Science 2020-11-13 Tommaso d'Orsi , Pravesh K. Kothari , Gleb Novikov , David Steurer

In representation learning, Convolutional Sparse Coding (CSC) enables unsupervised learning of features by jointly optimising both an \(\ell_2\)-norm fidelity term and a sparsity enforcing penalty. This work investigates using a…

Image and Video Processing · Electrical Eng. & Systems 2021-07-15 Perla Mayo , Oktay Karakuş , Robin Holmes , Alin Achim

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for…

Machine Learning · Computer Science 2020-10-27 Yuhai Song , Zhong Cao , Kailun Wu , Ziang Yan , Changshui Zhang

Tensor canonical correlation analysis (TCCA) has garnered significant attention due to its effectiveness in capturing high-order correlations in multi-view learning. However, existing TCCA methods often underemphasize the characterization…

Optimization and Control · Mathematics 2025-12-10 Yanjiao Zhu , Wanquan Liu , Xianchao Xiu , Jianqin Sun

The convolutional sparse model has recently gained increasing attention in the signal and image processing communities, and several methods have been proposed for solving the pursuit problem emerging from it -- in particular its convex…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

Over the past few years, dictionary learning (DL)-based methods have been successfully used in various image reconstruction problems. However, traditional DL-based computed tomography (CT) reconstruction methods are patch-based and ignore…