English
Related papers

Related papers: Online Convolutional Sparse Coding with Sample-Dep…

200 papers

We propose a new outline for adaptive dictionary learning methods for sparse encoding based on a hierarchical clustering of the training data. Through recursive application of a clustering method, the data is organized into a binary…

Machine Learning · Computer Science 2020-06-11 Renato Budinich , Gerlind Plonka

Deep convolutional neural networks (CNNs) have shown excellent performance in object recognition tasks and dense classification problems such as semantic segmentation. However, training deep neural networks on large and sparse datasets is…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Lorenz Berger , Eoin Hyde , M. Jorge Cardoso , Sebastien Ourselin

Sparse representations of images are useful in many computer vision applications. Sparse coding with an $l_1$ penalty and a learned linear dictionary requires regularization of the dictionary to prevent a collapse in the $l_1$ norms of the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Katrina Evtimova , Yann LeCun

Adaptive sparse coding methods learn a possibly overcomplete set of basis functions, such that natural image patches can be reconstructed by linearly combining a small subset of these bases. The applicability of these methods to visual…

Computer Vision and Pattern Recognition · Computer Science 2010-10-19 Koray Kavukcuoglu , Marc'Aurelio Ranzato , Yann LeCun

Dictionary learning is a branch of signal processing and machine learning that aims at finding a frame (called dictionary) in which some training data admits a sparse representation. The sparser the representation, the better the…

Machine Learning · Computer Science 2015-02-27 Luc Le Magoarou , Rémi Gribonval

Sparse dictionary learning (DL) has emerged as a powerful approach to extract semantically meaningful concepts from the internals of large language models (LLMs) trained mainly in the text domain. In this work, we explore whether DL can…

Support estimation (SE) of a sparse signal refers to finding the location indices of the non-zero elements in a sparse representation. Most of the traditional approaches dealing with SE problem are iterative algorithms based on greedy…

Signal Processing · Electrical Eng. & Systems 2026-05-06 Mehmet Yamac , Mete Ahishali , Serkan Kiranyaz , Moncef Gabbouj

In this paper, we explore an efficient variant of convolutional sparse coding with unit norm code vectors where reconstruction quality is evaluated using an inner product (cosine distance). To use these codes for discriminative…

Computer Vision and Pattern Recognition · Computer Science 2017-10-06 Bailey Kong , Charless C. Fowlkes

In this paper, a new class of circulant matrices built from deterministic sequences is proposed for convolution-based compressed sensing (CS). In contrast to random convolution, the coefficients of the underlying filter are given by the…

Information Theory · Computer Science 2015-06-11 Kezhi Li , Lu Gan , Cong Ling

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

The majority of contemporary computational methods for lexical semantic change (LSC) detection are based on neural embedding distributional representations. Although these models perform well on LSC benchmarks, their results are often…

Computation and Language · Computer Science 2026-05-05 Bach Phan-Tat , Kris Heylen , Dirk Geeraerts , Stefano De Pascale , Dirk Speelman

In the synthesis model signals are represented as a sparse combinations of atoms from a dictionary. Dictionary learning describes the acquisition process of the underlying dictionary for a given set of training samples. While ideally this…

Machine Learning · Statistics 2015-03-11 Matthias Seibert , Martin Kleinsteuber , Rémi Gribonval , Rodolphe Jenatton , Francis Bach

We propose a system for visual scene analysis and recognition based on encoding the sparse, latent feature-representation of an image into a high-dimensional vector that is subsequently factorized to parse scene content. The sparse feature…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Christopher J. Kymn , Sonia Mazelet , Annabel Ng , Denis Kleyko , Bruno A. Olshausen

Sparse coding or sparse dictionary learning has been widely used to recover underlying structure in many kinds of natural data. Here, we provide conditions guaranteeing when this recovery is universal; that is, when sparse codes and…

Neurons and Cognition · Quantitative Biology 2016-11-18 Christopher J. Hillar , Friedrich T. Sommer

In this paper, we introduce a Deep Convolutional Analysis Dictionary Model (DeepCAM) by learning convolutional dictionaries instead of unstructured dictionaries as in the case of deep analysis dictionary model introduced in the companion…

Machine Learning · Statistics 2020-02-04 Jun-Jie Huang , Pier Luigi Dragotti

This paper aims to improve the feature learning in Convolutional Networks (Convnet) by capturing the structure of objects. A new sparsity function is imposed on the extracted featuremap to capture the structure and shape of the learned…

Machine Learning · Computer Science 2017-01-03 Ehsan Hosseini-Asl

In this paper, we consider convolutional neural networks operating on sparse inputs with an application to depth upsampling from sparse laser scan data. First, we show that traditional convolutional networks perform poorly when applied to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Jonas Uhrig , Nick Schneider , Lukas Schneider , Uwe Franke , Thomas Brox , Andreas Geiger

Convolutional neural networks (CNNs) have been successfully used in a range of tasks. However, CNNs are often viewed as "black-box" and lack of interpretability. One main reason is due to the filter-class entanglement -- an intricate…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Haoyu Liang , Zhihao Ouyang , Yuyuan Zeng , Hang Su , Zihao He , Shu-Tao Xia , Jun Zhu , Bo Zhang

Classification methods based on sparse estimation have drawn much attention recently, due to their effectiveness in processing high-dimensional data such as images. In this paper, a method to improve the performance of a sparse…

Machine Learning · Statistics 2018-10-24 Babak Barazandeh , Mohammadhussein Rafieisakhaei , Sunwook Kim , Zhenyu , Kong , Maury A. Nussbaum

In this paper we formally analyse the use of sparse filtering algorithms to perform covariate shift adaptation. We provide a theoretical analysis of sparse filtering by evaluating the conditions required to perform covariate shift…

Machine Learning · Computer Science 2017-09-12 Fabio Massimo Zennaro , Ke Chen