English
Related papers

Related papers: Convex Coding

200 papers

Sparse coding is a class of unsupervised methods for learning a sparse representation of the input data in the form of a linear combination of a dictionary and a sparse code. This learning framework has led to state-of-the-art results in…

Machine Learning · Computer Science 2021-09-01 Ye Xue , Vincent Lau , Songfu Cai

State-of-the-art methods for Convolutional Sparse Coding usually employ Fourier-domain solvers in order to speed up the convolution operators. However, this approach is not without shortcomings. For example, Fourier-domain representations…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Jinhui Xiong , Peter Richtárik , Wolfgang Heidrich

Sparse coding algorithms are about finding a linear basis in which signals can be represented by a small number of active (non-zero) coefficients. Such coding has many applications in science and engineering and is believed to play an…

Neural and Evolutionary Computing · Computer Science 2016-08-14 András Lőrincz , Zsolt Palotai , Gábor Szirtes

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

It is essential for a robot to be able to detect revisits or loop closures for long-term visual navigation.A key insight explored in this work is that the loop-closing event inherently occurs sparsely, that is, the image currently being…

Robotics · Computer Science 2017-02-01 Yasir Latif , Guoquan Huang , John Leonard , Jose Neira

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

We present a novel feature selection technique, Sparse Linear Centroid-Encoder (SLCE). The algorithm uses a linear transformation to reconstruct a point as its class centroid and, at the same time, uses the $\ell_1$-norm penalty to filter…

Machine Learning · Computer Science 2023-06-12 Tomojit Ghosh , Michael Kirby , Karim Karimov

Clustering high-dimensional data often requires some form of dimensionality reduction, where clustered variables are separated from "noise-looking" variables. We cast this problem as finding a low-dimensional projection of the data which is…

Machine Learning · Statistics 2016-08-30 Nicolas Flammarion , Balamurugan Palaniappan , Francis Bach

An image super-resolution method from multiple observation of low-resolution images is proposed. The method is based on sub-pixel accuracy block matching for estimating relative displacements of observed images, and sparse signal…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Toshiyuki Kato , Hideitsu Hino , Noboru Murata

Convolutional sparse coding (CSC) can learn representative shift-invariant patterns from multiple kinds of data. However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic. In this…

Machine Learning · Computer Science 2020-04-22 Yaqing Wang , James T. Kwok , Lionel M. Ni

Transformer architectures have achieved remarkable success across language, vision, and multimodal tasks, and there is growing demand for them to address in-context compositional learning tasks. In these tasks, models solve the target…

Machine Learning · Computer Science 2025-11-26 Wei Chen , Jingxi Yu , Zichen Miao , Qiang Qiu

Over the past decade, the celebrated sparse representation model has achieved impressive results in various signal and image processing tasks. A convolutional version of this model, termed convolutional sparse coding (CSC), has been…

Signal Processing · Electrical Eng. & Systems 2018-10-03 Ives Rey-Otero , Jeremias Sulam , Michael Elad

Adaptive sparse coding methods learn a possibly overcomplete set of basis functions, such that natural image patches can be reconstructed by linearly combining a small subset of these bases. The applicability of these methods to visual…

Computer Vision and Pattern Recognition · Computer Science 2010-10-19 Koray Kavukcuoglu , Marc'Aurelio Ranzato , Yann LeCun

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

Optimization and Control · Mathematics 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

Non-negative sparse coding is a method for decomposing multivariate data into non-negative sparse components. In this paper we briefly describe the motivation behind this type of data representation and its relation to standard sparse…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Patrik O. Hoyer

Inverse imaging problems that are ill-posed can be encountered across multiple domains of science and technology, ranging from medical diagnosis to astronomical studies. To reconstruct images from incomplete and distorted data, it is…

Image and Video Processing · Electrical Eng. & Systems 2023-11-30 Cesar F. Caiafa , Ramiro M. Irastorza

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

In this paper, we consider the mixture of sparse linear regressions model. Let ${\beta}^{(1)},\ldots,{\beta}^{(L)}\in\mathbb{C}^n$ be $ L $ unknown sparse parameter vectors with a total of $ K $ non-zero coefficients. Noisy linear…

Information Theory · Computer Science 2018-08-03 Dong Yin , Ramtin Pedarsani , Yudong Chen , Kannan Ramchandran

Image foreground extraction is a classical problem in image processing and vision, with a large range of applications. In this dissertation, we focus on the extraction of text and graphics in mixed-content images, and design novel…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Shervin Minaee

Convex clustering, a convex relaxation of k-means clustering and hierarchical clustering, has drawn recent attentions since it nicely addresses the instability issue of traditional nonconvex clustering methods. Although its computational…

Methodology · Statistics 2019-01-01 Binhuan Wang , Yilong Zhang , Will Wei Sun , Yixin Fang