English
Related papers

Related papers: Universal Regularizers For Robust Sparse Coding an…

200 papers

Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high dimensional setting. Only recently a few sparse recovery results have been established for some specific local…

Machine Learning · Statistics 2012-02-14 Cun-Hui Zhang , Tong Zhang

The scale of modern datasets necessitates the development of efficient distributed optimization methods for machine learning. We present a general-purpose framework for distributed computing environments, CoCoA, that has an efficient…

Machine Learning · Computer Science 2018-10-11 Virginia Smith , Simone Forte , Chenxin Ma , Martin Takac , Michael I. Jordan , Martin Jaggi

A key recent advance in face recognition models a test face image as a sparse linear combination of a set of training face images. The resulting sparse representations have been shown to possess robustness against a variety of distortions…

Computer Vision and Pattern Recognition · Computer Science 2011-11-09 Yi Chen , Umamahesh Srinivas , Thong T. Do , Vishal Monga , Trac D. Tran

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

Methodology · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

Dictionary learning and sparse representation (DLSR) is a recent and successful mathematical model for data representation that achieves state-of-the-art performance in various fields such as pattern recognition, machine learning, computer…

Computer Vision and Pattern Recognition · Computer Science 2015-02-23 Mehrdad J. Gangeh , Ahmed K. Farahat , Ali Ghodsi , Mohamed S. Kamel

Regularized methods have been widely applied to system identification problems without known model structures. This paper proposes an infinite-dimensional sparse learning algorithm based on atomic norm regularization. Atomic norm…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mingzhou Yin , Mehmet Tolga Akan , Andrea Iannelli , Roy S. Smith

We propose a sparse-coding framework for activity recognition in ubiquitous and mobile computing that alleviates two fundamental problems of current supervised learning approaches. (i) It automatically derives a compact, sparse and…

Machine Learning · Computer Science 2014-07-24 Sourav Bhattacharya , Petteri Nurmi , Nils Hammerla , Thomas Plötz

Inspired by recent work on convex formulations of clustering (Lashkari & Golland, 2008; Nowozin & Bakir, 2008) we investigate a new formulation of the Sparse Coding Problem (Olshausen & Field, 1997). In sparse coding we attempt to…

Machine Learning · Computer Science 2012-05-14 David M. Bradley , J Andrew Bagnell

Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by sparse coding in a…

Machine Learning · Statistics 2015-01-19 Jim Jing-Yan Wang , Xin Gao

Hyperspectral images provide abundant spatial and spectral information that is very valuable for material detection in diverse areas of practical science. The high-dimensions of data lead to many processing challenges that can be addressed…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saeideh Ghanbari Azar , Saeed Meshgini , Tohid Yousefi Rezaii , Soosan Beheshti

In high dimensional regression settings, sparsity enforcing penalties have proved useful to regularize the data-fitting term. A recently introduced technique called screening rules propose to ignore some variables in the optimization…

Machine Learning · Statistics 2017-12-29 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

An image super-resolution method from multiple observation of low-resolution images is proposed. The method is based on sub-pixel accuracy block matching for estimating relative displacements of observed images, and sparse signal…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Toshiyuki Kato , Hideitsu Hino , Noboru Murata

Over the past decade, learning a dictionary from input images for sparse modeling has been one of the topics which receive most research attention in image processing and compressed sensing. Most existing dictionary learning methods…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Kai Liu , Yongjian Zhao , Hua Wang

In this paper, we study randomized reduction methods, which reduce high-dimensional features into low-dimensional space by randomized methods (e.g., random projection, random hashing), for large-scale high-dimensional classification.…

Machine Learning · Computer Science 2015-07-21 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

Optimization and Control · Mathematics 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone

This paper discusses sparse isotropic regularization for a random field on the unit sphere $\mathbb{S}^2$ in $\mathbb{R}^{3}$, where the field is expanded in terms of a spherical harmonic basis. A key feature is that the norm used in the…

Numerical Analysis · Mathematics 2018-01-11 Quoc T. Le Gia , Ian H. Sloan , Robert S. Womersley , Yu Guang Wang

Sparse approximations using highly over-complete dictionaries is a state-of-the-art tool for many imaging applications including denoising, super-resolution, compressive sensing, light-field analysis, and object recognition. Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-03 Ali Ayremlou , Thomas Goldstein , Ashok Veeraraghavan , Richard Baraniuk

The problem of signal detection using a flexible and general model is considered. Due to applicability and flexibility of sparse signal representation and approximation, it has attracted a lot of attention in many signal processing areas.…

Information Theory · Computer Science 2016-02-17 Mohsen Joneidi , Parvin Ahmadi , Mostafa Sadeghi , Nazanin Rahnavard

Robust optimization is becoming increasingly important in machine learning applications. In this paper, we study a unified framework of robust submodular optimization. We study this problem both from a minimization and maximization…

Machine Learning · Computer Science 2021-03-22 Rishabh Iyer

In this paper we propose and carefully evaluate a sequence labeling framework which solely utilizes sparse indicator features derived from dense distributed word representations. The proposed model obtains (near) state-of-the art…

Computation and Language · Computer Science 2016-12-22 Gábor Berend