English
Related papers

Related papers: Super-sparse Learning in Similarity Spaces

200 papers

A key recent advance in face recognition models a test face image as a sparse linear combination of a set of training face images. The resulting sparse representations have been shown to possess robustness against a variety of distortions…

Computer Vision and Pattern Recognition · Computer Science 2011-11-09 Yi Chen , Umamahesh Srinivas , Thong T. Do , Vishal Monga , Trac D. Tran

Adaptive sparse coding methods learn a possibly overcomplete set of basis functions, such that natural image patches can be reconstructed by linearly combining a small subset of these bases. The applicability of these methods to visual…

Computer Vision and Pattern Recognition · Computer Science 2010-10-19 Koray Kavukcuoglu , Marc'Aurelio Ranzato , Yann LeCun

The sparse representation classifier (SRC) has been utilized in various classification problems, which makes use of L1 minimization and works well for image recognition satisfying a subspace assumption. In this paper we propose a new…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Li Chen , Yuexiao Dong , Carey E. Priebe

Real world learning scenarios involve a nonstationary distribution of classes with sequential dependencies among the samples, in contrast to the standard machine learning formulation of drawing samples independently from a fixed, typically…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Mengye Ren , Tyler R. Scott , Michael L. Iuzzolino , Michael C. Mozer , Richard Zemel

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

Methodology · Statistics 2011-11-21 Zhou Fang

The increased availability of data in recent years has led several authors to ask whether it is possible to use data as a {\em computational} resource. That is, if more data is available, beyond the sample complexity limit, is it possible…

Machine Learning · Computer Science 2013-11-12 Amit Daniely , Nati Linial , Shai Shalev Shwartz

In machine learning applications, predictive models are trained to serve future queries across the entire data distribution. Real-world data often demands excessively complex models to achieve competitive performance, however, sacrificing…

Machine Learning · Computer Science 2025-09-22 Jizhou Huang , Brendan Juba

Categories can be represented at different levels of abstraction, from prototypes focused on the most typical members to remembering all observed exemplars of the category. These representations have been explored in the context of…

Machine Learning · Computer Science 2024-06-05 Liyi Zhang , Logan Nelson , Thomas L. Griffiths

In this paper, we propose a general collaborative sparse representation framework for multi-sensor classification, which takes into account the correlations as well as complementary information between heterogeneous sensors simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2016-06-17 Minh Dao , Nam H. Nguyen , Nasser M. Nasrabadi , Trac D. Tran

Sparse feature selection is necessary when we fit statistical models, we have access to a large group of features, don't know which are relevant, but assume that most are not. Alternatively, when the number of features is larger than the…

Applications · Statistics 2017-04-04 Emiliano Diaz

One of the most challenging problems in kernel online learning is to bound the model size and to promote the model sparsity. Sparse models not only improve computation and memory usage, but also enhance the generalization capacity, a…

Machine Learning · Computer Science 2017-05-30 Trung Le , Tu Dinh Nguyen , Vu Nguyen , Dinh Phung

Sparse representation models a signal as a linear combination of a small number of dictionary atoms. As a generative model, it requires the dictionary to be highly redundant in order to ensure both a stable high sparsity level and a low…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

Sparse coding aims to model data vectors as sparse linear combinations of basis elements, but a majority of related studies are restricted to continuous data without spatial or temporal structure. A new model-based sparse coding (MSC)…

Methodology · Statistics 2021-08-24 Xin Xing , Rui Xie , Wenxuan Zhong

Audio events are quite often overlapping in nature, and more prone to noise than visual signals. There has been increasing evidence for the superior performance of representations learned using sparse dictionaries for applications like…

Machine Learning · Computer Science 2017-12-05 Vaisakh Shaj , Puranjoy Bhattacharya

Large-scale machine learning (ML) models are increasingly being used in critical domains like education, lending, recruitment, healthcare, criminal justice, etc. However, the training, deployment, and utilization of these models demand…

Machine Learning · Computer Science 2025-03-31 Ding Zhu , Zhiqun Zuo , Mohammad Mahdi Khalili

Distinguishing subtle differences in attributes is valuable, yet learning to make visual comparisons remains non-trivial. Not only is the number of possible comparisons quadratic in the number of training images, but also access to images…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Aron Yu , Kristen Grauman

Dense embedding models are commonly deployed in commercial search engines, wherein all the document vectors are pre-computed, and near-neighbor search (NNS) is performed with the query vector to find relevant documents. However, the…

Machine Learning · Computer Science 2020-09-01 Tharun Medini , Beidi Chen , Anshumali Shrivastava

Supervised deep-embedding methods project inputs of a domain to a representational space in which same-class instances lie near one another and different-class instances lie far apart. We propose a probabilistic method that treats…

Machine Learning · Statistics 2019-09-27 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

We propose a stochastic variance reduced optimization algorithm for solving sparse learning problems with cardinality constraints. Sufficient conditions are provided, under which the proposed algorithm enjoys strong linear convergence…

Machine Learning · Computer Science 2017-12-27 Xingguo Li , Raman Arora , Han Liu , Jarvis Haupt , Tuo Zhao

Many computer vision and medical imaging problems are faced with learning from large-scale datasets, with millions of observations and features. In this paper we propose a novel efficient learning scheme that tightens a sparsity constraint…

Machine Learning · Statistics 2017-02-07 Adrian Barbu , Yiyuan She , Liangjing Ding , Gary Gramajo