English
Related papers

Related papers: Efficient Learning of Sparse Invariant Representat…

200 papers

Deep representation learning has become one of the most widely adopted approaches for visual search, recommendation, and identification. Retrieval of such representations from a large database is however computationally challenging.…

Machine Learning · Computer Science 2020-04-14 Biswajit Paria , Chih-Kuan Yeh , Ian E. H. Yen , Ning Xu , Pradeep Ravikumar , Barnabás Póczos

We introduce a new neural architecture and an unsupervised algorithm for learning invariant representations from temporal sequence of images. The system uses two groups of complex cells whose outputs are combined multiplicatively: one that…

Neural and Evolutionary Computing · Computer Science 2010-06-03 Karo Gregor , Yann LeCun

Learning expressive representations for high-dimensional yet sparse features has been a longstanding problem in information retrieval. Though recent deep learning methods can partially solve the problem, they often fail to handle the…

Information Retrieval · Computer Science 2023-05-30 Kaize Ding , Albert Jiongqian Liang , Bryan Perrozi , Ting Chen , Ruoxi Wang , Lichan Hong , Ed H. Chi , Huan Liu , Derek Zhiyuan Cheng

Conditional Random Fields (CRFs) constitute a popular and efficient approach for supervised sequence labelling. CRFs can cope with large description spaces and can integrate some form of structural dependency between labels. In this…

Machine Learning · Computer Science 2015-05-14 Nataliya Sokolovska , Thomas Lavergne , Olivier Cappé , François Yvon

Sparse coding strategies have been lauded for their parsimonious representations of data that leverage low dimensional structure. However, inference of these codes typically relies on an optimization procedure with poor computational…

Machine Learning · Computer Science 2022-09-02 Kion Fallah , Christopher J. Rozell

Parsimony, including sparsity and low rank, has been shown to successfully model data in numerous machine learning and signal processing tasks. Traditionally, such modeling approaches rely on an iterative algorithm that minimizes an…

Machine Learning · Computer Science 2012-12-18 Pablo Sprechmann , Alex M. Bronstein , Guillermo Sapiro

Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections…

Machine Learning · Statistics 2015-04-07 Farhad Pourkamali-Anaraki , Stephen Becker , Shannon M. Hughes

Learning visual features from unlabeled image data is an important yet challenging task, which is often achieved by training a model on some annotation-free information. We consider spatial contexts, for which we solve so-called jigsaw…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chen Wei , Lingxi Xie , Xutong Ren , Yingda Xia , Chi Su , Jiaying Liu , Qi Tian , Alan L. Yuille

Many computer vision and medical imaging problems are faced with learning from large-scale datasets, with millions of observations and features. In this paper we propose a novel efficient learning scheme that tightens a sparsity constraint…

Machine Learning · Statistics 2017-02-07 Adrian Barbu , Yiyuan She , Liangjing Ding , Gary Gramajo

Spectral-based subspace clustering methods have proved successful in many challenging applications such as gene sequencing, image recognition, and motion segmentation. In this work, we first propose a novel spectral-based subspace…

Machine Learning · Statistics 2021-06-09 Hankui Peng , Nicos G. Pavlidis

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro , Andrew Zisserman

We present Spectral Inference Networks, a framework for learning eigenfunctions of linear operators by stochastic optimization. Spectral Inference Networks generalize Slow Feature Analysis to generic symmetric operators, and are closely…

Machine Learning · Computer Science 2020-01-17 David Pfau , Stig Petersen , Ashish Agarwal , David G. T. Barrett , Kimberly L. Stachenfeld

Deep neural networks have gained tremendous success in a broad range of machine learning tasks due to its remarkable capability to learn semantic-rich features from high-dimensional data. However, they often require large-scale labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hu Wang , Guansong Pang , Chunhua Shen , Congbo Ma

Dictionary learning and sparse coding have been widely studied as mechanisms for unsupervised feature learning. Unsupervised learning could bring enormous benefit to the processing of hyperspectral images and to other remote sensing data…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Joshua Bruton , Hairong Wang

Recent advances in deep learning have achieved promising performance for medical image analysis, while in most cases ground-truth annotations from human experts are necessary to train the deep model. In practice, such annotations are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Jianbo Jiao , Richard Droste , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

Audio-visual representation learning is an important task from the perspective of designing machines with the ability to understand complex events. To this end, we propose a novel multimodal framework that instantiates multiple instance…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Sanjeel Parekh , Slim Essid , Alexey Ozerov , Ngoc Q. K. Duong , Patrick Pérez , Gaël Richard

Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often is not understood to sufficient accuracy. Therefore, there…

Machine Learning · Computer Science 2024-01-23 Xihaier Luo , Wei Xu , Yihui Ren , Shinjae Yoo , Balu Nadiga

Deep Convolutional Neural Networks (CNNs) have been successfully deployed on robots for 6-DoF object pose estimation through visual perception. However, obtaining labeled data on a scale required for the supervised training of CNNs is a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Rohan Pratap Singh , Mehdi Benallegue , Yusuke Yoshiyasu , Fumio Kanehiro

This paper focuses on detection tasks in information extraction, where positive instances are sparsely distributed and models are usually evaluated using F-measure on positive classes. These characteristics often result in deficient…

Computation and Language · Computer Science 2018-05-29 Hongyu Lin , Yaojie Lu , Xianpei Han , Le Sun

This paper introduces the use of single layer and deep convolutional networks for remote sensing data analysis. Direct application to multi- and hyper-spectral imagery of supervised (shallow or deep) convolutional networks is very…

Computer Vision and Pattern Recognition · Computer Science 2015-11-26 Adriana Romero , Carlo Gatta , Gustau Camps-Valls