English
Related papers

Related papers: Modeling Winner-Take-All Competition in Sparse Bin…

200 papers

In this work we consider partially observable environments with sparse rewards. We present a self-supervised representation learning method for image-based observations, which arranges embeddings respecting temporal distance of…

Machine Learning · Computer Science 2020-10-07 Aleksandr Ermolov , Nicu Sebe

Many imaging technologies rely on tomographic reconstruction, which requires solving a multidimensional inverse problem given a finite number of projections. Backprojection is a popular class of algorithm for tomographic reconstruction,…

Image and Video Processing · Electrical Eng. & Systems 2020-06-03 Xueqing Liu , Paul Sajda

The prominent success of neural networks, mainly in computer vision tasks, is increasingly shadowed by their sensitivity to small, barely perceivable adversarial perturbations in image input. In this work, we aim at explaining this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Dana Weitzner , Raja Giryes

We study streaming algorithms in the white-box adversarial stream model, where the internal state of the streaming algorithm is revealed to an adversary who adaptively generates the stream updates, but the algorithm obtains fresh randomness…

Data Structures and Algorithms · Computer Science 2023-07-10 Ying Feng , David P. Woodruff

Sparse sensor placement is a central challenge in the efficient characterization of complex systems when the cost of acquiring and processing data is high. Leading sparse sensing methods typically exploit either spatial or temporal…

Optimization and Control · Mathematics 2022-06-08 Thomas L. Mohren , Thomas L. Daniel , Steven L. Brunton , Bingni W. Brunton

Sparse representation models a signal as a linear combination of a small number of dictionary atoms. As a generative model, it requires the dictionary to be highly redundant in order to ensure both a stable high sparsity level and a low…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

This paper proposes a new algorithm for multiple sparse regression in high dimensions, where the task is to estimate the support and values of several (typically related) sparse vectors from a few noisy linear measurements. Our algorithm is…

Machine Learning · Statistics 2012-06-08 Ali Jalali , Sujay Sanghavi

Sparse matrices are favorable objects in machine learning and optimization. When such matrices are used, in place of dense ones, the overall complexity requirements in optimization can be significantly reduced in practice, both in terms of…

Information Theory · Computer Science 2016-04-05 Anastasios Kyrillidis , Bubacarr Bah , Rouzbeh Hasheminezhad , Quoc Tran-Dinh , Luca Baldassarre , Volkan Cevher

We address the problem of converting large-scale high-dimensional image data into binary codes so that approximate nearest-neighbor search over them can be efficiently performed. Different from most of the existing unsupervised approaches…

Computer Vision and Pattern Recognition · Computer Science 2015-12-02 Tsung-Yu Lin , Tsung-Wei Ke , Tyng-Luh Liu

In complex visual recognition tasks it is typical to adopt multiple descriptors, that describe different aspects of the images, for obtaining an improved recognition performance. Descriptors that have diverse forms can be fused into a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-15 Jayaraman J. Thiagarajan , Karthikeyan Natesan Ramamurthy , Andreas Spanias

In this paper, we introduce the concept of sparse bilinear logistic regression for decision problems involving explanatory variables that are two-dimensional matrices. Such problems are common in computer vision, brain-computer interfaces,…

Optimization and Control · Mathematics 2014-04-17 Jianing V. Shi , Yangyang Xu , Richard G. Baraniuk

Ising models describe the joint probability distribution of a vector of binary feature variables. Typically, not all the variables interact with each other and one is interested in learning the presumably sparse network structure of the…

Machine Learning · Computer Science 2019-07-09 Frank Nussbaum , Joachim Giesen

We present a novel approach to the formulation and the resolution of sparse Linear Discriminant Analysis (LDA). Our proposal, is based on penalized Optimal Scoring. It has an exact equivalence with penalized LDA, contrary to the multi-class…

Machine Learning · Computer Science 2012-07-03 Luis Francisco Sanchez Merchante , Yves Grandvalet , Gerrad Govaert

The convolutional sparse model has recently gained increasing attention in the signal and image processing communities, and several methods have been proposed for solving the pursuit problem emerging from it -- in particular its convex…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A…

Image and Video Processing · Electrical Eng. & Systems 2022-05-17 Tobias Alt , Pascal Peter , Joachim Weickert

In this paper, we study the problem of compressed sensing using binary measurement matrices and $\ell_1$-norm minimization (basis pursuit) as the recovery algorithm. We derive new upper and lower bounds on the number of measurements to…

Machine Learning · Statistics 2020-04-28 Mahsa Lotfi , Mathukumalli Vidyasagar

Matrix recovery from sparse observations is an extensively studied topic emerging in various applications, such as recommendation system and signal processing, which includes the matrix completion and compressed sensing models as special…

Methodology · Statistics 2026-04-13 Ziyuan Chen , Ying Yang , Fang Yao

In Compressed Sensing, a real-valued sparse vector has to be estimated from an underdetermined system of linear equations. In many applications, however, the elements of the sparse vector are drawn from a finite set. For the estimation of…

Information Theory · Computer Science 2016-08-24 Susanne Sparrer , Robert F. H. Fischer

Sparse linear regression -- finding an unknown vector from linear measurements -- is now known to be possible with fewer samples than variables, via methods like the LASSO. We consider the multiple sparse linear regression problem, where…

Machine Learning · Computer Science 2012-02-28 Ali Jalali , Pradeep Ravikumar , Sujay Sanghavi