English
Related papers

Related papers: Fast and Robust High-Dimensional Sparse Representa…

200 papers

In many applications it is important to estimate a fluid flow field from limited and possibly corrupt measurements. Current methods in flow estimation often use least squares regression to reconstruct the flow field, finding the…

Fluid Dynamics · Physics 2019-11-06 Jared Callaham , Kazuki Maeda , Steven L. Brunton

The role of sparse representations in the context of structured noise filtering is discussed. A strategy, especially conceived so as to address problems of an ill posed nature, is presented. The proposed approach revises and extends the…

Functional Analysis · Mathematics 2007-09-18 Bishnu P. Lamichhane , Laura Rebollo-Neira

$L_1$ regularization is used for finding sparse solutions to an underdetermined linear system. As sparse signals are widely expected in remote sensing, this type of regularization scheme and its extensions have been widely employed in many…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Yilei Shi , Xiao Xiang Zhu , Wotao Yin , Richard Bamler

Many applications concern sparse signals, for example, detecting anomalies from the differences between consecutive images taken by surveillance cameras. This paper focuses on the problem of recovering a K-sparse signal x in N dimensions.…

Machine Learning · Statistics 2013-02-06 Ping Li , Cun-Hui Zhang

Image super-resolution (SR) is one of the long-standing and active topics in image processing community. A large body of works for image super resolution formulate the problem with Bayesian modeling techniques and then obtain its…

Computer Vision and Pattern Recognition · Computer Science 2012-09-20 Haichao Zhang , David Wipf , Yanning Zhang

This paper proposes a fast and accurate method for sparse regression in the presence of missing data. The underlying statistical model encapsulates the low-dimensional structure of the incomplete data matrix and the sparsity of the…

Machine Learning · Statistics 2015-03-31 Ravi Ganti , Rebecca M. Willett

Sparse representation using over-complete dictionaries have shown to produce good quality results in various image processing tasks. Dictionary learning algorithms have made it possible to engineer data adaptive dictionaries which have…

Image and Video Processing · Electrical Eng. & Systems 2019-11-11 Nishant Deepak Keni , Amol Mangirish Singbal , Rizwan Ahmed

Sparse lexical representation learning has demonstrated much progress in improving passage retrieval effectiveness in recent models such as DeepImpact, uniCOIL, and SPLADE. This paper describes a straightforward yet effective approach for…

Information Retrieval · Computer Science 2021-12-20 Jheng-Hong Yang , Xueguang Ma , Jimmy Lin

In this paper, we consider a compressed sensing problem of reconstructing a sparse signal from an undersampled set of noisy linear measurements. The regularized least squares or least absolute shrinkage and selection operator (LASSO)…

Information Theory · Computer Science 2014-10-30 Chao-Kai Wen , Jun Zhang , Kai-Kit Wong , Jung-Chieh Chen , Chau Yuen

Deep representation learning has become one of the most widely adopted approaches for visual search, recommendation, and identification. Retrieval of such representations from a large database is however computationally challenging.…

Machine Learning · Computer Science 2020-04-14 Biswajit Paria , Chih-Kuan Yeh , Ian E. H. Yen , Ning Xu , Pradeep Ravikumar , Barnabás Póczos

We consider sparsity-based techniques for the approximation of high-dimensional functions from random pointwise evaluations. To date, almost all the works published in this field contain some a priori assumptions about the error corrupting…

Numerical Analysis · Mathematics 2019-05-10 Ben Adcock , Anyi Bao , Simone Brugiapaglia

The ability to detect sparse signals from noisy high-dimensional data is a top priority in modern science and engineering. A sparse solution of the linear system $A \rho = b_0$ can be found efficiently with an $l_1$-norm minimization…

Signal Processing · Electrical Eng. & Systems 2022-06-08 Miguel Moscoso , Alexei Novikov , George Papanicolaou , Chrysoula Tsogka

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

This paper introduces a framework for super-resolution of scalable video based on compressive sensing and sparse representation of residual frames in reconnaissance and surveillance applications. We exploit efficient compressive sampling…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Mohammad Hossein Moghaddam , Mohammad Javad Azizipour , Saeed Vahidian , Besma Smida

We formulate the sparse classification problem of $n$ samples with $p$ features as a binary convex optimization problem and propose a cutting-plane algorithm to solve it exactly. For sparse logistic regression and sparse SVM, our algorithm…

Optimization and Control · Mathematics 2025-01-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

We compute approximate solutions to L0 regularized linear regression using L1 regularization, also known as the Lasso, as an initialization step. Our algorithm, the Lass-0 ("Lass-zero"), uses a computationally efficient stepwise search to…

Machine Learning · Statistics 2016-02-18 William Herlands , Maria De-Arteaga , Daniel Neill , Artur Dubrawski

Frames are the foundation of the linear operators used in the decomposition and reconstruction of signals, such as the discrete Fourier transform, Gabor, wavelets, and curvelet transforms. The emergence of sparse representation models has…

Signal Processing · Electrical Eng. & Systems 2019-06-26 Wen-Liang Hwang , Ping-Tzan Huang , Tai-Lang Jong

Successful applications of sparse models in computer vision and machine learning imply that in many real-world applications, high dimensional data is distributed in a union of low dimensional subspaces. Nevertheless, the underlying…

Computer Vision and Pattern Recognition · Computer Science 2014-04-22 Xiao Bian , Hamid Krim

In this paper, we aim at the problem of tensor data completion. Tensor-train decomposition is adopted because of its powerful representation ability and linear scalability to tensor order. We propose an algorithm named Sparse Tensor-train…

Numerical Analysis · Computer Science 2018-03-23 Longhao Yuan , Qibin Zhao , Jianting Cao

In this paper, we develop a randomized algorithm and theory for learning a sparse model from large-scale and high-dimensional data, which is usually formulated as an empirical risk minimization problem with a sparsity-inducing regularizer.…

Machine Learning · Computer Science 2016-10-18 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou