English
Related papers

Related papers: Feature Selection via Sparse Approximation for Fac…

200 papers

We formulate the sparse classification problem of $n$ samples with $p$ features as a binary convex optimization problem and propose a cutting-plane algorithm to solve it exactly. For sparse logistic regression and sparse SVM, our algorithm…

Optimization and Control · Mathematics 2025-01-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

High-dimensional learning problems, where the number of features exceeds the sample size, often require sparse regularization for effective prediction and variable selection. While established for fully supervised data, these techniques…

Machine Learning · Computer Science 2026-01-01 The Tien Mai , Mai Anh Nguyen , Trung Nghia Nguyen

A Bayesian framework for 3D human pose estimation from monocular images based on sparse representation (SR) is introduced. Our probabilistic approach aims at simultaneously learning two overcomplete dictionaries (one for the visual input…

Computer Vision and Pattern Recognition · Computer Science 2014-12-02 Behnam Babagholami-Mohamadabadi , Amin Jourabloo , Ali Zarghami , Shohreh Kasaei

We present a new wrapper feature selection algorithm for human detection. This algorithm is a hybrid feature selection approach combining the benefits of filter and wrapper methods. It allows the selection of an optimal feature vector that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jeonghwan Park , Kang Li , Huiyu Zhou

In the field of data mining, how to deal with high-dimensional data is an inevitable problem. Unsupervised feature selection has attracted more and more attention because it does not rely on labels. The performance of spectral-based…

Machine Learning · Computer Science 2021-01-01 Zhengxin Li , Feiping Nie , Jintang Bian , Xuelong Li

L1-minimization refers to finding the minimum L1-norm solution to an underdetermined linear system b=Ax. Under certain conditions as described in compressive sensing theory, the minimum L1-norm solution is also the sparsest solution. In…

Computer Vision and Pattern Recognition · Computer Science 2012-08-28 Allen Y. Yang , Zihan Zhou , Arvind Ganesh , S. Shankar Sastry , Yi Ma

Feature selection in learning to rank has recently emerged as a crucial issue. Whereas several preprocessing approaches have been proposed, only a few works have been focused on integrating the feature selection into the learning process.…

Machine Learning · Computer Science 2015-07-03 Léa Laporte , Rémi Flamary , Stephane Canu , Sébastien Déjean , Josiane Mothe

(This paper was written in November 2011 and never published. It is posted on arXiv.org in its original form in June 2016). Many recent object recognition systems have proposed using a two phase training procedure to learn sparse…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Kevin Jarrett , Koray Kvukcuoglu , Karol Gregor , Yann LeCun

Sparse Representation (or coding) based Classification (SRC) has gained great success in face recognition in recent years. However, SRC emphasizes the sparsity too much and overlooks the correlation information which has been demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2014-05-05 Jing Wang , Canyi Lu , Meng Wang , Peipei Li , Shuicheng Yan , Xuegang Hu

We propose a feature screening method that integrates both feature-feature and feature-target relationships. Inactive features are identified via a penalized minimum Redundancy Maximum Relevance (mRMR) procedure, which is the continuous…

Machine Learning · Statistics 2025-08-27 Peter Naylor , Benjamin Poignard , Héctor Climente-González , Makoto Yamada

Major complications arise from the recent increase in the amount of high-dimensional data, including high computational costs and memory requirements. Feature selection, which identifies the most relevant and informative attributes of a…

Feature selection is an important data preprocessing in data mining and machine learning which can be used to reduce the feature dimension without deteriorating model's performance. Since obtaining annotated data is laborious or even…

Machine Learning · Computer Science 2022-04-08 Zhenzhen Sun , Yuanlong Yu

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

Sparse optimization is a central problem in machine learning and computer vision. However, this problem is inherently NP-hard and thus difficult to solve in general. Combinatorial search methods find the global optimal solution but are…

Optimization and Control · Mathematics 2020-06-30 Ganzhao Yuan , Li Shen , Wei-Shi Zheng

Action recognition is computationally expensive. In this paper, we address the problem of frame selection to improve the accuracy of action recognition. In particular, we show that selecting good frames helps in action recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Shreyank N Gowda , Marcus Rohrbach , Laura Sevilla-Lara

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

Face images captured in heterogeneous environments, e.g., sketches generated by the artists or composite-generation software, photos taken by common cameras and infrared images captured by corresponding infrared imaging devices, usually…

Computer Vision and Pattern Recognition · Computer Science 2016-07-04 Chunlei Peng , Xinbo Gao , Nannan Wang , Jie Li

After intensive research, heterogenous face recognition is still a challenging problem. The main difficulties are owing to the complex relationship between heterogenous face image spaces. The heterogeneity is always tightly coupled with…

Computer Vision and Pattern Recognition · Computer Science 2014-06-06 Dong Yi , Zhen Lei , Shengcai Liao , Stan Z. Li

In this paper the problem of image restoration (denoising and inpainting) is approached using sparse approximation of local image blocks. The local image blocks are extracted by sliding square windows over the image. An adaptive block size…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Sujit Kumar Sahoo

Feature selection is an important part of building a machine learning model. By eliminating redundant or misleading features from data, the machine learning model can achieve better performance while reducing the demand on com-puting…

Machine Learning · Computer Science 2021-06-11 Song Tan , Xia He