English
Related papers

Related papers: Improving feature selection algorithms using norma…

200 papers

Supervised machine learning involves approximating an unknown functional relationship from a limited dataset of features and corresponding labels. The classical approach to feature-based machine learning typically relies on applying linear…

Machine Learning · Statistics 2025-04-25 Margherita Lampani , Sabrina Guastavino , Michele Piana , Federico Benvenuto

Estimating dense correspondences between images is a long-standing image under-standing task. Recent works introduce convolutional neural networks (CNNs) to extract high-level feature maps and find correspondences through feature matching.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hao Huang , Jianchun Chen , Xiang Li , Lingjing Wang , Yi Fang

Lasso and other regularization procedures are attractive methods for variable selection, subject to a proper choice of shrinkage parameter. Given a set of potential subsets produced by a regularization algorithm, a consistent model…

Methodology · Statistics 2014-02-26 Minh-Ngoc Tran

Dynamic feature selection, where we sequentially query features to make accurate predictions with a minimal budget, is a promising paradigm to reduce feature acquisition costs and provide transparency into a model's predictions. The problem…

Machine Learning · Computer Science 2024-09-10 Soham Gadgil , Ian Covert , Su-In Lee

Feature selection is a critical task in machine learning and statistics. However, existing feature selection methods either (i) rely on parametric methods such as linear or generalized linear models, (ii) lack theoretical false discovery…

Machine Learning · Statistics 2025-07-18 Omar Melikechi , David B. Dunson , Jeffrey W. Miller

Discovery of diagnostic and prognostic molecular markers is important and actively pursued the research field in cancer research. For complex diseases, this process is often performed using Machine Learning. The current study compares two…

Genomics · Quantitative Biology 2020-04-30 Aneta Polewko-Klim , Witold R. Rudnicki

Checklists are simple decision aids that are often used to promote safety and reliability in clinical applications. In this paper, we present a method to learn checklists for clinical decision support. We represent predictive checklists as…

Machine Learning · Computer Science 2022-01-19 Haoran Zhang , Quaid Morris , Berk Ustun , Marzyeh Ghassemi

In this paper, we present a new feature selection method that is suitable for both unsupervised and supervised problems. We build upon the recently proposed Infinite Feature Selection (IFS) method where feature subsets of all sizes…

Machine Learning · Computer Science 2017-08-22 Sadegh Eskandari , Emre Akbas

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

Large annotated datasets are crucial for the success of deep neural networks, but labeling data can be prohibitively expensive in domains such as medical imaging. This work tackles the subset selection problem: selecting a small set of the…

Machine Learning · Computer Science 2025-09-29 Noga Bar , Raja Giryes

We propose a tree regularization framework, which enables many tree models to perform feature selection efficiently. The key idea of the regularization framework is to penalize selecting a new feature for splitting when its gain (e.g.…

Machine Learning · Computer Science 2012-03-22 Houtao Deng , George Runger

Feature selection is a preprocessing step which plays a crucial role in the domain of machine learning and data mining. Feature selection methods have been shown to be effctive in removing redundant and irrelevant features, improving the…

Machine Learning · Computer Science 2021-06-01 Xiongshi Deng , Min Li , Lei Wang , Qikang Wan

In the field of image analysis, segmentation is one of the most important preprocessing steps. One way to achieve segmentation is by mean of threshold selection, where each pixel that belongs to a determined class islabeled according to the…

Computer Vision and Pattern Recognition · Computer Science 2014-05-30 Valentín Osuna-Enciso , Erik Cuevas , Humberto Sossa

A large number of different feature detectors has been proposed so far. Any existing approach presents strengths and weaknesses, which make a detector optimal only for a limited range of applications. A tool capable of selecting the optimal…

Computer Vision and Pattern Recognition · Computer Science 2016-05-20 Bruno Ferrarini , Shoaib Ehsan , Naveed Ur Rehman , Ales Leonardis , Klaus D. McDonald-Maier

Both feature selection and hyperparameter tuning are key tasks in machine learning. Hyperparameter tuning is often useful to increase model performance, while feature selection is undertaken to attain sparse models. Sparsity may yield…

Machine Learning · Statistics 2020-02-14 Martin Binder , Julia Moosbauer , Janek Thomas , Bernd Bischl

Training a fine-grained image recognition model with limited data presents a significant challenge, as the subtle differences between categories may not be easily discernible amidst distracting noise patterns. One commonly employed strategy…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Avraham Chapman , Haiming Xu , Lingqiao Liu

The problem of feature selection has raised considerable interests in the past decade. Traditional unsupervised methods select the features which can faithfully preserve the intrinsic structures of data, where the intrinsic structures are…

Machine Learning · Computer Science 2015-04-06 Liang Du , Yi-Dong Shen

Feature selection is beneficial for improving the performance of general machine learning tasks by extracting an informative subset from the high-dimensional features. Conventional feature selection methods usually ignore the class…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Meng Liu , Chang Xu , Yong Luo , Chao Xu , Yonggang Wen , Dacheng Tao

In this paper, we investigate the problem of classifying feature vectors with mutually independent but non-identically distributed elements. First, we show the importance of this problem. Next, we propose a classifier and derive an…

Machine Learning · Computer Science 2021-09-01 Farzad Shahrivari , Nikola Zlatanov

Feature selection technology is a key technology of data dimensionality reduction. Becauseof the lack of label information of collected data samples, unsupervised feature selection has attracted more attention. The universality and…

Machine Learning · Computer Science 2024-10-22 Xiaolin Lv , Liang Du , Peng Zhou , Peng Wu