English
Related papers

Related papers: Gradient-based Laplacian Feature Selection

200 papers

The application of machine learning to image and video data often yields a high dimensional feature space. Effective feature selection techniques identify a discriminant feature subspace that lowers computational and modeling costs with…

Machine Learning · Computer Science 2022-06-22 Yijing Yang , Wei Wang , Hongyu Fu , C. -C. Jay Kuo

The need for labeled data is among the most common and well-known practical obstacles to deploying deep learning algorithms to solve real-world problems. The current generation of learning algorithms requires a large volume of data labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Aaron Reite , Scott Kangas , Zackery Steck , Steven Goley , Jonathan Von Stroh , Steven Forsyth

Feature selection is important in data representation and intelligent diagnosis. Elastic net is one of the most widely used feature selectors. However, the features selected are dependant on the training data, and their weights dedicated…

Machine Learning · Computer Science 2021-01-01 Shaode Yu , Haobo Chen , Hang Yu , Zhicheng Zhang , Xiaokun Liang , Wenjian Qin , Yaoqin Xie , Ping Shi

Data acquisition, storage and management have been improved, while the key factors of many phenomena are not well known. Consequently, irrelevant and redundant features artificially increase the size of datasets, which complicates learning…

Machine Learning · Statistics 2017-04-05 Jean Golay , Michael Leuenberger , Mikhail Kanevski

Knowing the features of a complex system that are highly relevant to a particular target variable is of fundamental interest in many areas of science. Existing approaches are often limited to linear settings, sometimes lack guarantees, and…

Machine Learning · Computer Science 2023-07-06 Francesco Quinzan , Ashkan Soleymani , Patrick Jaillet , Cristian R. Rojas , Stefan Bauer

As artificial intelligence methods are increasingly applied to complex task scenarios, high dimensional multi-label learning has emerged as a prominent research focus. At present, the curse of dimensionality remains one of the major…

Machine Learning · Computer Science 2025-04-18 Yifan Cao , Zhilong Mi , Ziqiao Yin , Binghui Guo , Jin Dong

The problem of feature selection has raised considerable interests in the past decade. Traditional unsupervised methods select the features which can faithfully preserve the intrinsic structures of data, where the intrinsic structures are…

Machine Learning · Computer Science 2015-04-06 Liang Du , Yi-Dong Shen

Extracting meaningful information from high-dimensional data poses a formidable modeling challenge, particularly when the data is obscured by noise or represented through different modalities. This research proposes a novel non-parametric…

Machine Learning · Computer Science 2024-08-27 Navid Ziaei , Behzad Nazari , Uri T. Eden , Alik Widge , Ali Yousefi

Not all real-world data are labeled, and when labels are not available, it is often costly to obtain them. Moreover, as many algorithms suffer from the curse of dimensionality, reducing the features in the data to a smaller set is often of…

Machine Learning · Computer Science 2022-05-19 Chiara Balestra , Florian Huber , Andreas Mayr , Emmanuel Müller

Unsupervised feature selection (UFS) is an important task in data engineering. However, most UFS methods construct models from a single perspective and often fail to simultaneously evaluate feature importance and preserve their inherent…

Machine Learning · Computer Science 2025-05-28 Jingjing Liu , Xiansen Ju , Xianchao Xiu , Wanquan Liu

Tabular biomedical data is often high-dimensional but with a very small number of samples. Although recent work showed that well-regularised simple neural networks could outperform more sophisticated architectures on tabular data, they are…

Machine Learning · Computer Science 2022-11-29 Andrei Margeloiu , Nikola Simidjievski , Pietro Lio , Mateja Jamnik

Gradient Boosted Decision Trees (GBDTs) are widely used for building ranking and relevance models in search and recommendation. Considerations such as latency and interpretability dictate the use of as few features as possible to train…

Machine Learning · Statistics 2021-09-07 Cuize Han , Nikhil Rao , Daria Sorokina , Karthik Subbian

Much work has been done recently to make neural networks more interpretable, and one obvious approach is to arrange for the network to use only a subset of the available features. In linear models, Lasso (or $\ell_1$-regularized) regression…

Machine Learning · Statistics 2021-06-17 Ismael Lemhadri , Feng Ruan , Louis Abraham , Robert Tibshirani

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

The challenge of selecting the most relevant features of a given dataset arises ubiquitously in data analysis and dimensionality reduction. However, features found to be of high importance for the entire dataset may not be relevant to…

Machine Learning · Statistics 2024-04-11 Otto Sumray , Heather A. Harrington , Vidit Nanda

Unsupervised feature selection (UFS) has recently gained attention for its effectiveness in processing unlabeled high-dimensional data. However, existing methods overlook the intrinsic causal mechanisms within the data, resulting in the…

Machine Learning · Computer Science 2025-01-28 Zongxin Shen , Yanyong Huang , Dongjie Wang , Minbo Ma , Fengmao Lv , Tianrui Li

Imperfect labels are ubiquitous in real-world datasets and seriously harm the model performance. Several recent effective methods for handling noisy labels have two key steps: 1) dividing samples into cleanly labeled and wrongly labeled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Wenkai Chen , Chuang Zhu , Yi Chen , Mengting Li , Tiejun Huang

Multi-view unsupervised feature selection (MUFS) has recently received increasing attention for its promising ability in dimensionality reduction on multi-view unlabeled data. Existing MUFS methods typically select discriminative features…

Machine Learning · Computer Science 2025-11-19 Zongxin Shen , Yanyong Huang , Bin Wang , Jinyuan Chang , Shiyu Liu , Tianrui Li

Analysis of single-cell transcriptomics often relies on clustering cells and then performing differential gene expression (DGE) to identify genes that vary between these clusters. These discrete analyses successfully determine cell types…

Quantitative Methods · Quantitative Biology 2022-10-07 Renee S. Hoekzema , Lewis Marsh , Otto Sumray , Thomas M. Carroll , Xin Lu , Helen M. Byrne , Heather A. Harrington

Feature selection (FS) is assumed to improve predictive performance and identify meaningful features in high-dimensional datasets. Surprisingly, small random subsets of features (0.02-1%) match or outperform the predictive performance of…

Machine Learning · Computer Science 2025-09-22 Bhavesh Neekhra , Debayan Gupta , Partha Pratim Chakrabarti