English
Related papers

Related papers: Graph Autoencoder-Based Unsupervised Feature Selec…

200 papers

We present a novel feature selection technique, Sparse Linear Centroid-Encoder (SLCE). The algorithm uses a linear transformation to reconstruct a point as its class centroid and, at the same time, uses the $\ell_1$-norm penalty to filter…

Machine Learning · Computer Science 2023-06-12 Tomojit Ghosh , Michael Kirby , Karim Karimov

Sparse autoencoders (SAEs) extract millions of interpretable features from a language model, but flat feature inventories aren't very useful on their own. Domain concepts get mixed with generic and weakly grounded features, while related…

Artificial Intelligence · Computer Science 2026-04-29 John Winnicki , Abeynaya Gnanasekaran , Eric Darve

This paper aims to improve the feature learning in Convolutional Networks (Convnet) by capturing the structure of objects. A new sparsity function is imposed on the extracted featuremap to capture the structure and shape of the learned…

Machine Learning · Computer Science 2017-01-03 Ehsan Hosseini-Asl

High-dimensional datasets depict a challenge for learning tasks in data mining and machine learning. Feature selection is an effective technique in dealing with dimensionality reduction. It is often an essential data processing step prior…

Machine Learning · Computer Science 2023-09-18 Gustavo Sosa-Cabrera , Santiago Gómez-Guerrero , Miguel García-Torres , Christian E. Schaerer

A common pipeline in functional data analysis is to first convert the discretely observed data to smooth functions, and then represent the functions by a finite-dimensional vector of coefficients summarizing the information. Existing…

Machine Learning · Computer Science 2024-01-19 Sidi Wu , Cédric Beaulac , Jiguo Cao

The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Fangfang Wang , Lingli Yang , Ruiqi Liu

Feature selection is playing an increasingly significant role with respect to many computer vision applications spanning from object recognition to visual object tracking. However, most of the recent solutions in feature selection are not…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Giorgio Roffo , Simone Melzi , Umberto Castellani , Alessandro Vinciarelli

In hyperspectral remote sensing data mining, it is important to take into account of both spectral and spatial information, such as the spectral signature, texture feature and morphological property, to improve the performances, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Lefei Zhang , Qian Zhang , Bo Du , Xin Huang , Yuan Yan Tang , Dacheng Tao

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

Most existing feature learning methods optimize inflexible handcrafted features and the affinity matrix is constructed by shallow linear embedding methods. Different from these conventional methods, we pretrain a generative neural network…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Changlu Chen , Chaoxi Niu , Xia Zhan , Kun Zhan

Unsupervised feature selection (FS) is essential for high-dimensional learning tasks where labels are not available. It helps reduce noise, improve generalization, and enhance interpretability. However, most existing unsupervised FS methods…

Machine Learning · Computer Science 2025-11-13 Shira Lifshitz , Ofir Lindenbaum , Gal Mishne , Ron Meir , Hadas Benisty

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

Band selection in hyperspectral imaging (HSI) is critical for optimising data processing and enhancing analytical accuracy. Traditional approaches have predominantly concentrated on analysing spectral and pixel characteristics within…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Judy X Yang , Jun Zhou , Jing Wang , Hui Tian , Alan Wee Chung Liew

The most effective dimensionality reduction procedures produce interpretable features from the raw input space while also providing good performance for downstream supervised learning tasks. For many methods, this requires optimizing one or…

Machine Learning · Computer Science 2023-02-22 Leland Barnard , Farwa Ali , Hugo Botha , David T. Jones

Unsupervised Anomaly Detection has become a popular method to detect pathologies in medical images as it does not require supervision or labels for training. Most commonly, the anomaly detection model generates a "normal" version of an…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Felix Meissen , Johannes Paetzold , Georgios Kaissis , Daniel Rueckert

Unsupervised representation learning has been extensively employed in anomaly detection, achieving impressive performance. Extracting valuable feature vectors that can remarkably improve the performance of anomaly detection are essential in…

Machine Learning · Computer Science 2022-04-26 Muhao Xu , Xueying Zhou , Xizhan Gao , WeiKai He , Sijie Niu

Feature selection is an important tool to deal with high dimensional data. In unsupervised case, many popular algorithms aim at maintaining the structure of the original data. In this paper, we propose a simple and effective feature…

Machine Learning · Statistics 2020-04-06 Xiaoyun Li , Chengxi Wu , Ping Li

In this paper, a novel learning paradigm is presented to automatically identify groups of informative and correlated features from very high dimensions. Specifically, we explicitly incorporate correlation measures as constraints and then…

Machine Learning · Computer Science 2012-07-03 Yiteng Zhai , Mingkui Tan , Ivor Tsang , Yew Soon Ong

The goal of feature selection is to choose the optimal subset of features for a recognition task by evaluating the importance of each feature, thereby achieving effective dimensionality reduction. Currently, proposed feature selection…

Machine Learning · Computer Science 2024-02-27 Zhenxing Zhang , Jun Ge , Zheng Wei , Chunjie Zhou , Yilei Wang

The selection of most informative and discriminative features from high-dimensional data has been noticed as an important topic in machine learning and data engineering. Using matrix factorization-based techniques such as nonnegative matrix…

Machine Learning · Computer Science 2022-10-04 Amir Moslemi , Arash Ahmadian