English
Related papers

Related papers: SAND: One-Shot Feature Selection with Additive Noi…

200 papers

Feature selection prepares the AI-readiness of data by eliminating redundant features. Prior research falls into two primary categories: i) Supervised Feature Selection, which identifies the optimal feature subset based on their relevance…

Machine Learning · Computer Science 2024-03-08 Xinyuan Wang , Dongjie Wang , Wangyang Ying , Rui Xie , Haifeng Chen , Yanjie Fu

Feature selection is a dimensionality reduction technique that selects a subset of representative features from high dimensional data by eliminating irrelevant and redundant features. Recently, feature selection combined with sparse…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Siwei Feng , Marco F. Duarte

Feature selection is an important process in machine learning. It builds an interpretable and robust model by selecting the features that contribute the most to the prediction target. However, most mature feature selection algorithms,…

Machine Learning · Computer Science 2022-07-20 Zhifeng Qiu , Wanxin Zeng , Dahua Liao , Ning Gui

As an effective data preprocessing step, feature selection has shown its effectiveness to prepare high-dimensional data for many machine learning tasks. The proliferation of high di-mension and huge volume big data, however, has brought…

Machine Learning · Computer Science 2019-03-01 Ning Gui , Danni Ge , Ziyin Hu

Attention mechanisms, such as local and non-local attention, play a fundamental role in recent deep learning based speech enhancement (SE) systems. However, natural speech contains many fast-changing and relatively brief acoustic events,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-16 Xinmeng Xu , Weiping Tu , Yuhong Yang

There exist many high-dimensional data in real-world applications such as biology, computer vision, and social networks. Feature selection approaches are devised to confront with high-dimensional data challenges with the aim of efficient…

Machine Learning · Computer Science 2021-06-22 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Scientific observations may consist of a large number of variables (features). Identifying a subset of meaningful features is often ignored in unsupervised learning, despite its potential for unraveling clear patterns hidden in the ambient…

Machine Learning · Computer Science 2020-11-10 Ofir Lindenbaum , Uri Shaham , Jonathan Svirsky , Erez Peterfreund , Yuval Kluger

Excluding irrelevant features in a pattern recognition task plays an important role in maintaining a simpler machine learning model and optimizing the computational efficiency. Nowadays with the rise of large scale datasets, feature…

Machine Learning · Computer Science 2018-04-17 Saman Sadeghyan

Feature selection, an effective technique for dimensionality reduction, plays an important role in many machine learning systems. Supervised knowledge can significantly improve the performance. However, faced with the rapid growth of newly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Zheng Wang , Qiao Wang , Tingzhang Zhao , Xiaojun Ye

Feature selection is an essential step in data science pipelines to reduce the complexity associated with large datasets. While much research on this topic focuses on optimizing predictive performance, few studies investigate stability in…

Sparse Neural Networks (SNNs) have emerged as powerful tools for efficient feature selection. Leveraging the dynamic sparse training (DST) algorithms within SNNs has demonstrated promising feature selection capabilities while drastically…

We study the data selection problem, whose aim is to select a small representative subset of data that can be used to efficiently train a machine learning model. We present a new data selection approach based on $k$-means clustering and…

Network Intrusion Detection (NID) remains a key area of research within the information security community, while also being relevant to Machine Learning (ML) practitioners. The latter generally aim to detect attacks using network features,…

Machine Learning · Computer Science 2024-11-19 Charles Westphal , Stephen Hailes , Mirco Musolesi

Feature selection is essential for effective visual recognition. We propose an efficient joint classifier learning and feature selection method that discovers sparse, compact representations of input features from a vast sea of candidates,…

Computer Vision and Pattern Recognition · Computer Science 2015-12-03 Marius Leordeanu , Alexandra Radu , Shumeet Baluja , Rahul Sukthankar

Recent improvements in convolutional neural network (CNN)-based single image super-resolution (SISR) methods rely heavily on fabricating network architectures, rather than finding a suitable training algorithm other than simply minimizing…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 SeongUk Park , Nojun Kwak

The growing environmental footprint of artificial intelligence (AI), especially in terms of storage and computation, calls for more frugal and interpretable models. Sparse models (e.g., linear, neural networks) offer a promising solution by…

Machine Learning · Statistics 2025-09-23 Sylvain Sardy , Maxime van Cutsem , Xiaoyu Ma

Data and knowledge representation are fundamental concepts in machine learning. The quality of the representation impacts the performance of the learning model directly. Feature learning transforms or enhances raw data to structures that…

Artificial Intelligence · Computer Science 2021-04-26 Filipe Alves Neto Verri , Renato Tinós , Liang Zhao

One main obstacle for the wide use of deep learning in medical and engineering sciences is its interpretability. While neural network models are strong tools for making predictions, they often provide little information about which features…

Machine Learning · Statistics 2021-12-06 Vu Dinh , Lam Si Tung Ho

The problem of feature selection has raised considerable interests in the past decade. Traditional unsupervised methods select the features which can faithfully preserve the intrinsic structures of data, where the intrinsic structures are…

Machine Learning · Computer Science 2015-04-06 Liang Du , Yi-Dong Shen

Feature selection identifies subsets of informative features and reduces dimensions in the original feature space, helping provide insights into data generation or a variety of domain problems. Existing methods mainly depend on feature…

Machine Learning · Computer Science 2021-06-07 Xinxing Wu , Qiang Cheng