English
Related papers

Related papers: AFS: An Attention-based mechanism for Supervised F…

200 papers

Classic feature selection techniques remove those features that are either irrelevant or redundant, achieving a subset of relevant features that help to provide a better knowledge extraction. This allows the creation of compact models that…

Machine Learning · Computer Science 2020-12-16 Brais Cancela , Verónica Bolón-Canedo , Amparo Alonso-Betanzos , João Gama

This paper introduces a novel graph-based filter method for automatic feature selection (abbreviated as GB-AFS) for multi-class classification tasks. The method determines the minimum combination of features required to sustain prediction…

Machine Learning · Computer Science 2023-09-06 David Levin , Gonen Singer

Data-centric AI encourages the need of cleaning and understanding of data in order to achieve trustworthy AI. Existing technologies, such as AutoML, make it easier to design and train models automatically, but there is a lack of a similar…

Machine Learning · Computer Science 2022-03-10 Girmaw Abebe Tadesse , William Ogallo , Celia Cintas , Skyler Speakman

Identifying anomalies has become one of the primary strategies towards security and protection procedures in computer networks. In this context, machine learning-based methods emerge as an elegant solution to identify such scenarios and…

Machine Learning · Computer Science 2022-12-07 Lucas Biaggi , João P. Papa , Kelton A. P Costa , Danillo R. Pereira , Leandro A. Passos

High-dimensional data in many machine learning applications leads to computational and analytical complexities. Feature selection provides an effective way for solving these problems by removing irrelevant and redundant features, thus…

Machine Learning · Computer Science 2019-03-19 Ali Mirzaei , Vahid Pourahmadi , Mehran Soltani , Hamid Sheikhzadeh

Plant species exhibit significant intra-class variation and minimal inter-class variation. To enhance classification accuracy, it is essential to reduce intra-class variation while maximizing inter-class variation. This paper addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Aisha Zulfiqar , Ebroul Izquiedro

Excluding irrelevant features in a pattern recognition task plays an important role in maintaining a simpler machine learning model and optimizing the computational efficiency. Nowadays with the rise of large scale datasets, feature…

Machine Learning · Computer Science 2018-04-17 Saman Sadeghyan

Semi-supervised multi-label feature selection has recently been developed to solve the curse of dimensionality problem in high-dimensional multi-label data with certain samples missing labels. Although many efforts have been made, most…

Machine Learning · Computer Science 2025-10-10 Li Yang , Yanyong Huang , Dongjie Wang , Ke Li , Xiuwen Yi , Fengmao Lv , Tianrui Li

We introduce Attention Free Transformer (AFT), an efficient variant of Transformers that eliminates the need for dot product self attention. In an AFT layer, the key and value are first combined with a set of learned position biases, the…

Machine Learning · Computer Science 2021-09-23 Shuangfei Zhai , Walter Talbott , Nitish Srivastava , Chen Huang , Hanlin Goh , Ruixiang Zhang , Josh Susskind

In this paper, we propose an end-to-end feature fusion at-tention network (FFA-Net) to directly restore the haze-free image. The FFA-Net architecture consists of three key components: 1) A novel Feature Attention (FA) module combines…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Xu Qin , Zhilin Wang , Yuanchao Bai , Xiaodong Xie , Huizhu Jia

Black-box neural network models are widely used in industry and science, yet are hard to understand and interpret. Recently, the attention mechanism was introduced, offering insights into the inner workings of neural language models. This…

Machine Learning · Computer Science 2021-01-19 Blaž Škrlj , Sašo Džeroski , Nada Lavrač , Matej Petkovič

Irrelevant features can significantly degrade few-shot learn ing performance. This problem is used to match queries and support images based on meaningful similarities despite the limited data. However, in this process, non-relevant fea…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Javier Rodenas , Eduardo Aguilar , Petia Radeva

Sparse Neural Networks (SNNs) have emerged as powerful tools for efficient feature selection. Leveraging the dynamic sparse training (DST) algorithms within SNNs has demonstrated promising feature selection capabilities while drastically…

Feature selection is a crucial step in building machine learning models. This process is often achieved with accuracy as an objective, and can be cumbersome and computationally expensive for large-scale datasets. Several additional model…

Machine Learning · Computer Science 2024-03-15 Shubham Sharma , Sanghamitra Dutta , Emanuele Albini , Freddy Lecue , Daniele Magazzeni , Manuela Veloso

In computer vision, the performance of deep neural networks (DNNs) is highly related to the feature extraction ability, i.e., the ability to recognize and focus on key pixel regions in an image. However, in this paper, we quantitatively and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Shanshan Zhong , Wushao Wen , Jinghui Qin , Qiangpu Chen , Zhongzhan Huang

Despite convolutional network-based methods have boosted the performance of single image super-resolution (SISR), the huge computation costs restrict their practical applicability. In this paper, we develop a computation efficient yet…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Xuehui Wang , Qing Wang , Yuzhi Zhao , Junchi Yan , Lei Fan , Long Chen

Convolutional Neural Networks (CNNs) have achieved tremendous success in a number of learning tasks including image classification. Recent advanced models in CNNs, such as ResNets, mainly focus on the skip connection to avoid gradient…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Xinglin Pan , Jing Xu , Yu Pan , liangjian Wen , WenXiang Lin , Kun Bai , Zenglin Xu

One of the most important steps toward interpretability and explainability of neural network models is feature selection, which aims to identify the subset of relevant features. Theoretical results in the field have mostly focused on the…

Machine Learning · Computer Science 2020-10-19 Vu Dinh , Lam Si Tung Ho

Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised…

Machine Learning · Computer Science 2019-12-12 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Along with the flourish of the information age, massive amounts of data are generated day by day. Due to the large-scale and high-dimensional characteristics of these data, it is often difficult to achieve better decision-making in…

Machine Learning · Computer Science 2023-04-04 Peican Zhu , Xin Hou , Keke Tang , Zhen Wang , Feiping Nie