English
Related papers

Related papers: ShuffleGate: A Unified Gating Mechanism for Featur…

200 papers

In this paper, a novel learning paradigm is presented to automatically identify groups of informative and correlated features from very high dimensions. Specifically, we explicitly incorporate correlation measures as constraints and then…

Machine Learning · Computer Science 2012-07-03 Yiteng Zhai , Mingkui Tan , Ivor Tsang , Yew Soon Ong

Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Azam Asilian Bidgoli , Shahryar Rahnamayan

Previous work combines word-level and character-level representations using concatenation or scalar weighting, which is suboptimal for high-level tasks like reading comprehension. We present a fine-grained gating mechanism to dynamically…

Computation and Language · Computer Science 2017-09-13 Zhilin Yang , Bhuwan Dhingra , Ye Yuan , Junjie Hu , William W. Cohen , Ruslan Salakhutdinov

A common approach for feature selection is to examine the variable importance scores for a machine learning model, as a way to understand which features are the most relevant for making predictions. Given the significance of feature…

Machine Learning · Computer Science 2021-05-13 Jack Dunn , Luca Mingardi , Ying Daisy Zhuo

Feature Transformation is crucial for classic machine learning that aims to generate feature combinations to enhance the performance of downstream tasks from a data-centric perspective. Current methodologies, such as manual expert-driven…

Machine Learning · Computer Science 2025-03-27 Tianqi He , Xiaohan Huang , Yi Du , Qingqing Long , Ziyue Qiao , Min Wu , Yanjie Fu , Yuanchun Zhou , Meng Xiao

Feature selection is a vital technique in machine learning, as it can reduce computational complexity, improve model performance, and mitigate the risk of overfitting. However, the increasing complexity and dimensionality of datasets pose…

Machine Learning · Computer Science 2024-07-24 Yuepeng Chen , Weiping Ding , Hengrong Ju , Jiashuang Huang , Tao Yin

Ensuring the trustworthiness and interpretability of machine learning models is critical to their deployment in real-world applications. Feature attribution methods have gained significant attention, which provide local explanations of…

Machine Learning · Computer Science 2023-09-20 Md Abdul Kadir , Gowtham Krishna Addluri , Daniel Sonntag

Modern DNN-based recommendation systems rely on training-derived embeddings of sparse features. Input sparsity makes obtaining high-quality embeddings for rarely-occurring categories harder as their representations are updated infrequently.…

Machine Learning · Computer Science 2023-09-29 Zihao Deng , Benjamin Ghaemmaghami , Ashish Kumar Singh , Benjamin Cho , Leo Orshansky , Mattan Erez , Michael Orshansky

Feature selection (FS) is a process which attempts to select more informative features. In some cases, too many redundant or irrelevant features may overpower main features for classification. Feature selection can remedy this problem and…

Machine Learning · Computer Science 2013-06-07 A. Nisthana Parveen , H. Hannah Inbarani , E. N. Sathishkumar

Modern deep learning-based recommendation systems exploit hundreds to thousands of different categorical features, each with millions of different categories ranging from clicks to posts. To respect the natural diversity within the…

Machine Learning · Computer Science 2020-06-30 Hao-Jun Michael Shi , Dheevatsa Mudigere , Maxim Naumov , Jiyan Yang

Exemplar replay has become an effective strategy for mitigating catastrophic forgetting in federated continual learning (FCL) by retaining representative samples from past tasks. Existing studies focus on designing sample-importance…

Machine Learning · Computer Science 2026-04-13 Zhuang Qi , Ying-Peng Tang , Lei Meng , Guoqing Chao , Lei Wu , Han Yu , Xiangxu Meng

Recognition of objects with subtle differences has been used in many practical applications, such as car model recognition and maritime vessel identification. For discrimination of the objects in fine-grained detail, we focus on deep…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Kaan Karaman , Erhan Gundogdu , Aykut Koc , A. Aydin Alatan

Feature selection is one of the most relevant processes in any methodology for creating a statistical learning model. Usually, existing algorithms establish some criterion to select the most influential variables, discarding those that do…

Machine Learning · Statistics 2024-05-10 Carlos Sebastián , Carlos E. González-Guillén

This paper analyses properties of conceptual hierarchy obtained via incremental concept formation method called "flexible prediction" in order to determine what kind of "relevance" of participating attributes may be requested for meaningful…

Artificial Intelligence · Computer Science 2020-05-26 Mieczyslaw A. Klopotek , Andrzej Matuszewski

Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised…

Machine Learning · Computer Science 2019-12-12 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Interpretable machine learning has become a very active area of research due to the rising popularity of machine learning algorithms and their inherently challenging interpretability. Most work in this area has been focused on the…

Machine Learning · Statistics 2023-11-09 Quay Au , Julia Herbinger , Clemens Stachl , Bernd Bischl , Giuseppe Casalicchio

Feature selection, which is a technique to select key features in recommender systems, has received increasing research attention. Recently, Adaptive Feature Selection (AdaFS) has shown remarkable performance by adaptively selecting…

Information Retrieval · Computer Science 2023-09-07 Youngjune Lee , Yeongjong Jeong , Keunchan Park , SeongKu Kang

Feature ranking has been widely adopted in machine learning applications such as high-throughput biology and social sciences. The approaches of the popular Relief family of algorithms assign importances to features by iteratively accounting…

Machine Learning · Computer Science 2021-01-26 Blaž Škrlj , Sašo Džeroski , Nada Lavrač , Matej Petković

Feature Selection is a crucial procedure in Data Science tasks such as Classification, since it identifies the relevant variables, making thus the classification procedures more interpretable, cheaper in terms of measurement and more…

Machine Learning · Statistics 2024-01-17 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

Limited by cognitive abilities, decision-makers (DMs) may struggle to evaluate decision alternatives based on all criteria in multiple criteria decision-making problems. This paper proposes an embedded criteria selection method derived from…

Optimization and Control · Mathematics 2025-06-10 Kun Zhou , Zaiwu Gong , Guo Wei , Roman Slowinski