English
Related papers

Related papers: Feature Selection for multi-labeled variables via …

200 papers

This paper uses a classical approach to feature selection: minimization of a cost function applied on estimated joint distributions. However, the search space in which such minimization is performed is extended. In the original formulation,…

Computation · Statistics 2018-01-31 Diego Marcondes , Adilson Simonis , Junior Barrera

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

The "Curse of dimensionality" is prevalent across various data patterns, which increases the risk of model overfitting and leads to a decline in model classification performance. However, few studies have focused on this issue in Partial…

Machine Learning · Computer Science 2025-06-06 Wanfu Gao , Hanlin Pan , Qingqi Han , Kunpeng Liu

Machine learning models usually assume that a set of feature values used to obtain an output is fixed in advance. However, in many real-world problems, a cost is associated with measuring these features. To address the issue of reducing…

Machine Learning · Computer Science 2025-03-13 Katsumi Takahashi , Koh Takeuchi , Hisashi Kashima

In machine learning and pattern recognition, feature selection has been a hot topic in the literature. Unsupervised feature selection is challenging due to the loss of labels which would supply the related information.How to define an…

Machine Learning · Computer Science 2015-01-14 Chang Liu , Yi Xu

Food authenticity studies are concerned with determining if food samples have been correctly labeled or not. Discriminant analysis methods are an integral part of the methodology for food authentication. Motivated by food authenticity…

Methodology · Statistics 2010-10-08 Thomas Brendan Murphy , Nema Dean , Adrian E. Raftery

Feature selection can efficiently identify the most informative features with respect to the target feature used in training. However, state-of-the-art vector-based methods are unable to encapsulate the relationships between feature samples…

Machine Learning · Computer Science 2018-09-11 Lixin Cui , Lu Bai , Zhihong Zhang , Yue Wang , Edwin R. Hancock

Statistical inference is considered for variables of interest, called primary variables, when auxiliary variables are observed along with the primary variables. We consider the setting of incomplete data analysis, where some primary…

Methodology · Statistics 2019-03-27 Shinpei Imori , Hidetoshi Shimodaira

Feature selection is a technique to screen out less important features. Many existing supervised feature selection algorithms use redundancy and relevancy as the main criteria to select features. However, feature interaction, potentially a…

Machine Learning · Statistics 2015-06-11 Wittawat Jitkrittum , Hirotaka Hachiya , Masashi Sugiyama

Dealing with datasets of very high dimension is a major challenge in machine learning. In this paper, we consider the problem of feature selection in applications where the memory is not large enough to contain all features. In this…

Machine Learning · Statistics 2017-09-07 Antonio Sutera , Célia Châtel , Gilles Louppe , Louis Wehenkel , Pierre Geurts

Many machine learning applications such as in vision, biology and social networking deal with data in high dimensions. Feature selection is typically employed to select a subset of features which im- proves generalization accuracy as well…

Machine Learning · Computer Science 2016-06-15 Yamuna Prasad , Dinesh Khandelwal , K. K. Biswas

In this paper, we present a new method for few-sample supervised feature selection (FS). Our method first learns the manifold of the feature space of each class using kernels capturing multi-feature associations. Then, based on Riemannian…

Machine Learning · Statistics 2022-07-19 David Cohen , Tal Shnitzer , Yuval Kluger , Ronen Talmon

When processing high-dimensional datasets, a common pre-processing step is feature selection. Filter-based feature selection algorithms are not tailored to a specific classification method, but rather rank the relevance of each feature with…

Machine Learning · Computer Science 2023-03-06 Shir Friedman , Gonen Singer , Neta Rabin

Cold-start challenges in recommender systems necessitate leveraging auxiliary features beyond user-item interactions. However, the presence of irrelevant or noisy features can degrade predictive performance, whereas an excessive number of…

Information Retrieval · Computer Science 2025-08-11 Nikita Sukhorukov , Danil Gusak , Evgeny Frolov

Conventional mutual information (MI) based feature selection (FS) methods are unable to handle heterogeneous feature subset selection properly because of data format differences or estimation methods of MI between feature subset and class…

Machine Learning · Statistics 2015-03-31 Min Wei , Tommy W. S. Chow , Rosa H. M. Chan

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi

Correlations in streams of multivariate time series data means that typically, only a small subset of the features are required for a given data mining task. In this paper, we propose a technique which we call Merit Score for Time-Series…

Machine Learning · Computer Science 2021-12-08 Bahavathy Kathirgamanathan , Padraig Cunningham

Existing feature filters rely on statistical pair-wise dependence metrics to model feature-target relationships, but this approach may fail when the target depends on higher-order feature interactions rather than individual contributions.…

Machine Learning · Computer Science 2025-10-07 Taurai Muvunza , Egor Kraev , Pere Planell-Morell , Alexander Y. Shestopaloff

In certain emerging applications such as health monitoring wearable and traffic monitoring systems, Internet-of-Things (IoT) devices generate or collect a huge amount of multi-label datasets. Within these datasets, each instance is linked…

Machine Learning · Computer Science 2024-10-01 Afsaneh Mahanipour , Hana Khamfroush

Mutual Information (MI) is often used for feature selection when developing classifier models. Estimating the MI for a subset of features is often intractable. We demonstrate, that under the assumptions of conditional independence, MI…

Machine Learning · Computer Science 2017-06-26 Hemanth Venkateswara , Prasanth Lade , Binbin Lin , Jieping Ye , Sethuraman Panchanathan