English
Related papers

Related papers: Validity of Feature Importance in Low-Performing M…

200 papers

Accurate breast lesion risk estimation can significantly reduce unnecessary biopsies and help doctors decide optimal treatment plans. Most existing computer-aided systems rely solely on mammogram features to classify breast lesions. While…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Hung Q. Vo , Pengyu Yuan , Tiancheng He , Stephen T. C. Wong , Hien V. Nguyen

There exist many high-dimensional data in real-world applications such as biology, computer vision, and social networks. Feature selection approaches are devised to confront with high-dimensional data challenges with the aim of efficient…

Machine Learning · Computer Science 2021-06-22 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Many image and vision applications require a large amount of data for model training. Collecting all such data at a central location can be challenging due to data privacy and communication bandwidth restrictions. Federated learning is an…

Machine Learning · Computer Science 2020-06-24 Tiffany Tuor , Shiqiang Wang , Bong Jun Ko , Changchang Liu , Kin K. Leung

Many real-world machine learning applications are characterized by a huge number of features, leading to computational and memory issues, as well as the risk of overfitting. Ideally, only relevant and non-redundant features should be…

Machine Learning · Computer Science 2023-06-21 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Feature selection plays an important role in the data mining process. It is needed to deal with the excessive number of features, which can become a computational burden on the learning algorithms. It is also necessary, even when…

Machine Learning · Computer Science 2015-10-13 Tarek Amr Abdallah , Beatriz de La Iglesia

Imputation of missing attribute values in medical datasets for extracting hidden knowledge from medical datasets is an interesting research topic of interest which is very challenging. One cannot eliminate missing values in medical records.…

Databases · Computer Science 2016-03-11 Yelipe UshaRani , P. Sammulal

Quantifying the usefulness of individual features in random forests learning can greatly enhance its interpretability. Existing studies have shown that some popularly used feature importance measures for random forests suffer from the bias…

Machine Learning · Statistics 2023-11-14 Chien-Ming Chi , Yingying Fan , Jinchi Lv

We discuss promising recent contributions on quantifying feature relevance using Shapley values, where we observed some confusion on which probability distribution is the right one for dropped features. We argue that the confusion is based…

Machine Learning · Statistics 2019-11-28 Dominik Janzing , Lenon Minorics , Patrick Blöbaum

Machine Learning is transforming medical research by improving diagnostic accuracy and personalizing treatments. General ML models trained on large datasets identify broad patterns across populations, but their effectiveness is often…

Machine Learning · Computer Science 2024-12-24 Gideon Vos , Liza van Eijk , Zoltan Sarnyai , Mostafa Rahimi Azghadi

With the emergence of large-scale pre-trained neural networks, methods to adapt such "foundation" models to data-limited downstream tasks have become a necessity. Fine-tuning, preference optimization, and transfer learning have all been…

Machine Learning · Statistics 2025-07-09 Javan Tahir , Surya Ganguli , Grant M. Rotskoff

Have you ever wondered how your feature space is impacting the prediction of a specific sample in your dataset? In this paper, we introduce Single Sample Feature Importance (SSFI), which is an interpretable feature importance algorithm that…

Machine Learning · Computer Science 2019-11-28 Joseph Gatto , Ravi Lanka , Yumi Iwashita , Adrian Stoica

Low resolution fine-grained classification has widespread applicability for applications where data is captured at a distance such as surveillance and mobile photography. While fine-grained classification with high resolution images has…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Maneet Singh , Shruti Nagpal , Mayank Vatsa , Richa Singh

More attention is being paid for feature importance ranking (FIR), in particular when thousands of features can be extracted for intelligent diagnosis and personalized medicine. A large number of FIR approaches have been proposed, while few…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Shaode Yu , Zhicheng Zhang , Xiaokun Liang , Junjie Wu , Erlei Zhang , Wenjian Qin , Yaoqin Xie

The all-relevant problem of feature selection is the identification of all strongly and weakly relevant attributes. This problem is especially hard to solve for time series classification and regression in industrial applications such as…

Machine Learning · Computer Science 2017-05-23 Maximilian Christ , Andreas W. Kempa-Liehr , Michael Feindt

The performance of many machine learning algorithms depends on their hyperparameter settings. The goal of this study is to determine whether it is important to tune a hyperparameter or whether it can be safely set to a default value. We…

Machine Learning · Computer Science 2020-07-16 Hilde J. P. Weerts , Andreas C. Mueller , Joaquin Vanschoren

The recent paper by Byrd & Lipton (2019), based on empirical observations, raises a major concern on the impact of importance weighting for the over-parameterized deep learning models. They observe that as long as the model can separate the…

Machine Learning · Computer Science 2021-03-30 Da Xu , Yuting Ye , Chuanwei Ruan

In this work we show that the classification performance of high-dimensional structural MRI data with only a small set of training examples is improved by the usage of dimension reduction methods. We assessed two different dimension…

Machine Learning · Computer Science 2015-05-27 Andreas Grünauer , Markus Vincze

Data-fusion involves the integration of multiple related datasets. The statistical file-matching problem is a canonical data-fusion problem in multivariate analysis, where the objective is to characterise the joint distribution of a set of…

Methodology · Statistics 2021-04-08 Daniel Ahfock , Saumyadipta Pyne , Geoffrey J. McLachlan

In this paper we address the problem of feature selection when the data is functional, we study several statistical procedures including classification, regression and principal components. One advantage of the blinding procedure is that it…

Methodology · Statistics 2023-12-29 Ricardo Fraiman , Yanina Gimenez , Marcela Svarc

Machine learning (ML) models are increasingly used to support clinical decision-making. However, real-world medical datasets are often noisy, incomplete, and imbalanced, leading to performance disparities across patient subgroups. These…