English
Related papers

Related papers: Conditional Feature Importance for Mixed Data

200 papers

Motivation: Machine learning based prediction of compound-protein interactions (CPIs) is important for drug design, screening and repurposing studies and can improve the efficiency and cost-effectiveness of wet lab assays. Despite the…

Quantitative Methods · Quantitative Biology 2022-02-02 Adiba Yaseen , Imran Amin , Naeem Akhter , Asa Ben-Hur , Fayyaz Minhas

Explainable Artificial Intelligence (XAI) has mainly focused on static learning scenarios so far. We are interested in dynamic scenarios where data is sampled progressively, and learning is done in an incremental rather than a batch mode.…

Machine Learning · Computer Science 2023-10-31 Fabian Fumagalli , Maximilian Muschalik , Eyke Hüllermeier , Barbara Hammer

Understanding the contribution of individual features in predictive models remains a central goal in interpretable machine learning, and while many model-agnostic methods exist to estimate feature importance, they often fall short in…

Machine Learning · Computer Science 2025-07-08 Ivan Lazic , Chiara Barà , Marta Iovino , Sebastiano Stramaglia , Niksa Jakovljevic , Luca Faes

The identification of compound-protein interactions (CPI) plays a critical role in drug screening, drug repurposing, and combination therapy studies. The effectiveness of CPI prediction relies heavily on the features extracted from both…

Biomolecules · Quantitative Biology 2023-06-16 Li Zhang , Wenhao Li , Haotian Guan , Zhiquan He , Mingjun Cheng , Han Wang

Classifier specific (CS) and classifier agnostic (CA) feature importance methods are widely used (often interchangeably) by prior studies to derive feature importance ranks from a defect classifier. However, different feature importance…

Machine Learning · Computer Science 2022-02-08 Gopi Krishnan Rajbahadur , Shaowei Wang , Yasutaka Kamei , Ahmed E. Hassan

Although conceptually related, variable selection and relative importance (RI) analysis have been treated quite differently in the literature. While RI is typically used for post-hoc model explanation, this paper explores its potential for…

Machine Learning · Statistics 2026-04-24 Tien-En Chang , Argon Chen

When used in the context of decision theory, feature importance expresses how much changing the value of a feature can change the model outcome (or the utility of the outcome), compared to other features. Feature importance should not be…

Artificial Intelligence · Computer Science 2023-08-08 Kary Främling

Conditional selective inference (SI) has been actively studied as a new statistical inference framework for data-driven hypotheses. The basic idea of conditional SI is to make inferences conditional on the selection event characterized by a…

Machine Learning · Statistics 2021-04-23 Kazuya Sugiyama , Vo Nguyen Le Duy , Ichiro Takeuchi

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

Machine Learning · Computer Science 2026-03-30 Jörg Martin , Stefan Haufe

Accurate conditional prediction in the regression setting plays an important role in many real-world problems. Typically, a point prediction often falls short since no attempt is made to quantify the prediction accuracy. Classically, under…

Methodology · Statistics 2025-09-04 Kejin Wu , Dimitris N. Politis

In this paper, we introduce Partial Information Decomposition of Features (PIDF), a new paradigm for simultaneous data interpretability and feature selection. Contrary to traditional methods that assign a single importance value, our…

Machine Learning · Computer Science 2025-11-17 Charles Westphal , Stephen Hailes , Mirco Musolesi

This paper addresses challenges of designing and managing Complex Performance Indicators (CPI), which amalgamate individual indicators to measure latent, yet crucial business factors like customer satisfaction or sustainability indices.…

Software Engineering · Computer Science 2025-05-08 Benito Giunta , Corentin Burnay

Assessing the importance of individual features in Machine Learning is critical to understand the model's decision-making process. While numerous methods exist, the lack of a definitive ground truth for comparison highlights the need for…

Machine Learning · Computer Science 2025-12-05 Eddie Conti , Álvaro Parafita , Axel Brando

Structure learning of Conditional Random Fields (CRFs) can be cast into an L1-regularized optimization problem. To avoid optimizing over a fully linked model, gain-based or gradient-based feature selection methods start from an empty model…

Machine Learning · Computer Science 2014-07-01 Ni Lao , Jun Zhu

While precise data observation is essential for the learning processes of predictive models, it can be challenging owing to factors such as insufficient observation accuracy, high collection costs, and privacy constraints. In this paper, we…

Machine Learning · Computer Science 2024-09-18 Kosuke Sugiyama , Masato Uchida

Tests of conditional independence (CI) underpin a number of important problems in machine learning and statistics, from causal discovery to evaluation of predictor fairness and out-of-distribution robustness. Shah and Peters (2020) showed…

Machine Learning · Statistics 2025-12-17 Zheng He , Roman Pogodin , Yazhe Li , Namrata Deka , Arthur Gretton , Danica J. Sutherland

When training a predictive model over medical data, the goal is sometimes to gain insights about a certain disease. In such cases, it is common to use feature importance as a tool to highlight significant factors contributing to that…

Machine Learning · Computer Science 2020-10-16 Amnon Catav , Boyang Fu , Jason Ernst , Sriram Sankararaman , Ran Gilad-Bachrach

Feature attribution XAI algorithms enable their users to gain insight into the underlying patterns of large datasets through their feature importance calculation. Existing feature attribution algorithms treat all features in a dataset…

Artificial Intelligence · Computer Science 2022-03-25 Veera Raghava Reddy Kovvuri , Siyuan Liu , Monika Seisenberger , Berndt Müller , Xiuyi Fan

In order to ensure the reliability of the explanations of machine learning models, it is crucial to establish their advantages and limits and in which case each of these methods outperform. However, the current understanding of when and how…

Machine Learning · Computer Science 2025-02-12 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Sonali Parbhoo , Jesse Read

We propose a coefficient of conditional dependence between two random variables $Y$ and $Z$ given a set of other variables $X_1,\ldots,X_p$, based on an i.i.d. sample. The coefficient has a long list of desirable properties, the most…

Statistics Theory · Mathematics 2021-03-30 Mona Azadkia , Sourav Chatterjee