English
Related papers

Related papers: iLOCO: Distribution-Free Inference for Feature Int…

200 papers

The rapid advancement and widespread adoption of machine learning-driven technologies have underscored the practical and ethical need for creating interpretable artificial intelligence systems. Feature importance, a method that assigns…

Machine Learning · Computer Science 2023-12-07 Nimrod Harel , Uri Obolski , Ran Gilad-Bachrach

Feature selection is a critical component in predictive analytics that significantly affects the prediction accuracy and interpretability of models. Intrinsic methods for feature selection are built directly into model learning, providing a…

Machine Learning · Computer Science 2024-03-19 Theodor Stoecker , Nico Hambauer , Patrick Zschech , Mathias Kraus

In the context of algorithmic decision-making, fair machine learning methods often yield multiple models that balance predictive fairness and performance in varying degrees. This diversity introduces a challenge for stakeholders who must…

Machine Learning · Computer Science 2025-10-28 Sofoklis Kitharidis , Cor J. Veenman , Thomas Bäck , Niki van Stein

Errors might not have the same consequences depending on the task at hand. Nevertheless, there is limited research investigating the impact of imbalance in the contribution of different features in an error vector. Therefore, we propose the…

Machine Learning · Computer Science 2022-07-12 Xavier F. Cadet , Sara Ahmadi-Abhari , Hamed Haddadi

In unsupervised representation learning, models aim to distill essential features from high-dimensional data into lower-dimensional learned representations, guided by inductive biases. Understanding the characteristics that make a good…

Machine Learning · Computer Science 2024-10-02 Robin C. Geyer , Alessandro Torcinovich , João B. Carvalho , Alexander Meyer , Joachim M. Buhmann

Within the field of hierarchical modelling, little attention is paid to micro-macro models: those in which group-level outcomes are dependent on covariates measured at the level of individuals within groups. Although such models are perhaps…

Methodology · Statistics 2024-11-06 Shaun McDonald , Alexandre Leblanc , Saman Muthukumarana , David Campbell

Variable importance plays a pivotal role in interpretable machine learning as it helps measure the impact of factors on the output of the prediction model. Model agnostic methods based on the generation of "null" features via permutation…

Foot contact plays a critical role in human interaction with the world, and thus exploring foot contact can advance our understanding of human movement and physical interaction. Despite its importance, existing methods often approximate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Daniel Sungho Jung , Kyoung Mu Lee

Classifier specific (CS) and classifier agnostic (CA) feature importance methods are widely used (often interchangeably) by prior studies to derive feature importance ranks from a defect classifier. However, different feature importance…

Machine Learning · Computer Science 2022-02-08 Gopi Krishnan Rajbahadur , Shaowei Wang , Yasutaka Kamei , Ahmed E. Hassan

In models of opinion dynamics, many parameters -- either in the form of constants or in the form of functions -- play a critical role in describing, calibrating, and forecasting how opinions change with time. When examining a model of…

Social and Information Networks · Computer Science 2023-10-27 Weiqi Chu , Qin Li , Mason A. Porter

Fairness in machine learning research is commonly framed in the context of classification tasks, leaving critical gaps in regression. In this paper, we propose a novel approach to measure intersectional fairness in regression tasks, going…

Machine Learning · Computer Science 2025-08-01 Joe Germino , Nuno Moniz , Nitesh V. Chawla

When machine learning supports decision-making in safety-critical systems, it is important to verify and understand the reasons why a particular output is produced. Although feature importance calculation approaches assist in…

Machine Learning · Statistics 2020-09-14 Divish Rengasamy , Benjamin Rothwell , Grazziela Figueredo

To reduce the human intervention in the preference measure process,this article proposes a preference collaborative measure framework based on an updated belief system,which is also capable of improving the accuracy and efficiency of…

Artificial Intelligence · Computer Science 2025-04-01 Hang Yu , Wei Wei , Zheng Tan , Jing-lei Liu

Evaluating whether explanations faithfully reflect a model's reasoning remains an open problem. Existing benchmarks use single interventions without statistical testing, making it impossible to distinguish genuine faithfulness from…

Computation and Language · Computer Science 2026-03-20 Abhinaba Basu , Pavan Chakraborty

Feature importance (FI) estimates are a popular form of explanation, and they are commonly created and evaluated by computing the change in model confidence caused by removing certain input features at test time. For example, in the…

Machine Learning · Computer Science 2021-10-29 Peter Hase , Harry Xie , Mohit Bansal

Interpretable machine learning has become a very active area of research due to the rising popularity of machine learning algorithms and their inherently challenging interpretability. Most work in this area has been focused on the…

Machine Learning · Statistics 2023-11-09 Quay Au , Julia Herbinger , Clemens Stachl , Bernd Bischl , Giuseppe Casalicchio

In-context learning (ICL) is an important paradigm for adapting large language models (LLMs) to new tasks, but the generalization behavior of ICL remains poorly understood. We investigate the inductive biases of ICL from the perspective of…

Computation and Language · Computer Science 2023-05-23 Chenglei Si , Dan Friedman , Nitish Joshi , Shi Feng , Danqi Chen , He He

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Background Deriving feature rankings is essential in bioinformatics studies since the ordered features are important in guiding subsequent research. Feature rankings may be distorted by influential points (IP), but such effects are rarely…

Applications · Statistics 2023-03-21 Shuo Wang , Junyan Lu

In observational studies with dichotomous outcome of a population, researchers need to present the effects of exposures and interaction between the exposures jointly in order to learn the relationship between the exposure effects and the…

Methodology · Statistics 2015-01-22 Xiaoqin Wang , Weimin Ye , Li Yin