English
Related papers

Related papers: Deletion and Insertion Tests in Regression Models

200 papers

Assessing the importance of individual features in Machine Learning is critical to understand the model's decision-making process. While numerous methods exist, the lack of a definitive ground truth for comparison highlights the need for…

Machine Learning · Computer Science 2025-12-05 Eddie Conti , Álvaro Parafita , Axel Brando

Segmentation has emerged as a fundamental field of computer vision and natural language processing, which assigns a label to every pixel/feature to extract regions of interest from an image/text. To evaluate the performance of segmentation,…

Machine Learning · Statistics 2023-11-14 Ben Dai , Chunlin Li

Rule-based models offer a human-understandable representation, i.e. they are interpretable. For this reason, they are used to explain the decisions of non-interpretable complex models, referred to as black box models. The generation of such…

Artificial Intelligence · Computer Science 2025-03-03 Michał Kozielski , Marek Sikora , Łukasz Wawrowski

Labeling cost is often expensive and is a fundamental limitation of supervised learning. In this paper, we study importance labeling problem, in which we are given many unlabeled data and select a limited number of data to be labeled from…

Machine Learning · Computer Science 2021-04-13 Tomoya Murata , Taiji Suzuki

Two maximum likelihood-based algorithms for unfolding or deconvolution are considered: the Richardson-Lucy method and the Data Unfolding method with Mean Integrated Square Error (MISE) optimization [10]. Unfolding is viewed as a procedure…

Data Analysis, Statistics and Probability · Physics 2025-11-18 Nikolay D. Gagunashvili

Feature importance scores are ubiquitous tools for understanding the predictions of machine learning models. However, many popular attribution methods suffer from high instability due to random sampling. Leveraging novel ideas from…

Machine Learning · Statistics 2025-07-08 Jeremy Goldwasser , Giles Hooker

We present a method of explainable artificial intelligence (XAI), "What I Know (WIK)", to provide additional information to verify the reliability of a deep learning model by showing an example of an instance in a training dataset that is…

Artificial Intelligence · Computer Science 2023-02-06 Shin-nosuke Ishikawa , Masato Todo , Masato Taki , Yasunobu Uchiyama , Kazunari Matsunaga , Peihsuan Lin , Taiki Ogihara , Masao Yasui

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Akaike's information criterion (AIC) is a measure of the quality of a statistical model for a given set of data. We can determine the best statistical model for a particular data set by the minimization of the AIC. Since we need to evaluate…

Optimization and Control · Mathematics 2019-11-21 Keiji Kimura , Hayato Waki

Predicting default is essential for banks to ensure profitability and financial stability. While modern machine learning methods often outperform traditional regression techniques, their lack of transparency limits their use in regulated…

Machine Learning · Computer Science 2025-09-16 Sagi Schwartz , Qinling Wang , Fang Fang

Explainable Artificial Intelligence (XAI) emerged to reveal the internal mechanism of machine learning models and how the features affect the prediction outcome. Collinearity is one of the big issues that XAI methods face when identifying…

Machine Learning · Computer Science 2024-11-05 Ahmed M Salih

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone

The purported "black box" nature of neural networks is a barrier to adoption in applications where interpretability is essential. Here we present DeepLIFT (Deep Learning Important FeaTures), a method for decomposing the output prediction of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Avanti Shrikumar , Peyton Greenside , Anshul Kundaje

Predictive modelling is important for health data analysis and data-driven clinical decision-making. However, predictive studies are challenging to design optimally by hand when tens or even hundreds of features require selection,…

Leveraging the large body of work devoted in recent years to describe redundancy and synergy in multivariate interactions among random variables, we propose a novel approach to quantify cooperative effects in feature importance, one of the…

Data Analysis, Statistics and Probability · Physics 2025-03-14 Marlis Ontivero-Ortega , Luca Faes , Jesus M Cortes , Daniele Marinazzo , Sebastiano Stramaglia

We show how complexity theory can be introduced in machine learning to help bring together apparently disparate areas of current research. We show that this new approach requires less training data and is more generalizable as it shows…

Machine Learning · Computer Science 2019-10-10 Santiago Hernández-Orozco , Hector Zenil , Jürgen Riedel , Adam Uccello , Narsis A. Kiani , Jesper Tegnér

This paper examines two different yet related questions related to explainable AI (XAI) practices. Machine learning (ML) is increasingly important in financial services, such as pre-approval, credit underwriting, investments, and various…

Machine Learning · Computer Science 2022-09-21 Swati Tyagi

Machine learning techniques can be useful in applications such as credit approval and college admission. However, to be classified more favorably in such contexts, an agent may decide to strategically withhold some of her features, such as…

Machine Learning · Computer Science 2021-01-15 Anilesh K. Krishnaswamy , Haoming Li , David Rein , Hanrui Zhang , Vincent Conitzer

This study introduces the concept of "structural beauty" as an objective computational approach for evaluating the aesthetic appeal of images. Through the utilization of the Segment anything model (SAM), we propose a method that leverages…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Yao Qianxiang , Bin Jiang

The kernel matrix used in kernel methods encodes all the information required for solving complex nonlinear problems defined on data representations in the input space using simple, but implicitly defined, solutions. Spectral analysis on…

Machine Learning · Computer Science 2020-10-26 Alexandros Iosifidis