English
Related papers

Related papers: Interpretable Models via Pairwise permutations alg…

200 papers

A wide variety of model explanation approaches have been proposed in recent years, all guided by very different rationales and heuristics. In this paper, we take a new route and cast interpretability as a statistical inference problem. We…

Machine Learning · Computer Science 2024-01-01 Hugo Henri Joseph Senetaire , Damien Garreau , Jes Frellsen , Pierre-Alexandre Mattei

This work explores a novel approach for adaptive, differentiable parametrization of large-scale non-stationary random fields. Coupled with any gradient-based algorithm, the method can be applied to variety of optimization problems,…

Optimization and Control · Mathematics 2019-03-19 Andrei Mukhin , Aleksey Khlyupin

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

In machine learning one of the strategic tasks is the selection of only significant variables as predictors for the response(s). In this paper an approach is proposed which consists in the application of permutation tests on the candidate…

Variable importance is one of the most widely used measures for interpreting machine learning with significant interest from both statistics and machine learning communities. Recently, increasing attention has been directed toward…

Machine Learning · Statistics 2025-12-22 Xiaohan Wang , Yunzhe Zhou , Giles Hooker

In recent years, machine learning models have been increasingly applied to spectroscopic datasets for chemical and biomedical analysis. For their successful adoption, particularly in clinical and safety-critical settings, professionals and…

Correspondence analysis (CA) is a multivariate statistical tool used to visualize and interpret data dependencies by finding maximally correlated embeddings of pairs of random variables. CA has found applications in fields ranging from…

Machine Learning · Computer Science 2020-07-01 Hsiang Hsu , Salman Salamatian , Flavio P. Calmon

Most computer vision application rely on algorithms finding local correspondences between different images. These algorithms detect and compare stable local invariant descriptors centered at scale-invariant keypoints. Because of the…

Computer Vision and Pattern Recognition · Computer Science 2014-09-10 Ives Rey-Otero , Mauricio Delbracio , Jean-Michel Morel

This paper presents a new framework for manifold learning based on a sequence of principal polynomials that capture the possibly nonlinear nature of the data. The proposed Principal Polynomial Analysis (PPA) generalizes PCA by modeling the…

Machine Learning · Statistics 2016-02-02 Valero Laparra , Sandra Jiménez , Devis Tuia , Gustau Camps-Valls , Jesús Malo

The interpretation of feature importance in machine learning models is challenging when features are dependent. Permutation feature importance (PFI) ignores such dependencies, which can cause misleading interpretations due to extrapolation.…

Machine Learning · Statistics 2023-11-09 Christoph Molnar , Gunnar König , Bernd Bischl , Giuseppe Casalicchio

In genome-wide association (GWA) studies the goal is to detect associations between genetic markers and a given phenotype. The number of genetic markers can be large and effective methods for control of the overall error rate is a central…

Methodology · Statistics 2017-05-09 Kari Krizak Halle , Mette Langaas

Variable importance assessment has become a crucial step in machine-learning applications when using complex learners, such as deep neural networks, on large-scale data. Removal-based importance assessment is currently the reference…

Machine Learning · Computer Science 2023-10-27 Ahmad Chamma , Denis A. Engemann , Bertrand Thirion

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

Optimization and Control · Mathematics 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

Understanding the decision-making process of machine learning models provides valuable insights into the task, the data, and the reasons behind a model's failures. In this work, we propose a method that performs inherently interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Moritz Vandenhirtz , Julia E. Vogt

One of the central issues of several machine learning applications on real data is the choice of the input features. Ideally, the designer should select only the relevant, non-redundant features to preserve the complete information…

Machine Learning · Computer Science 2023-03-28 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Ubiquitous linear Gaussian exploratory tools such as principle component analysis (PCA) and factor analysis (FA) remain widely used as tools for: exploratory analysis, pre-processing, data visualization and related tasks. However, due to…

Machine Learning · Computer Science 2021-03-02 Adam Farooq , Yordan P. Raykov , Petar Raykov , Max A. Little

Being able to interpret, or explain, the predictions made by a machine learning model is of fundamental importance. This is especially true when there is interest in deploying data-driven models to make high-stakes decisions, e.g. in…

Machine Learning · Computer Science 2019-10-01 An-phi Nguyen , María Rodríguez Martínez

Multivariate correlation analysis plays a key role in various fields such as statistics and big data analytics. In this paper, it is presented a new non-parametric association measure between more than two variables based on the concept of…

Methodology · Statistics 2024-02-13 Eloi Martinez-Rabert

Methods for supervised principal component analysis (SPCA) aim to incorporate label information into principal component analysis (PCA), so that the extracted features are more useful for a prediction task of interest. Prior work on SPCA…

Machine Learning · Statistics 2022-08-18 Alexander Ritchie , Laura Balzano , Daniel Kessler , Chandra S. Sripada , Clayton Scott

Recent deep-learning models have achieved impressive predictive performance by learning complex functions of many variables, often at the cost of interpretability. This chapter covers recent work aiming to interpret models by attributing…

Machine Learning · Statistics 2021-08-20 Chandan Singh , Wooseok Ha , Bin Yu