English
Related papers

Related papers: Model free variable importance for high dimensiona…

200 papers

Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values…

Machine Learning · Statistics 2020-02-07 Kjersti Aas , Martin Jullum , Anders Løland

Sequential algorithms such as sequential importance sampling (SIS) and sequential Monte Carlo (SMC) have proven fundamental in Bayesian inference for models not admitting a readily available likelihood function. For approximate Bayesian…

Computation · Statistics 2024-11-08 Umberto Picchini , Massimiliano Tamborrino

Shapley effects are a particularly interpretable approach to assessing how a function depends on its various inputs. The existing literature contains various estimators for this class of sensitivity indices in the context of nonparametric…

Methodology · Statistics 2025-05-27 Akira Horiguchi , Matthew T. Pratola

Score-based generative models require guidance in order to generate plausible, on-manifold samples. The most popular guidance method, Classifier-Free Guidance (CFG), is only applicable in settings with labeled data and requires training an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Eric Yeats , Darryl Hannan , Wilson Fearn , Timothy Doster , Henry Kvinge , Scott Mahan

Among various supervised deep metric learning methods proxy-based approaches have achieved high retrieval accuracies. Proxies, which are class-representative points in an embedding space, receive updates based on proxy-sample similarities…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Aoyu Li , Ikuro Sato , Kohta Ishikawa , Rei Kawakami , Rio Yokota

Gaussian Process (GP) models are a powerful tool in probabilistic machine learning with a solid theoretical foundation. Thanks to current advances, modeling complex data with GPs is becoming increasingly feasible, which makes them an…

Machine Learning · Computer Science 2025-03-04 Sarem Seitz

Graphical models have found widespread applications in many areas of modern statistics and machine learning. Iterative Proportional Fitting (IPF) and its variants have become the default method for undirected graphical model estimation, and…

Methodology · Statistics 2024-08-22 Kshitij Khare , Syed Rahman , Bala Rajaratnam , Jiayuan Zhou

Feature importance measures are widely studied and are essential for understanding model behavior, guiding feature selection, and enhancing interpretability. However, many machine learning fitted models involve complex interactions between…

Machine Learning · Statistics 2025-05-26 Camille Little , Lili Zheng , Genevera Allen

Inference for doubly intractable distributions is challenging because the intractable normalizing functions of these models include parameters of interest. Previous auxiliary variable MCMC algorithms are infeasible for multi-dimensional…

Computation · Statistics 2020-08-07 Jaewoo Park

Spatial two-component mixture models offer a robust framework for analyzing spatially correlated data with zero inflation. To circumvent potential biases introduced by assuming a specific distribution for the response variables, we employ a…

Methodology · Statistics 2025-09-17 Chung-Wei Shen , Bu-Ren Hsu , Chia-Ming Hsu , Chun-Shu Chen

Choice modeling has been a central topic in the study of individual preference or utility across many fields including economics, marketing, operations research, and psychology. While the vast majority of the literature on choice models has…

Machine Learning · Statistics 2022-08-22 Zhongze Cai , Hanzhao Wang , Kalyan Talluri , Xiaocheng Li

Algorithmic fairness is of utmost societal importance, yet state-of-the-art large-scale machine learning models require training with massive datasets that are frequently biased. In this context, pre-processing methods that focus on…

Machine Learning · Computer Science 2024-06-12 Adrian Arnaiz-Rodriguez , Nuria Oliver

Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature…

Machine Learning · Statistics 2025-10-03 Wangxuan Fan , Siqi Li , Doudou Zhou , Yohei Okada , Chuan Hong , Molei Liu , Nan Liu

Understanding systems by forward and inverse modeling is a recurrent topic of research in many domains of science and engineering. In this context, Monte Carlo methods have been widely used as powerful tools for numerical inference and…

Computation · Statistics 2022-02-14 F. Llorente , L. Martino , D. Delgado , G. Camps-Valls

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

Lower-dimensional subspaces that impact estimates of uncertainty are often described by Linear combinations of input variables, leading to active variables. This paper extends the derivative-based active subspace methods and…

Numerical Analysis · Mathematics 2026-01-08 Matieyendou Lamboni , Sergei Kucherenko

We propose a general, modular method for significance testing of groups (or clusters) of variables in a high-dimensional linear model. In presence of high correlations among the covariables, due to serious problems of identifiability, it is…

Statistics Theory · Mathematics 2015-02-12 Jacopo Mandozzi , Peter Bühlmann

This work introduces a novel, simple, and flexible method to quantify irreversibility in generic high-dimensional time series based on the well-known mapping to a binary classification problem. Our approach utilizes gradient boosting for…

Statistical Mechanics · Physics 2025-01-09 Michele Vodret , Cristiano Pacini , Christian Bongiorno

Causal discovery methods seek to identify causal relations between random variables from purely observational data, as opposed to actively collected experimental data where an experimenter intervenes on a subset of correlates. One of the…

Machine Learning · Computer Science 2021-02-08 Samir Wadhwa , Roy Dong

Undirected graphical models are widely used to model the conditional independence structure of vector-valued data. However, in many modern applications, for example those involving EEG and fMRI data, observations are more appropriately…

Machine Learning · Statistics 2024-01-29 Boxin Zhao , Percy S. Zhai , Y. Samuel Wang , Mladen Kolar