English
Related papers

Related papers: Statistically Valid Variable Importance Assessment…

200 papers

Growing scale of recommender systems require extensive tuning to respond to market dynamics and system changes. We address the challenge of tuning a large-scale ads recommendation platform with multiple continuous parameters influencing key…

Machine Learning · Computer Science 2024-10-08 Kaushal Paneri , Michael Munje , Kailash Singh Maurya , Adith Swaminathan , Yifan Shi

Estimating high-dimensional covariance matrices is a key task across many fields. This paper explores the theoretical limits of distributed covariance estimation in a feature-split setting, where communication between agents is constrained.…

Machine Learning · Statistics 2025-07-24 Mohammad Reza Rahmani , Mohammad Hossein Yassaee , Mohammad Reza Aref

Understanding the contribution of individual features in predictive models remains a central goal in interpretable machine learning, and while many model-agnostic methods exist to estimate feature importance, they often fall short in…

Machine Learning · Computer Science 2025-07-08 Ivan Lazic , Chiara Barà , Marta Iovino , Sebastiano Stramaglia , Niksa Jakovljevic , Luca Faes

Important variables of processes are often categorical, i.e. names or labels representing, e.g. categories of inputs, or types of reactors or a sequence of steps. In this work, we use Natural Language Processing Models to derive embeddings…

The estimation of the Extreme Value Index (EVI) is fundamental in extreme value analysis but suffers from high variance due to reliance on only a few extreme observations. We propose a control variates based transfer learning approach in a…

Methodology · Statistics 2025-11-20 Louison Bocquet-Nouaille , Jérôme Morio , Benjamin Bobbia

In various high-energy physics contexts, such as neutrino-oscillation experiments, several assumptions underlying the typical asymptotic confidence interval construction are violated, such that one has to resort to computationally expensive…

High Energy Physics - Experiment · Physics 2024-05-09 Lukas Berns

Canonical correlation analysis (CCA) has become a key tool for population neuroimaging, allowing investigation of associations between many imaging and non-imaging measurements. As other variables are often a source of variability not of…

Methodology · Statistics 2024-01-09 Anderson M. Winkler , Olivier Renaud , Stephen M. Smith , Thomas E. Nichols

Current practice in interpretable machine learning often focuses on explaining the final model trained from data, e.g., by using the Shapley additive explanations (SHAP) method. The recently developed Shapley variable importance cloud…

Machine Learning · Computer Science 2022-12-19 Yilin Ning , Mingxuan Liu , Nan Liu

As technology advanced, collecting data via automatic collection devices become popular, thus we commonly face data sets with lengthy variables, especially when these data sets are collected without specific research goals beforehand. It…

Machine Learning · Statistics 2022-05-10 Wan-Ping Nicole Chen , Yuan-chin Ivan Chang

Instruction-tuning datasets often contain substantial redundancy and low-quality samples, necessitating effective data selection methods. We propose an instruction data selection framework based on weighted in-context influence (wICI),…

Computation and Language · Computer Science 2026-04-29 Guangzeng Han , Xiaolei Huang

The gold standard for identifying causal relationships is a randomized controlled experiment. In many applications in the social sciences and medicine, the researcher does not control the assignment mechanism and instead may rely upon…

Applications · Statistics 2016-11-22 Johann Gagnon-Bartsch , Yotam Shem-Tov

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

This paper fills the limited statistical understanding of Shapley values as a variable importance measure from a nonparametric (or smoothing) perspective. We introduce population-level \textit{Shapley curves} to measure the true variable…

Machine Learning · Statistics 2024-04-04 Ratmir Miftachov , Georg Keilbar , Wolfgang Karl Härdle

The basic idea of importance sampling is to use independent samples from a proposal measure in order to approximate expectations with respect to a target measure. It is key to understand how many samples are required in order to guarantee…

Computation · Statistics 2017-01-17 S. Agapiou , O. Papaspiliopoulos , D. Sanz-Alonso , A. M. Stuart

Reliability-oriented sensitivity analysis aims at combining both reliability and sensitivity analyses by quantifying the influence of each input variable of a numerical model on a quantity of interest related to its failure. In particular,…

Statistics Theory · Mathematics 2022-10-25 Julien Demange-Chryst , François Bachoc , Jérôme Morio

Detecting lexical semantic change in smaller data sets, e.g. in historical linguistics and digital humanities, is challenging due to a lack of statistical power. This issue is exacerbated by non-contextual embedding models that produce one…

Computation and Language · Computer Science 2022-02-23 Yang Liu , Alan Medlar , Dorota Glowacka

In this comment on "Solving Statistical Mechanics Using Variational Autoregressive Networks" by Wu et al., we propose a subtle yet powerful modification of their approach. We show that the inherent sampling error of their method can be…

Statistical Mechanics · Physics 2019-03-27 Kim Nicoli , Pan Kessel , Nils Strodthoff , Wojciech Samek , Klaus-Robert Müller , Shinichi Nakajima

Explainable AI (XAI) is widely used to analyze AI systems' decision-making, such as providing counterfactual explanations for recourse. When unexpected explanations occur, users may want to understand the training data properties shaping…

Machine Learning · Computer Science 2025-03-26 André Artelt , Barbara Hammer

Modified policy iteration (MPI) is a dynamic programming (DP) algorithm that contains the two celebrated policy and value iteration methods. Despite its generality, MPI has not been thoroughly studied, especially its approximation form…

Artificial Intelligence · Computer Science 2012-05-21 Bruno Scherrer , Victor Gabillon , Mohammad Ghavamzadeh , Matthieu Geist

Learning in neural networks is often framed as a problem in which targeted error signals are directly propagated to parameters and used to produce updates that induce more optimal network behaviour. Backpropagation of error (BP) is an…

Neural and Evolutionary Computing · Computer Science 2023-01-30 Nasir Ahmad , Ellen Schrader , Marcel van Gerven