English
Related papers

Related papers: Trustworthy Feature Importance Avoids Unrestricted…

200 papers

Model-free knockoffs is a recently proposed technique for identifying covariates that is likely to have an effect on a response variable. The method is an efficient method to control the false discovery rate in hypothesis tests for separate…

Methodology · Statistics 2019-03-29 Lars Holden , Kristoffer Hellton

Shortcut mitigation strategies commonly rely on training data annotations, group-balanced held-out data or the presence of all groups, i.e., all combinations of (spurious) attributes and classes, in the training data. However, these…

Machine Learning · Computer Science 2026-05-14 Phuong Quynh Le , Jörg Schlötterer , Sari Sadiya , Gemma Roig , Christin Seifert

Model-based reinforcement learning aims to increase sample efficiency, but the accuracy of dynamics models and the resulting compounding errors are often seen as key limitations. This paper empirically investigates potential sample…

Machine Learning · Computer Science 2024-12-31 Daniel Palenicek , Michael Lutter , João Carvalho , Daniel Dennert , Faran Ahmad , Jan Peters

Copulas have become an important tool in the modern best practice Enterprise Risk Management, often supplanting other approaches to modelling stochastic dependence. However, choosing the `right' copula is not an easy task, and the…

Risk Management · Quantitative Finance 2016-10-10 Jianxi Su , Edward Furman

Classical semiparametric inference with missing outcome data is not robust to contamination of the observed data and a single observation can have arbitrarily large influence on estimation of a parameter of interest. This sensitivity is…

Methodology · Statistics 2021-03-02 Eva Cantoni , Xavier de Luna

Jacobi permutations, introduced by Viennot in the context of Jacobi elliptic functions, are counted by the Euler numbers $E_{n}$ appearing in the series expansion $\sec x+\tan x=\sum_{n=0}^{\infty}E_{n}x^{n}/n!$. We conduct a systematic…

Combinatorics · Mathematics 2025-09-23 Alyssa G. Henke , Kyle R. Hoffman , Derek H. Stephens , Yongwei Yuan , Yan Zhuang

The most popular methods for measuring importance of the variables in a black box prediction algorithm make use of synthetic inputs that combine predictor variables from multiple subjects. These inputs can be unlikely, physically…

Machine Learning · Computer Science 2023-04-14 Masayoshi Mase , Art B. Owen , Benjamin B. Seiler

In this work, we develop an importance sampling estimator by coupling the reduced-order model and the generative model in a problem setting of uncertainty quantification. The target is to estimate the probability that the quantity of…

Machine Learning · Statistics 2024-12-20 Xiaoliang Wan , Shuangqing Wei

Variational methods are employed in situations where exact Bayesian inference becomes intractable due to the difficulty in performing certain integrals. Typically, variational methods postulate a tractable posterior and formulate a lower…

Machine Learning · Statistics 2019-06-12 Nikolaos Gianniotis , Christoph Schnörr , Christian Molkenthin , Sanjay Singh Bora

Variable importance assessment has become a crucial step in machine-learning applications when using complex learners, such as deep neural networks, on large-scale data. Removal-based importance assessment is currently the reference…

Machine Learning · Computer Science 2023-10-27 Ahmad Chamma , Denis A. Engemann , Bertrand Thirion

We consider models for molecular sequence evolution in which the transition rates at each site depend on the local sequence context, giving rise to a time-inhomogeneous Markov process in which sites evolve under a complex dependency…

Computation · Statistics 2025-08-18 Joseph Mathews , Scott C. Schmidler

This paper is concerned with Bayesian inference when the likelihood is analytically intractable but can be unbiasedly estimated. We propose an annealed importance sampling procedure for estimating expectations with respect to the posterior.…

Methodology · Statistics 2014-02-26 M. -N. Tran , C. Strickland , M. K. Pitt , R. Kohn

Not all real-world data are labeled, and when labels are not available, it is often costly to obtain them. Moreover, as many algorithms suffer from the curse of dimensionality, reducing the features in the data to a smaller set is often of…

Machine Learning · Computer Science 2022-05-19 Chiara Balestra , Florian Huber , Andreas Mayr , Emmanuel Müller

Importance sampling is a widely used technique to estimate properties of a distribution. This paper investigates trading-off some bias for variance by adaptively winsorizing the importance sampling estimator. The novel winsorizing…

Computation · Statistics 2021-02-10 Paulo Orenstein

Kernel methods give powerful, flexible, and theoretically grounded approaches to solving many problems in machine learning. The standard approach, however, requires pairwise evaluations of a kernel function, which can lead to scalability…

Machine Learning · Computer Science 2021-04-08 Danica J. Sutherland , Jeff Schneider

In this paper, we integrate the concepts of feature importance with implicit bias in the context of pattern classification. This is done by means of a three-step methodology that involves (i) building a classifier and tuning its…

Machine Learning · Computer Science 2023-05-18 Isel Grau , Gonzalo Nápoles , Fabian Hoitsma , Lisa Koutsoviti Koumeri , Koen Vanhoof

We develop a new smoothing or extrapolating method, based on discrete Laguerre functions, for systematically analyzing the stochastic signal of shifted-contour auxiliary-field Monte Carlo. We study the statistical errors and extrapolation…

Strongly Correlated Electrons · Physics 2015-04-22 Shlomit Jacobi , Roi Baer

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution…

Artificial Intelligence · Computer Science 2015-09-24 Shayan Poursoltan , Frank Neumann

We investigate the effect that the choice of measurement scale has upon inference and extrapolation in extreme value analysis. Separate analyses of variables from a single process on scales which are linked by a nonlinear transformation may…

Applications · Statistics 2010-11-17 J. L. Wadsworth , J. A. Tawn , P. Jonathan

A method is described for the extrapolation of perturbative expansions in powers of asymptotically small coupling parameters or other variables onto the region of finite variables and even to the variables tending to infinity. The method…

High Energy Physics - Phenomenology · Physics 2024-06-18 V. I. Yukalov , E. P. Yukalova