English
Related papers

Related papers: Total Variation Floodgate for Variable Importance …

200 papers

There has been recent interest in extending the ideas of False Discovery Rates (FDR) to variable selection in regression settings. Traditionally the FDR in these settings has been defined in terms of the coefficients of the full regression…

Methodology · Statistics 2013-02-12 Max Grazier G'Sell , Trevor Hastie , Robert Tibshirani

An important objective of experimental biology is the quantification of the relationship between predictor and response variables, a statistical analysis often termed variance partitioning (VP). In this paper, a series of simulations is…

Applications · Statistics 2019-11-27 Matthias M. Fischer

Despite increasing popularity in empirical studies, the integration of machine learning generated variables into regression models for statistical inference suffers from the measurement error problem, which can bias estimation and threaten…

Econometrics · Economics 2024-12-23 Gordon Burtch , Edward McFowland , Mochen Yang , Gediminas Adomavicius

Learning with hidden variables is a central challenge in probabilistic graphical models that has important implications for many real-life problems. The classical approach is using the Expectation Maximization (EM) algorithm. This…

Machine Learning · Computer Science 2012-12-12 Gal Elidan , Nir Friedman

The extreme value index (EVI) characterizes the tail behavior of a distribution and is crucial for extreme value theory. Inference on the EVI is challenging due to data scarcity in the tail region. We propose a novel method for constructing…

Methodology · Statistics 2025-12-15 Yiwei Tang , Judy Huixia Wang , Deyuan Li

Computing the exact likelihood of data in large Bayesian networks consisting of thousands of vertices is often a difficult task. When these models contain many deterministic conditional probability tables and when the observed values are…

Computation · Statistics 2012-06-26 Ydo Wexler , Dan Geiger

Fr\'echet regression has emerged as a promising approach for regression analysis involving non-Euclidean response variables. However, its practical applicability has been hindered by its reliance on ideal scenarios with abundant and…

Methodology · Statistics 2023-10-26 Kyunghee Han , Dogyoon Song

In a variety of scientific applications we wish to characterize a physical system using measurements or observations. This often requires us to solve an inverse problem, which usually has non-unique solutions so uncertainty must be…

Geophysics · Physics 2022-05-19 Xin Zhang , Muhammad Atif Nawaz , Xuebin Zhao , Andrew Curtis

We consider the problem of statistical inference when the data is collected via a Thompson Sampling-type algorithm. While Thompson Sampling (TS) is known to be both asymptotically optimal and empirically effective, its adaptive sampling…

Machine Learning · Statistics 2026-03-17 Budhaditya Halder , Shubhayan Pan , Koulik Khamaru

Ecess-over-Threshold method is a crucial technique in extreme value analysis, which approximately models larger observations over a threshold using a Generalized Pareto Distribution. This paper presents a comprehensive framework for…

Methodology · Statistics 2025-06-03 Yifan Hu , Yanxi Hou

Variable importance plays a pivotal role in interpretable machine learning as it helps measure the impact of factors on the output of the prediction model. Model agnostic methods based on the generation of "null" features via permutation…

The automation of probabilistic reasoning is one of the primary aims of machine learning. Recently, the confluence of variational inference and deep learning has led to powerful and flexible automatic inference methods that can be trained…

Machine Learning · Statistics 2021-02-10 Luca Ambrogioni , Gianluigi Silvestri , Marcel van Gerven

Visual statistical inference is a way to determine significance of patterns found while exploring data. It is dependent on the evaluation of a lineup, of a data plot among a sample of null plots, by human observers. Each individual is…

Applications · Statistics 2014-08-12 Mahbubul Majumder , Heike Hofmann , Dianne Cook

Treatment effect heterogeneity plays an important role in many areas of causal inference and within recent years, estimation of the conditional average treatment effect (CATE) has received much attention in the statistical community. While…

Methodology · Statistics 2024-12-17 Simon Christoffer Ziersen , Torben Martinussen

We study the excess minimum risk in statistical inference, defined as the difference between the minimum expected loss in estimating a random variable from an observed feature vector and the minimum expected loss in estimating the same…

Information Theory · Computer Science 2023-09-29 László Györfi , Tamás Linder , Harro Walk

With the introduction of the variational autoencoder (VAE), probabilistic latent variable models have received renewed attention as powerful generative models. However, their performance in terms of test likelihood and quality of generated…

Machine Learning · Statistics 2020-01-13 Lars Maaløe , Marco Fraccaro , Valentin Liévin , Ole Winther

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

Machine Learning · Statistics 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

Factor analysis acts a pivotal role in enhancing maritime safety. Most previous studies conduct factor analysis within the framework of incident-related label prediction, where the developed models can be categorized into short-term and…

Machine Learning · Computer Science 2024-10-29 Tianyi Chen , Hua Wang , Yutong Cai , Maohan Liang , Qiang Meng

Probabilistic graphical models offer a powerful framework to account for the dependence structure between variables, which is represented as a graph. However, the dependence between variables may render inference tasks intractable. In this…

Variational inference is a very efficient and popular heuristic used in various forms in the context of latent variable models. It's closely related to Expectation Maximization (EM), and is applied when exact EM is computationally…

Machine Learning · Computer Science 2015-08-25 Pranjal Awasthi , Andrej Risteski