English
Related papers

Related papers: Causal Covariate Shift Correction using Fisher inf…

200 papers

Statistical change point (CP) detection methods typically rely on likelihood-based inference and ignore contextual information about plausible CP locations beyond the observed sequence. Although informative priors provide a natural way to…

Methodology · Statistics 2026-05-05 Jonathon Jacobs , Shanshan Chen

The most recent multi-source covariate shift algorithm is an efficient hyperparameter optimization algorithm for missing target output. In this paper, we extend this algorithm to the framework of federated learning. For data islands in…

Machine Learning · Statistics 2023-03-01 Yaqian Xu , Wenquan Cui , Jianjun Xu , Haoyang Cheng

Conformal prediction methodology has recently been extended to the covariate shift setting, where the distribution of covariates differs between training and test data. While existing results ensure that the prediction sets from these…

Machine Learning · Statistics 2026-02-09 Mehrdad Pournaderi , Yu Xiang

Deep active learning (AL) seeks to minimize the annotation costs for training deep neural networks. BAIT, a recently proposed AL strategy based on the Fisher Information, has demonstrated impressive performance across various datasets.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Denis Huseljic , Paul Hahn , Marek Herde , Lukas Rauch , Bernhard Sick

Randomized controlled trials generate experimental variation that can credibly identify causal effects, but often suffer from limited scale, while observational datasets are large, but often violate desired identification assumptions. To…

Econometrics · Economics 2023-12-27 George Z. Gui

Covariate shift in the test data is a common practical phenomena that can significantly downgrade both the accuracy and the fairness performance of the model. Ensuring fairness across different sensitive groups under covariate shift is of…

Machine Learning · Computer Science 2024-01-09 Shreyas Havaldar , Jatin Chauhan , Karthikeyan Shanmugam , Jay Nandy , Aravindan Raghuveer

In many statistical applications that concern mathematical psychologists, the concept of Fisher information plays an important role. In this tutorial we clarify the concept of Fisher information as it manifests itself across three different…

Statistics Theory · Mathematics 2017-10-18 Alexander Ly , Maarten Marsman , Josine Verhagen , Raoul Grasman , Eric-Jan Wagenmakers

Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these…

Machine Learning · Computer Science 2024-11-05 Edwige Cyffers , Muni Sreenivas Pydi , Jamal Atif , Olivier Cappé

Uncertainty estimation is a key factor that makes deep learning reliable in practical applications. Recently proposed evidential neural networks explicitly account for different uncertainties by treating the network's outputs as evidence to…

Machine Learning · Computer Science 2023-07-03 Danruo Deng , Guangyong Chen , Yang Yu , Furui Liu , Pheng-Ann Heng

The Fisher information matrix (FIM) plays an important role in the analysis of parameter inference and system design problems. In a number of cases, however, the statistical data distribution and its associated information matrix are either…

Statistics Theory · Mathematics 2016-11-24 Dave Zachariah , Petre Stoica

Estimating causal effects from observational data is not always possible due to confounding. Identifying a set of appropriate covariates (adjustment set) and adjusting for their influence can remove confounding bias; however, such a set is…

Methodology · Statistics 2020-11-19 Sofia Triantafillou , Gregory Cooper

We study variable selection (also called support recovery) in high-dimensional sparse linear regression when one has external information on which variables are likely to be associated with the response. Consistent recovery is only possible…

Statistics Theory · Mathematics 2026-02-16 Paul Rognon-Vael , David Rossell , Piotr Zwiernik

The Fisher information matrix is a quantity of fundamental importance for information geometry and asymptotic statistics. In practice, it is widely used to quickly estimate the expected information available in a data set and guide…

Methodology · Statistics 2023-06-06 William R. Coulton , Benjamin D. Wandelt

We study the problem of estimating the magnitude of a Gaussian beam displacement using a two pixel or 'split' detector. We calculate the maximum likelihood estimator, and compute its asymptotic mean-squared-error via the Fisher information.…

Instrumentation and Detectors · Physics 2015-09-11 George C. Knee , William J. Munro

Longitudinal observations are sometimes costly or not available. Cross sectional sampling can be an alternative. Observations are drawn then at a specific point in time from a population of durations whose distributions satisfy a {\em core…

Statistics Theory · Mathematics 2007-06-13 Bert van Es , Chris A. J. Klaassen , Philip J. Mokveld

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

Machine learning models trained on imbalanced datasets often exhibit intersectional biases-systematic errors arising from the interaction of multiple attributes such as object class and environmental conditions. This paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Farjana Yesmin

Short-term traffic volume prediction is crucial for intelligent transportation system and there are many researches focusing on this field. However, most of these existing researches concentrated on refining model architecture and ignored…

Machine Learning · Computer Science 2024-10-22 Xiannan Huang , Shuhan Qiu , Yan Cheng , Quan Yuan , Chao Yang

We introduce a fine-grained framework for uncertainty quantification of predictive models under distributional shifts. This framework distinguishes the shift in covariate distributions from that in the conditional relationship between the…

Methodology · Statistics 2025-05-20 Jiahao Ai , Zhimei Ren

Estimating the causal effects of an intervention from high-dimensional observational data is difficult due to the presence of confounding. The task is often complicated by the fact that we may have a systematic missingness in our data at…

Machine Learning · Statistics 2020-03-02 Sonali Parbhoo , Mario Wieser , Aleksander Wieczorek , Volker Roth