English
Related papers

Related papers: EnsembleIV: Creating Instrumental Variables from E…

200 papers

There are several bias mitigators that can reduce algorithmic bias in machine learning models but, unfortunately, the effect of mitigators on fairness is often not stable when measured across different data splits. A popular approach to…

Machine Learning · Computer Science 2022-02-03 Michael Feffer , Martin Hirzel , Samuel C. Hoffman , Kiran Kate , Parikshit Ram , Avraham Shinnar

Use of machine learning to estimate nuisance functions (e.g. outcomes models, propensity score models) in estimators used in causal inference is increasingly common, as it can mitigate bias due to model misspecification. However, it can be…

Methodology · Statistics 2025-07-17 Rachael K. Ross , Lina M. Montoya , Dana E. Goin , Ivan Diaz , Audrey Renson

This article considers inference in linear instrumental variables models with many regressors, all of which could be endogenous. We propose the STIV estimator. Identification robust confidence sets are derived by solving linear programs. We…

Statistics Theory · Mathematics 2021-08-09 Eric Gautier , Christiern Rose

This paper addresses the weak instruments problem in linear instrumental variable models from a Bayesian perspective. The new approach has two components. First, a novel predictor-dependent shrinkage prior is developed for the many…

Methodology · Statistics 2014-08-05 P. Richard Hahn , Hedibert Lopes

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

In this article supervised learning problems are solved using soft rule ensembles. We first review the importance sampling learning ensembles (ISLE) approach that is useful for generating hard rules. The soft rules are then obtained with…

Machine Learning · Statistics 2015-03-20 Deniz Akdemir , Nicolas Heslot

Instrumental variable (IV) methods mitigate bias from unobserved confounding in observational causal inference but rely on the availability of a valid instrument, which can often be difficult or infeasible to identify in practice. In this…

Machine Learning · Statistics 2026-04-08 Frances Dean , Jenna Fields , Radhika Bhalerao , Marie Charpignon , Ahmed Alaa

Addressing biases in AI models is crucial for ensuring fair and accurate predictions. However, obtaining large, unbiased datasets for training can be challenging. This paper proposes a comprehensive approach using multiple methods to remove…

Machine Learning · Computer Science 2024-02-15 Ahmed Radwan , Layan Zaafarani , Jetana Abudawood , Faisal AlZahrani , Fares Fourati

Most machine learning classifiers give predictions for new examples accurately, yet without indicating how trustworthy predictions are. In the medical domain, this hampers their integration in decision support systems, which could be useful…

Machine Learning · Computer Science 2018-07-06 Telma Pereira , Sandra Cardoso , Dina Silva , Manuela Guerreiro , Alexandre de Mendonça , Sara C. Madeira

Machine learning-based Deepfake detection models have achieved impressive results on benchmark datasets, yet their performance often deteriorates significantly when evaluated on out-of-distribution data. In this work, we investigate an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haroon Wahab , Hassan Ugail , Lujain Jaleel

This paper develops a new empirical Bayesian inference algorithm for solving a linear inverse problem given multiple measurement vectors (MMV) of under-sampled and noisy observable data. Specifically, by exploiting the joint sparsity across…

Numerical Analysis · Mathematics 2021-03-30 Jiahui Zhang , Anne Gelb , Theresa Scarnati

Ensemble methods are known for enhancing the accuracy and robustness of machine learning models by combining multiple base learners. However, standard approaches like greedy or random ensembling often fall short, as they assume a constant…

Machine Learning · Computer Science 2025-06-24 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Although deep learning models have achieved state-of-the-art performance on a number of vision tasks, generalization over high dimensional multi-modal data, and reliable predictive uncertainty estimation are still active areas of research.…

Machine Learning · Computer Science 2020-12-10 Samarth Sinha , Homanga Bharadhwaj , Anirudh Goyal , Hugo Larochelle , Animesh Garg , Florian Shkurti

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez

Unsupervised ensemble learning emerged to address the challenge of combining multiple learners' predictions without access to ground truth labels or additional data. This paradigm is crucial in scenarios where evaluating individual…

Machine Learning · Computer Science 2026-01-29 Ariel Maymon , Yanir Buznah , Uri Shaham

The doubly robust estimator, which models both the propensity score and outcomes, is a popular approach to estimate the average treatment effect in the potential outcome setting. The primary appeal of this estimator is its theoretical…

Methodology · Statistics 2024-09-11 Kaoru Babasaki , Shonosuke Sugasawa , Kosaku Takanashi , Kenichiro McAlinn

Latent confounders are a fundamental challenge for inferring causal effects from observational data. The instrumental variable (IV) approach is a practical way to address this challenge. Existing IV based estimators need a known IV or other…

Machine Learning · Computer Science 2024-12-09 Debo Cheng , Jiuyong Li , Lin Liu , Ziqi Xu , Weijia Zhang , Jixue Liu , Thuc Duy Le

Ensemble models often achieve higher accuracy than single learners, but their ability to maintain small generalization gaps is not always well understood. This study examines how ensembles balance accuracy and overfitting across four…

Machine Learning · Computer Science 2025-12-08 Zubair Ahmed Mohammad

We present new methods to estimate causal effects retrospectively from micro data with the assistance of a machine learning ensemble. This approach overcomes two important limitations in conventional methods like regression modeling or…

Machine Learning · Statistics 2016-07-12 Cyrus Samii , Laura Paler , Sarah Zukerman Daly

Imbalanced learning (IL), i.e., learning unbiased models from class-imbalanced data, is a challenging problem. Typical IL methods including resampling and reweighting were designed based on some heuristic assumptions. They often suffer from…

Machine Learning · Computer Science 2020-10-20 Zhining Liu , Pengfei Wei , Jing Jiang , Wei Cao , Jiang Bian , Yi Chang