English
Related papers

Related papers: Cross-Fitting and Averaging for Machine Learning E…

200 papers

The adaptive asymmetric trimmed mean is a known way of estimating central location, usually in conjunction with the bootstrap. It is here modified and applied to meta-analysis, as a way of dealing with outlying results by down-weighting the…

Applications · Statistics 2019-07-17 Rose Baker

We introduce the Meta Highly-Adaptive-Lasso Minimum Loss Estimator (M-HAL-MLE), a novel ensemble approach for estimating functional parameters of realistically modeled data distribution from independent and identically distributed…

Methodology · Statistics 2025-07-28 Zeyi Wang , Wenxin Zhang , Brian S Caffo , Martin Lindquist , Mark van der Laan

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara

We consider an experiment with at least two stages or batches and $O(N)$ subjects per batch. First, we propose a semiparametric treatment effect estimator that efficiently pools information across the batches, and show it asymptotically…

Methodology · Statistics 2023-09-28 Harrison H. Li , Art B. Owen

In modern statistics, interests shift from pursuing the uniformly minimum variance unbiased estimator to reducing mean squared error (MSE) or residual squared error. Shrinkage based estimation and regression methods offer better prediction…

Methodology · Statistics 2025-02-25 Tianyu Zhan , Haoda Fu , Jian Kang

Several multi-target regression methods were devel-oped in the last years aiming at improving predictive performanceby exploring inter-target correlation within the problem. However, none of these methods outperforms the others for all…

Researchers increasingly use meta-analysis to synthesize the results of several studies in order to estimate a common effect. When the outcome variable is continuous, standard meta-analytic approaches assume that the primary studies report…

Meta-learning aims to learn general knowledge with diverse training tasks conducted from limited data, and then transfer it to new tasks. It is commonly believed that increasing task diversity will enhance the generalization ability of…

Machine Learning · Computer Science 2024-06-04 Jingyao Wang , Wenwen Qiang , Xingzhe Su , Changwen Zheng , Fuchun Sun , Hui Xiong

Measuring dataset similarity is fundamental in machine learning, particularly for transfer learning and domain adaptation. In the context of supervised learning, most existing approaches quantify similarity of two data sets based on their…

Machine Learning · Statistics 2026-04-22 Shudong Sun , Hao Helen Zhang , Joseph C Watkins

The accuracy of machine learning systems is a widely studied research topic. Established techniques such as cross-validation predict the accuracy on unseen data of the classifier produced by applying a given learning method to a given…

Machine Learning · Computer Science 2012-12-06 J. E. Smith , P. Caleb-Solly , M. A. Tahir , D. Sannen , H. van-Brussel

Scientific machine learning reports predictive performance. It does not report whether the same prediction would survive a different draw of training data. Across $9$ chemistry benchmarks, two classifiers trained on independent bootstraps…

Machine Learning · Computer Science 2026-05-14 Gordan Prastalo , Kevin Maik Jablonka

Ensemble models often achieve higher accuracy than single learners, but their ability to maintain small generalization gaps is not always well understood. This study examines how ensembles balance accuracy and overfitting across four…

Machine Learning · Computer Science 2025-12-08 Zubair Ahmed Mohammad

We address the problem of estimating heterogeneous treatment effects in panel data, adopting the popular Difference-in-Differences (DiD) framework under the conditional parallel trends assumption. We propose a novel doubly robust…

Machine Learning · Statistics 2025-04-29 Hui Lan , Haoge Chang , Eleanor Dillon , Vasilis Syrgkanis

One of the central goals of causal machine learning is the accurate estimation of heterogeneous treatment effects from observational data. In recent years, meta-learning has emerged as a flexible, model-agnostic paradigm for estimating…

Artificial Intelligence · Computer Science 2024-11-14 Henri Arno , Paloma Rabaey , Thomas Demeester

Supervised learning is ubiquitous in medical image analysis. In this paper we consider the problem of meta-learning -- predicting which methods will perform well in an unseen classification problem, given previous experience with other…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Veronika Cheplygina , Pim Moeskops , Mitko Veta , Behdad Dasht Bozorg , Josien Pluim

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

Observational cohort studies are increasingly being used for comparative effectiveness research to assess the safety of therapeutics. Recently, various doubly robust methods have been proposed for average treatment effect estimation by…

Methodology · Statistics 2025-03-11 Xiaoqing Tan , Shu Yang , Wenyu Ye , Douglas E. Faries , Ilya Lipkovich , Zbigniew Kadziola

Model-based reinforcement learning is attractive for sequential decision-making because it explicitly estimates reward and transition models and then supports planning through simulated rollouts. In offline settings with hidden confounding,…

Machine Learning · Computer Science 2026-04-08 Nishanth Venkatesh , Andreas A. Malikopoulos

Predicting students' academic performance has been a research area of interest in recent years with many institutions focusing on improving the students' performance and the education quality. The analysis and prediction of students'…

Computers and Society · Computer Science 2020-06-11 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

We revisit the classical causal inference problem of estimating the average treatment effect in the presence of fully observed confounding variables using two-stage semiparametric methods. In existing theoretical studies of methods such as…

Methodology · Statistics 2022-05-23 Steve Yadlowsky