English
Related papers

Related papers: Predicting data value before collection: A coeffic…

200 papers

A central goal of machine learning is to learn robust representations that capture the causal relationship between inputs features and output labels. However, minimizing empirical risk over finite or biased datasets often results in models…

Machine Learning · Computer Science 2021-06-15 Chunting Zhou , Xuezhe Ma , Paul Michel , Graham Neubig

This work presents novel extensions for combining two frameworks for quantifying both aleatoric (i.e., irreducible) and epistemic (i.e., reducible) sources of uncertainties in the modeling of engineered systems. The data-consistent (DC)…

Machine Learning · Statistics 2024-03-07 Taylor Roper , Harri Hakula , Troy Butler

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

In strategic classification, an institution (e.g., a bank) anticipates adaptation from users who change their features to increase utility in a classification task (e.g., loan repayment). Since a key challenge is the distribution shift…

Machine Learning · Computer Science 2026-05-27 Antonio Gois , Sophia Gunluk , Nir Rosenfeld , Nidhi Hegde , Simon Lacoste-Julien , Dhanya Sridhar

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

Methodology · Statistics 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

Defect prediction models---classifiers that identify defect-prone software modules---have configurable parameters that control their characteristics (e.g., the number of trees in a random forest). Recent studies show that these classifiers…

Software Engineering · Computer Science 2018-02-01 Chakkrit Tantithamthavorn , Shane McIntosh , Ahmed E. Hassan , Kenichi Matsumoto

How should researchers select experimental sites when the deployment population differs from observed data? I formulate the problem of experimental site selection as an optimal transport problem, developing methods to minimize downstream…

Methodology · Statistics 2025-11-07 Adam Bouyamourn

Efficiently managing and utilizing large-scale medical imaging datasets with limited resources presents significant challenges. While coreset selection helps reduce computational costs, its effectiveness in medical data remains limited due…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yan Liang , Ziyuan Yang , Zhuxin Lei , Mengyu Sun , Yingyu Chen , Yi Zhang

Systematic quantification of data quality is critical for consistent model performance. Prior works have focused on out-of-distribution data. Instead, we tackle an understudied yet equally important problem of characterizing incongruous…

Machine Learning · Computer Science 2022-06-14 Nabeel Seedat , Jonathan Crabbé , Mihaela van der Schaar

A common practice in evidence-based decision-making uses estimates of conditional probabilities P(y|x) obtained from research studies to predict outcomes y on the basis of observed covariates x. Given this information, decisions are then…

Econometrics · Economics 2025-12-08 Atheendar S. Venkataramani , Charles F. Manski , John Mullahy

Transfer learning of prediction models has been extensively studied, while the corresponding policy learning approaches are rarely discussed. In this paper, we propose principled approaches for learning the optimal policy in the target…

Machine Learning · Computer Science 2025-05-20 Xueqing Liu , Qinwei Yang , Zhaoqing Tian , Ruocheng Guo , Peng Wu

There is growing interest in exploring causal effects in target populations via data combination. However, most approaches are tailored to specific settings and lack comprehensive comparative analyses. In this article, we focus on a typical…

Methodology · Statistics 2024-09-17 Peng Wu , Shanshan Luo , Zhi Geng

To increase statistical efficiency in a randomized experiment, researchers often use stratification (i.e., blocking) in the design stage. However, conventional practices of stratification fail to exploit valuable information about the…

Methodology · Statistics 2025-10-28 Zikai Li

We study a setting where the goal is to learn a target function f(x) with respect to a target distribution D(x), but training is done on i.i.d. samples from a different training distribution D'(x), labeled by the true target f(x). Such a…

Machine Learning · Computer Science 2026-02-13 Marko Medvedev , Idan Attias , Elisabetta Cornacchia , Theodor Misiakiewicz , Gal Vardi , Nathan Srebro

The generalization ability of machine learning models degrades significantly when the test distribution shifts away from the training distribution. We investigate the problem of training models that are robust to shifts caused by changes in…

Machine Learning · Computer Science 2023-09-19 Jiaheng Wei , Harikrishna Narasimhan , Ehsan Amid , Wen-Sheng Chu , Yang Liu , Abhishek Kumar

This paper introduces an approach to reference class selection in distributional forecasting with an application to corporate sales growth rates using several co-variates as reference variables, that are implicit predictors. The method can…

Statistical Finance · Quantitative Finance 2024-05-07 Etienne Theising

The Area Under the ROC Curve (AUC) is a widely employed metric in long-tailed classification scenarios. Nevertheless, most existing methods primarily assume that training and testing examples are drawn i.i.d. from the same distribution,…

Machine Learning · Computer Science 2023-11-07 Siran Dai , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Ridge regression with random coefficients provides an important alternative to fixed coefficients regression in high dimensional setting when the effects are expected to be small but not zeros. This paper considers estimation and prediction…

Machine Learning · Statistics 2023-06-29 Hongzhe Zhang , Hongzhe Li

Integrating the outputs of multiple classifiers via combiners or meta-learners has led to substantial improvements in several difficult pattern recognition problems. In the typical setting investigated till now, each classifier is trained…

Machine Learning · Computer Science 2007-05-23 Kagan Tumer , Joydeep Ghosh

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

Machine Learning · Computer Science 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson