English
Related papers

Related papers: Model selection with uncertainty in estimating opt…

200 papers

Deep learning models are being adopted and applied on various critical decision-making tasks, yet they are trained to provide point predictions without providing degrees of confidence. The trustworthiness of deep learning models can be…

Machine Learning · Computer Science 2024-10-28 Daniel Nolte , Souparno Ghosh , Ranadip Pal

A model among many may only be best under certain states of the world. Switching from a model to another can also be costly. Finding a procedure to dynamically choose a model in these circumstances requires to solve a complex estimation…

Machine Learning · Computer Science 2023-10-10 Francesco Cordoni , Alessio Sancetta

Reward modeling is essential for aligning Large Language Models(LLMs) with human preferences, yet conventional reward models suffer from poor interpretability and heavy reliance on costly expert annotations. While recent rubric-based…

Artificial Intelligence · Computer Science 2026-03-10 Dengcan Liu , Fengkai Yang , Xiaohan Wang , Shurui Yan , Jiajun Chai , Jiahao Li , Yikun Ban , Zhendong Mao , Wei Lin , Guojun Yin

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

Data-driven methods for personalizing treatment assignment have garnered much attention from clinicians and researchers. Dynamic treatment regimes formalize this through a sequence of decision rules that map individual patient…

Methodology · Statistics 2022-02-22 Eric J. Rose , Erica E. M. Moodie , Susan Shortreed

When selecting from a list of potential candidates, it is important to ensure not only that the selected items are of high quality, but also that they are sufficiently dissimilar so as to both avoid redundancy and to capture a broader range…

Methodology · Statistics 2026-02-25 Yash Nair , Ying Jin , James Yang , Emmanuel Candes

Large health care data repositories such as electronic health records (EHR) open new opportunities to derive individualized treatment strategies for complicated diseases such as sepsis. In this paper, we consider the problem of estimating…

Statistics Theory · Mathematics 2023-10-03 Nilanjana Laha , Aaron Sonabend-W , Rajarshi Mukherjee , Tianxi Cai

This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and cons to deciding…

Machine Learning · Computer Science 2022-06-22 Jean-Sébastien Dessureault , Daniel Massicotte

Counterfactual inference for continuous rather than binary treatment variables is more common in real-world causal inference tasks. While there are already some sample reweighting methods based on Marginal Structural Model for eliminating…

Machine Learning · Computer Science 2024-07-15 Yonghe Zhao , Qiang Huang , Haolong Zeng , Yun Pen , Huiyan Sun

Diabetic retinopathy (DR) is a major cause of visual impairment, and effective treatment options depend heavily on timely and accurate diagnosis. Deep learning models have demonstrated great success identifying DR from retinal images.…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Madhushan Ramalingam , Yaish Riaz , Priyanthi Rajamanoharan , Piyumi Dasanayaka

Medication recommendation is one of the most critical health-related applications, which has attracted extensive research interest recently. Most existing works focus on a single hospital with abundant medical data. However, many small…

Information Retrieval · Computer Science 2024-12-31 Qidong Liu , Zhaopeng Qiu , Xiangyu Zhao , Xian Wu , Zijian Zhang , Tong Xu , Feng Tian

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman

Given an (optimal) dynamic treatment rule, it may be of interest to evaluate that rule -- that is, to ask the causal question: what is the expected outcome had every subject received treatment according to that rule? In this paper, we study…

Methodology · Statistics 2021-10-27 Lina Montoya , Jennifer Skeem , Mark van der Laan , Maya Petersen

A data augmentation module is utilized in contrastive learning to transform the given data example into two views, which is considered essential and irreplaceable. However, the predetermined composition of multiple data augmentations brings…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Junbo Zhang , Kaisheng Ma

Imbalances in covariates between treatment groups are frequent in observational studies and can lead to biased comparisons. Various adjustment methods can be employed to correct these biases in the context of multi-level treatments ($>$ 2).…

Applications · Statistics 2021-06-04 Diop S. Arona , Duchesne Thierry , Cumming Steven , Diop Awa , Talbot Denis

Precision medicine aims to tailor therapeutic decisions to individual patient characteristics. This objective is commonly formalized through dynamic treatment regimes, which use statistical and machine learning methods to derive sequential…

Machine Learning · Statistics 2026-03-23 Sophia Yazzourh , Erica E. M. Moodie

In clinical trials, the response of a given subject often depends on the selected treatment as well as on some covariates. We study optimal approximate designs of experiments in the models with treatment and covariate effects. We allow for…

Statistics Theory · Mathematics 2019-07-10 Samuel Rosa

Contrastive representation learning (CRL) underpins many modern foundation models. Despite recent theoretical progress, existing analyses suffer from several key limitations: (i) the statistical consistency of CRL remains poorly understood;…

Machine Learning · Computer Science 2026-05-29 Yuanfan Li , Xiyuan Wei , Tianbao Yang , Yiming Ying

The covariate shift is a challenging problem in supervised learning that results from the discrepancy between the training and test distributions. An effective approach which recently drew a considerable attention in the research community…

Machine Learning · Computer Science 2013-11-27 Yun-Qian Miao , Ahmed K. Farahat , Mohamed S. Kamel

Dynamic feature selection (DFS) addresses budget constraints in decision-making by sequentially acquiring features for each instance, making it appealing for resource-limited scenarios. However, existing DFS methods require models…

Machine Learning · Computer Science 2026-02-19 Javier Fumanal-Idocin , Raquel Fernandez-Peralta , Javier Andreu-Perez