English
Related papers

Related papers: Ambiguous Dynamic Treatment Regimes: A Reinforceme…

200 papers

Objective: Anemia is a frequent comorbidity in hemodialysis patients that can be successfully treated by administering erythropoiesis-stimulating agents (ESAs). ESAs dosing is currently based on clinical protocols that often do not account…

New biological assays like Perturb-seq link highly parallel CRISPR interventions to a high-dimensional transcriptomic readout, providing insight into gene regulatory networks. Causal gene regulatory networks can be represented by directed…

Machine Learning · Statistics 2024-02-22 Albert Xue , Jingyou Rao , Sriram Sankararaman , Harold Pimentel

Off-policy learning ability is an important feature of reinforcement learning (RL) for practical applications. However, even one of the most elementary RL algorithms, temporal-difference (TD) learning, is known to suffer form divergence…

Machine Learning · Computer Science 2025-04-21 Han-Dong Lim , Donghwan Lee

Body Dysmorphic Disorder (BDD) is a highly prevalent and frequently underdiagnosed condition characterized by persistent, intrusive preoccupations with perceived defects in physical appearance. In this extended analysis, we employ multiple…

Machine Learning · Computer Science 2025-03-17 Omar Costilla-Reyes , Morgan Talbot

In this work, we present our various contributions to the objective of building a decision support tool for the diagnosis of rare diseases. Our goal is to achieve a state of knowledge where the uncertainty about the patient's disease is…

This paper proposes a novel approach to construct data-driven online solutions to optimization problems (P) subject to a class of distributionally uncertain dynamical systems. The introduced framework allows for the simultaneous learning of…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Dan Li , Dariush Fooladivanda , Sonia Martinez

In applications of offline reinforcement learning to observational data, such as in healthcare or education, a general concern is that observed actions might be affected by unobserved factors, inducing confounding and biasing estimates…

Machine Learning · Computer Science 2023-03-24 Andrew Bennett , Nathan Kallus

The significant portion of diabetic patients was affected due to major blindness caused by Diabetic retinopathy (DR). For diabetic retinopathy, lesion segmentation, and detection the comprehensive examination is delved into the deep…

Artificial Intelligence · Computer Science 2024-11-20 Syed Mohd Faisal Malik , Md Tabrez Nafis , Mohd Abdul Ahad , Safdar Tanweer

Wasserstein distributionally robust control (DRC) recently emerges as a principled paradigm for handling uncertainty in stochastic dynamical systems. However, it constructs data-driven ambiguity sets via uniform distribution shifts before…

Optimization and Control · Mathematics 2025-10-14 Jingyi Wu , Chao Ning , Yang Shi

Randomized clinical trials are considered the gold standard for estimating causal effects. Nevertheless, in studies that are aimed at examining adverse effects of interventions, such trials are often impractical because of ethical and…

Methodology · Statistics 2020-01-20 Anthony D. Scotina , Andrew R. Zullo , Robert J. Smith , Roee Gutman

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

Software Engineering · Computer Science 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

Test-time reinforcement learning (TTRL) always adapts models at inference time via pseudo-labeling, leaving it vulnerable to spurious optimization signals from label noise. Through an empirical study, we observe that responses with medium…

Machine Learning · Computer Science 2026-04-24 Yongcan Yu , Lingxiao He , Jian Liang , Kuangpu Guo , Meng Wang , Qianlong Xie , Xingxing Wang , Ran He

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Adaptation and Self-Organizing Systems · Physics 2022-04-15 Wolfram Barfuss , Richard P. Mann

Medical automatic diagnosis aims to imitate human doctors in real-world diagnostic processes and to achieve accurate diagnoses by interacting with the patients. The task is formulated as a sequential decision-making problem with a series of…

Machine Learning · Computer Science 2022-06-07 Hongyi Yuan , Sheng Yu

State of the art methods for target tracking with sensor management (or controlled sensing) are model-based and are obtained through solutions to Partially Observable Markov Decision Process (POMDP) formulations. In this paper a…

Signal Processing · Electrical Eng. & Systems 2024-07-22 Adarsh M. Subramaniam , Argyrios Gerogiannis , James Z. Hare , Venugopal V. Veeravalli

Inferring causal effects of continuous-valued treatments from observational data is a crucial task promising to better inform policy- and decision-makers. A critical assumption needed to identify these effects is that all confounding…

Clinical diagnosis guidelines aim at specifying the steps that may lead to a diagnosis. Inspired by guidelines, we aim to learn the optimal sequence of actions to perform in order to obtain a correct diagnosis from electronic health…

Machine Learning · Computer Science 2023-11-16 Lillian Muyama , Antoine Neuraz , Adrien Coulet

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-09-10 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Many real-world decisions are made under uncertainty by solving optimization problems using predicted quantities. This predict-then-optimize paradigm has motivated decision-focused learning, which trains models with awareness of how the…

Machine Learning · Computer Science 2025-11-10 Paula Rodriguez-Diaz , Kirk Bansak Elisabeth Paulson

Meta-reinforcement learning (meta-RL) aims to learn from multiple training tasks the ability to adapt efficiently to unseen test tasks. Despite the success, existing meta-RL algorithms are known to be sensitive to the task distribution…

Machine Learning · Computer Science 2021-03-02 Zichuan Lin , Garrett Thomas , Guangwen Yang , Tengyu Ma