English
Related papers

Related papers: Identifying Decision Points for Safe and Interpret…

200 papers

In observational causal inference, domain knowledge often leaves multiple covariate adjustments plausible, yet which sets satisfy ignorability is untestable. Different adjustment sets can yield conflicting estimates of the average treatment…

Methodology · Statistics 2026-03-23 Aditya Ghosh , Dominik Rothenhäusler

Distributional reinforcement learning (RL) is a powerful framework increasingly adopted in safety-critical domains for its ability to optimize risk-sensitive objectives. However, the role of the discount factor is often overlooked, as it is…

Machine Learning · Computer Science 2026-02-05 Mehrdad Moghimi , Anthony Coache , Hyejin Ku

Learning to solve long horizon temporally extended tasks with reinforcement learning has been a challenge for several years now. We believe that it is important to leverage both the hierarchical structure of complex tasks and to use expert…

Machine Learning · Computer Science 2022-10-18 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Machine learning for early prediction in medicine has recently shown breakthrough performance, however, the focus on improving prediction accuracy has led to a neglect of faithful explanations that are required to gain the trust of medical…

Computation and Language · Computer Science 2025-12-04 Michael Staniek , Artem Sokolov , Stefan Riezler

Predicting the effect of interventions with many possible variations, e.g., therapeutic content that affects mental health outcomes or an earnings call transcript that drives movement in share price, is useful across several domains.…

Machine Learning · Computer Science 2026-05-27 Nikita Dhawan , Arnav Paruthi , Andrew Kim , Lovedeep Gondara , Jekaterina Novikova , Chris J. Maddison

Sepsis remains one of the most complex and heterogeneous syndromes in intensive care, characterized by diverse physiological trajectories and variable responses to treatment. While deep learning models perform well in the early prediction…

Machine Learning · Computer Science 2026-04-01 Vincent Lemaire , Nédra Meloulli , Pierre Jaquet

This paper studies reinforcement learning (RL) in doubly inhomogeneous environments under temporal non-stationarity and subject heterogeneity. In a number of applications, it is commonplace to encounter datasets generated by system dynamics…

Machine Learning · Statistics 2025-03-18 Liyuan Hu , Mengbing Li , Chengchun Shi , Zhenke Wu , Piotr Fryzlewicz

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

Machine Learning · Computer Science 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. Several approaches have been recently considered to encode attributes in the latent space to enhance its…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Maxime Di Folco , Cosmin I. Bercea , Emily Chan , Julia A. Schnabel

Within batch reinforcement learning, safe policy improvement (SPI) seeks to ensure that the learnt policy performs at least as well as the behavior policy that generated the dataset. The core challenge in SPI is seeking improvements while…

Machine Learning · Computer Science 2024-10-15 Abhishek Sharma , Leo Benac , Sonali Parbhoo , Finale Doshi-Velez

This paper is a contribution towards interpretability of the deep learning models in different applications of time-series. We propose a temporal attention layer that is capable of selecting the relevant information to perform various…

Computer Vision and Pattern Recognition · Computer Science 2018-06-25 Phongtharin Vinayavekhin , Subhajit Chaudhury , Asim Munawar , Don Joven Agravante , Giovanni De Magistris , Daiki Kimura , Ryuki Tachibana

Ordinal user-provided ratings across multiple items are frequently encountered in both scientific and commercial applications. Whilst recommender systems are known to do well on these type of data from a predictive point of view, their…

Methodology · Statistics 2025-03-05 Sjoerd Hermes

Deep reinforcement learning (RL) has shown remarkable success in complex domains, however, the inherent black box nature of deep neural network policies raises significant challenges in understanding and trusting the decision-making…

Machine Learning · Computer Science 2025-01-20 Peilang Li , Umer Siddique , Yongcan Cao

Deep reinforcement learning (RL) has recently led to many breakthroughs on a range of complex control tasks. However, the agent's decision-making process is generally not transparent. The lack of interpretability hinders the applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Wenjie Shi , Gao Huang , Shiji Song , Zhuoyuan Wang , Tingyu Lin , Cheng Wu

Medical automatic diagnosis aims to imitate human doctors in real-world diagnostic processes and to achieve accurate diagnoses by interacting with the patients. The task is formulated as a sequential decision-making problem with a series of…

Machine Learning · Computer Science 2022-06-07 Hongyi Yuan , Sheng Yu

Individualized treatment rules aim to identify if, when, which, and to whom treatment should be applied. A globally aging population, rising healthcare costs, and increased access to patient-level data have created an urgent need for…

Methodology · Statistics 2019-01-04 Ying-Qi Zhao , Eric B. Laber , Yang Ning , Sumona Saha , Bruce Sands

We introduce a Reinforcement Learning Psychotherapy AI Companion that generates topic recommendations for therapists based on patient responses. The system uses Deep Reinforcement Learning (DRL) to generate multi-objective policies for four…

Machine Learning · Computer Science 2023-03-20 Baihan Lin , Guillermo Cecchi , Djallel Bouneffouf

An individualized treatment rule (ITR) is a decision rule that aims to improve individual patients health outcomes by recommending optimal treatments according to patients specific information. In observational studies, collected data may…

Methodology · Statistics 2023-10-03 Zeyu Bian , Erica EM Moodie , Susan M Shortreed , Sylvie D Lambert , Sahir Bhatnagar

In this work, we consider causal inference in various high-dimensional treatment settings, including for single multi-valued treatments and vector treatments with binary or continuous components, when the number of treatments can be…

Statistics Theory · Mathematics 2026-02-26 Patrick Kramer , Edward H. Kennedy , Isaac M. Opper

Inverse reinforcement learning (IRL) for linear systems seeks a cost function whose optimal controller reproduces an expert policy from data. Existing data-driven methods for discrete-time linear systems are largely built on iterative…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Duc Cuong Nguyen , Phuong Nam Dao