English
Related papers

Related papers: Insulin Regimen ML-based control for T2DM patients

200 papers

We propose a dual-hormone delivery strategy by exploiting deep reinforcement learning (RL) for people with Type 1 Diabetes (T1D). Specifically, double dilated recurrent neural networks (RNN) are used to learn the hormone delivery strategy,…

Quantitative Methods · Quantitative Biology 2019-10-10 Taiyu Zhu , Kezhi Li , Pantelis Georgiou

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Objective. Type 2 diabetes mellitus (T2DM) is a highly prevalent non-communicable chronic disease that substantially reduces life expectancy. Accurate estimation of all-cause mortality risk in T2DM patients is crucial for personalizing and…

Maximising a cumulative reward function that is Markov and stationary, i.e., defined over state-action pairs and independent of time, is sufficient to capture many kinds of goals in a Markov decision process (MDP). However, not all goals…

Artificial Intelligence · Computer Science 2023-06-05 Tom Zahavy , Brendan O'Donoghue , Guillaume Desjardins , Satinder Singh

Type 2 diabetes progresses slowly and may be reversed through lifestyle changes, but quantifying the long-term impact of regular physical activity remains challenging due to sparse longitudinal data. Mechanistic models offer a powerful tool…

Quantitative Methods · Quantitative Biology 2026-02-17 Lea Multerer , Pierluigi Francesco De Paola , Marta Lenatti , Alessia Paglialonga , Laura Azzimonti

Because failures in distribution systems caused by extreme weather events directly result in consumers' outages, this paper proposes a state-based decision-making model with the objective of mitigating loss of load to improve the…

Optimization and Control · Mathematics 2019-04-02 Chong Wang , Ping Ju , Shunbo Lei , Zhaoyu Wang , Yunhe Hou

Decision makers, such as doctors and judges, make crucial decisions such as recommending treatments to patients, and granting bails to defendants on a daily basis. Such decisions typically involve weighting the potential benefits of taking…

Artificial Intelligence · Computer Science 2016-10-25 Himabindu Lakkaraju , Cynthia Rudin

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision…

Machine Learning · Computer Science 2020-10-13 Reazul Hasan Russel , Mouhacine Benosman , Jeroen Van Baar

This paper studies the computation of robust deterministic policies for Markov Decision Processes (MDPs) in the Lightning Does Not Strike Twice (LDST) model of Mannor, Mebel and Xu (ICML '12). In this model, designed to provide robustness…

Optimization and Control · Mathematics 2024-12-18 Fei Wu , Erik Demeulemeester , Jannik Matuschke

In reinforcement learning (RL), when defining a Markov Decision Process (MDP), the environment dynamics is implicitly assumed to be stationary. This assumption of stationarity, while simplifying, can be unrealistic in many scenarios. In the…

Machine Learning · Computer Science 2021-10-15 Shagun Sodhani , Franziska Meier , Joelle Pineau , Amy Zhang

Many strategic decision-making problems, such as environment design for warehouse robots, can be naturally formulated as bi-level reinforcement learning (RL), where a leader agent optimizes its objective while a follower solves a Markov…

Machine Learning · Computer Science 2026-04-01 Mikoto Kudo , Takumi Tanabe , Akifumi Wachi , Youhei Akimoto

We investigate model-based reinforcement learning in contextual Markov decision processes (C-MDPs) in which the context is unobserved and induces confounding in the offline dataset. In such settings, conventional model-learning methods are…

Machine Learning · Computer Science 2025-12-09 Nishanth Venkatesh , Andreas A. Malikopoulos

We consider the problem of optimal tracking control of unknown discrete-time nonlinear nonzero-sum games. The related state-of-art literature is mostly focused on Policy Iteration algorithms and multiple neural network approximation, which…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Alexandros Tanzanakis , John Lygeros

We are interested in risk constraints for infinite horizon discrete time Markov decision processes (MDPs). Starting with average reward MDPs, we show that increasing concave stochastic dominance constraints on the empirical distribution of…

Optimization and Control · Mathematics 2012-06-21 William B. Haskell , Rahul Jain

Cell phenotype dynamic homeostasis contrasts with the inherent randomness of intracellular reactions. Although feedback control of master regulatory genes (MRG) is a key strategy for maintaining gene network expression ranges limited,…

Molecular Networks · Quantitative Biology 2025-08-13 Guilherme Giovanini , Cyro von Zuben de Valega Negrão , Ammar Alsinai , Alexandre Ferreira Ramos

Exogenous state variables and rewards can slow down reinforcement learning by injecting uncontrolled variation into the reward signal. We formalize exogenous state variables and rewards and identify conditions under which an MDP with…

Machine Learning · Computer Science 2018-06-06 Thomas G. Dietterich , George Trimponias , Zhitang Chen

Binding and unbinding of ligands to specific sites of a macromolecule are one of the most elementary molecular interactions inside the cell that embody the computational processes of biological regulations. The interaction between…

Molecular Networks · Quantitative Biology 2011-11-10 Hidenori Kimura , Hiroyuki Okano , Reiko J. Tanaka

In this work, we show existence of invariant ergodic measure for switched linear dynamical systems (SLDSs) under a norm-stability assumption of system dynamics in some unbounded subset of $\mathbb{R}^{n}$. Consequently, given a stationary…

Probability · Mathematics 2020-06-16 Muhammad Abdullah Naeem , Miroslav Pajic

With the increasing availability of wearable devices, continuous monitoring of individuals' physiological and behavioral patterns has become significantly more accessible. Access to these continuous patterns about individuals' statuses…

Machine Learning · Computer Science 2019-07-30 Ramin Ramazi , Christine Perndorfer , Emily Soriano , Jean-Philippe Laurenceau , Rahmatollah Beheshti

Markov decision processes (MDPs) with rewards are a widespread and well-studied model for systems that make both probabilistic and nondeterministic choices. A fundamental result about MDPs is that their minimal and maximal expected rewards…

Logic in Computer Science · Computer Science 2024-11-26 Kevin Batz , Benjamin Lucien Kaminski , Christoph Matheja , Tobias Winkler