中文
相关论文

相关论文: Offline Learning of Closed-Loop Deep Brain Stimula…

200 篇论文

Offline reinforcement learning algorithms hold the promise of enabling data-driven RL methods that do not require costly or dangerous real-world exploration and benefit from large pre-collected datasets. This in turn can facilitate…

Mental disorders (MD) are among the top most demanding challenges in world-wide health. According to the World Health Organization, the burden of MDs continues to grow with significant impact on health and major social and human rights. A…

神经元与认知 · 定量生物学 2023-03-21 Thomas Wahl , Joséphine Riedinger , Michel Duprez , Axel Hutt

This work proposes a unified control architecture that couples a Reinforcement Learning (RL)-driven controller with a disturbance-rejection Extended State Observer (ESO), complemented by an Event-Triggered Mechanism (ETM) to limit…

最优化与控制 · 数学 2026-01-01 Ningwei Bai , Chi Pui Chan , Qichen Yin , Tengyang Gong , Yunda Yan , Zezhi Tang

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

机器学习 · 计算机科学 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

Offline Reinforcement Learning (RL) algorithms learn a policy using a fixed training dataset, which is then deployed online to interact with the environment and make decisions. Transformers, a standard choice for modeling time-series data,…

人工智能 · 计算机科学 2025-02-18 Dan Elbaz , Oren Salzman

Dynamic diagnosis is desirable when medical tests are costly or time-consuming. In this work, we use reinforcement learning (RL) to find a dynamic policy that selects lab test panels sequentially based on previous observations, ensuring…

机器学习 · 计算机科学 2023-03-01 Zheng Yu , Yikuan Li , Joseph Kim , Kaixuan Huang , Yuan Luo , Mengdi Wang

We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be…

机器学习 · 计算机科学 2022-09-20 Zuyue Fu , Zhengling Qi , Zhaoran Wang , Zhuoran Yang , Yanxun Xu , Michael R. Kosorok

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

机器学习 · 计算机科学 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Essential Tremor is the most common neurological movement disorder. This progressive disease causes uncontrollable rhythmic motions -most often affecting the patient's dominant upper extremity- that occur during volitional movement and make…

神经元与认知 · 定量生物学 2017-06-02 Jeffrey A. Herron , Margaret C. Thompson , Timothy Brown , Howard J. Chizeck , Jeffrey G. Ojemann , Andrew L. Ko

This paper proposes a deep reinforcement learning (DRL)-based event-triggered controller design for networked artificial pancreas (AP) systems. Although existing DRL-based AP controllers typically assume periodic control updates, networked…

系统与控制 · 电气工程与系统科学 2026-05-18 Junya Ikemoto , Satoshi Maruyama , Kazumune Hashimoto

Under voltage load shedding has been considered as a standard and effective measure to recover the voltage stability of the electric power grid under emergency and severe conditions. However, this scheme usually trips a massive amount of…

系统与控制 · 电气工程与系统科学 2021-10-01 Thanh Long Vu , Sayak Mukherjee , Renke Huang , Qiuhua Hung

This paper proposes a deep learning-based optimal battery management scheme for frequency regulation (FR) by integrating model predictive control (MPC), supervised learning (SL), reinforcement learning (RL), and high-fidelity battery…

系统与控制 · 电气工程与系统科学 2022-01-05 Yun Li , Yixiu Wang , Yifu Chen , Kaixun Hua , Jiayang Ren , Ghazaleh Mozafari , Qiugang Lu , Yankai Cao

Bipedal locomotion skills are challenging to develop. Control strategies often use local linearization of the dynamics in conjunction with reduced-order abstractions to yield tractable solutions. In these model-based control strategies, the…

机器人学 · 计算机科学 2018-07-30 Zhaoming Xie , Glen Berseth , Patrick Clary , Jonathan Hurst , Michiel van de Panne

Deep Brain Stimulation (DBS) is an established and powerful treatment method in various neurological disorders. It involves chronically delivering electrical pulses to a certain stimulation target in the brain in order to alleviate the…

系统与控制 · 电气工程与系统科学 2023-10-03 Anna Franziska Frigge , Alexander Medvedev , Elena Jiltsova , Dag Nyholm

People with type 1 diabetes (T1D) lack the ability to produce the insulin their bodies need. As a result, they must continually make decisions about how much insulin to self-administer to adequately control their blood glucose levels.…

机器学习 · 计算机科学 2020-09-22 Ian Fox , Joyce Lee , Rodica Pop-Busui , Jenna Wiens

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

机器学习 · 计算机科学 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

A deep reinforcement learning (DRL) agent observes its states through observations, which may contain natural measurement errors or adversarial noises. Since the observations deviate from the true states, they can mislead the agent into…

机器学习 · 计算机科学 2021-07-15 Huan Zhang , Hongge Chen , Chaowei Xiao , Bo Li , Mingyan Liu , Duane Boning , Cho-Jui Hsieh

Offline reinforcement learning (RL) aims to find an optimal policy for Markov decision processes (MDPs) using a pre-collected dataset. In this work, we revisit the linear programming (LP) reformulation of Markov decision processes for…

机器学习 · 计算机科学 2024-12-11 Asuman Ozdaglar , Sarath Pattathil , Jiawei Zhang , Kaiqing Zhang

Offline Reinforcement Learning (RL) aims to learn policies from previously collected datasets without exploring the environment. Directly applying off-policy algorithms to offline RL usually fails due to the extrapolation error caused by…

机器学习 · 计算机科学 2022-02-24 Chenjia Bai , Lingxiao Wang , Zhuoran Yang , Zhihong Deng , Animesh Garg , Peng Liu , Zhaoran Wang

This paper addresses distributional offline continuous-time reinforcement learning (DOCTR-L) with stochastic policies for high-dimensional optimal control. A soft distributional version of the classical Hamilton-Jacobi-Bellman (HJB)…

机器学习 · 计算机科学 2021-04-05 Igor Halperin