中文
相关论文

相关论文: Offline Learning of Closed-Loop Deep Brain Stimula…

200 篇论文

The integration of distributed energy resources (DER) has escalated the challenge of voltage magnitude regulation in distribution networks. Traditional model-based approaches, which rely on complex sequential mathematical formulations,…

系统与控制 · 电气工程与系统科学 2024-11-05 Shengren Hou , Peter Palensky , Pedro P. Vergara

Offline reinforcement learning (RL) is a challenging setting where existing off-policy actor-critic methods perform poorly due to the overestimation of out-of-distribution state-action pairs. Thus, various additional augmentations are…

机器学习 · 计算机科学 2023-02-23 Zifeng Zhuang , Kun Lei , Jinxin Liu , Donglin Wang , Yilang Guo

Parkinson's disease (PD) is a progressive degenerative disorder of the central nervous system characterized by motor and non-motor symptoms. As the disease progresses, patients alternate periods in which motor symptoms are mitigated due to…

音频与语音处理 · 电气工程与系统科学 2020-08-26 Anna Pompili , Rubén Solera-Ureña , Alberto Abad , Rita Cardoso , Isabel Guimarães , Margherita Fabbri , Isabel P. Martins , Joaquim Ferreira

Models of the cortico-basal ganglia network and volume conductor models of the brain can provide insight into the mechanisms of action of deep brain stimulation (DBS). In this study, the coupling of a network model, under parkinsonian…

神经元与认知 · 定量生物学 2017-05-31 Christian Schmidt , Eleanor Dunn , Madeleine Lowery , Ursula van Rienen

Offline reinforcement learning (RL) has received increasing attention for learning policies from previously collected data without interaction with the real environment, which is particularly important in high-stakes applications. While a…

机器学习 · 计算机科学 2026-04-03 Qing Zhu , Xian Yu

Single-domain offline reinforcement learning (RL) often suffers from limited data coverage, while cross-domain offline RL handles this issue by leveraging additional data from other domains with dynamics shifts. However, existing studies…

机器学习 · 计算机科学 2026-03-10 Zhongjian Qiao , Rui Yang , Jiafei Lyu , Xiu Li , Zhongxiang Dai , Zhuoran Yang , Siyang Gao , Shuang Qiu

Deep Brain Stimulation (DBS) is a well-established neurosurgical treatment aiming at symptom alleviation in a range of neurological and psychiatric diseases. Computational models of DBS are widely used to investigate the effects of…

系统与控制 · 电气工程与系统科学 2025-11-17 Anna Franziska Frigge , Alexander Medvedev

Perceived outcomes from DBS for PD were sampled for 52 cases by surveying 46 DBS recipients and 45 carers. Post-DBS experience ranged from 10-129 months. There were significant variations in perceived outcomes over time. In some cases…

神经元与认知 · 定量生物学 2015-08-11 N. W. Page , C. Hall , S. D. Page

Background: Clinical diagnosis is typically reached by following a series of steps recommended by guidelines authored by colleges of experts. Accordingly, guidelines play a crucial role in rationalizing clinical decisions but suffer from…

机器学习 · 计算机科学 2024-04-10 Lillian Muyama , Antoine Neuraz , Adrien Coulet

Malfunctioning neurons in the brain sometimes operate synchronously, reportedly causing many neurological diseases, e.g. Parkinson's. Suppression and control of this collective synchronous activity are therefore of great importance for…

神经元与认知 · 定量生物学 2021-09-22 Dmitrii Krylov , Remi Tachet , Romain Laroche , Michael Rosenblum , Dmitry V. Dylov

With the widespread adoption of deep learning, reinforcement learning (RL) has experienced a dramatic increase in popularity, scaling to previously intractable problems, such as playing complex games from pixel observations, sustaining…

机器学习 · 计算机科学 2023-04-20 Rafael Figueiredo Prudencio , Marcos R. O. A. Maximo , Esther Luna Colombini

Offline methods for reinforcement learning have a potential to help bridge the gap between reinforcement learning research and real-world applications. They make it possible to learn policies from offline datasets, thus overcoming concerns…

Traditional offline reinforcement learning (RL) methods predominantly operate in a batch-constrained setting. This confines the algorithms to a specific state-action distribution present in the dataset, reducing the effects of…

机器学习 · 统计学 2025-07-16 Charles A. Hepburn , Yue Jin , Giovanni Montana

A promising paradigm for offline reinforcement learning (RL) is to constrain the learned policy to stay close to the dataset behaviors, known as policy constraint offline RL. However, existing works heavily rely on the purity of the data,…

机器学习 · 计算机科学 2022-10-20 Chengqian Gao , Ke Xu , Liu Liu , Deheng Ye , Peilin Zhao , Zhiqiang Xu

The paradigm shift in the electric power grid necessitates a revisit of existing control methods to ensure the grid's security and resilience. In particular, the increased uncertainties and rapidly changing operational conditions in power…

系统与控制 · 电气工程与系统科学 2020-11-20 Thanh Long Vu , Sayak Mukherjee , Tim Yin , Renke Huang , and Jie Tan , Qiuhua Huang

Reinforcement Learning (RL) offers a powerful framework for optimizing dynamic treatment regimes (DTRs). However, clinical RL is fundamentally bottlenecked by reward engineering: the challenge of defining signals that safely and effectively…

机器学习 · 计算机科学 2026-02-05 Qianyi Xu , Gousia Habib , Feng Wu , Yanrui Du , Zhihui Chen , Swapnil Mishra , Dilruk Perera , Mengling Feng

Offline preference-based reinforcement learning (PbRL) typically operates in two phases: first, use human preferences to learn a reward model and annotate rewards for a reward-free offline dataset; second, learn a policy by optimizing the…

人工智能 · 计算机科学 2024-12-24 Songjun Tu , Jingbo Sun , Qichao Zhang , Yaocheng Zhang , Jia Liu , Ke Chen , Dongbin Zhao

Offline reinforcement learning (RL) extends the paradigm of classical RL algorithms to purely learning from static datasets, without interacting with the underlying environment during the learning process. A key challenge of offline RL is…

机器学习 · 计算机科学 2022-06-16 Shentao Yang , Yihao Feng , Shujian Zhang , Mingyuan Zhou

Deep Brain Stimulation (DBS) is a therapy widely used for treating the symptoms of neurological disorders. Electrical pulses are chronically delivered in DBS to a disease-specific brain target via a surgically implanted electrode. The…

系统与控制 · 电气工程与系统科学 2024-10-24 Anna Franziska Frigge , Elena Jiltsova , Fredrik Olsson , Dag Nyholm , Alexander Medvedev

This study focuses on the topic of offline preference-based reinforcement learning (PbRL), a variant of conventional reinforcement learning that dispenses with the need for online interaction or specification of reward functions. Instead,…

机器学习 · 计算机科学 2023-06-12 Yachen Kang , Diyuan Shi , Jinxin Liu , Li He , Donglin Wang