English
Related papers

Related papers: Offline Learning of Closed-Loop Deep Brain Stimula…

200 papers

Deep reinforcement learning (DRL) requires the collection of interventional data, which is sometimes expensive and even unethical in the real world, such as in the autonomous driving and the medical field. Offline reinforcement learning…

Machine Learning · Computer Science 2023-06-12 Wenxuan Zhu , Chao Yu , Qiang Zhang

The commissioning and operation of future large-scale scientific experiments will challenge current tuning and control methods. Reinforcement learning (RL) algorithms are a promising solution thanks to their capability of autonomously…

Objective - This work introduces Dareplane, a modular and broad technology-agnostic open source software platform for brain-computer interface research with an application focus on adaptive deep brain stimulation (aDBS). One difficulty for…

Other Quantitative Biology · Quantitative Biology 2025-02-19 Matthias Dold , Joana Pereira , Bastian Sajonz , Volker A. Coenen , Jordy Thielen , Marcus L. F. Janssen , Michael Tangermann

In recommender systems (RecSys) and real-time bidding (RTB) for online advertisements, we often try to optimize sequential decision making using bandit and reinforcement learning (RL) techniques. In these applications, offline reinforcement…

Machine Learning · Computer Science 2021-09-20 Haruka Kiyohara , Kosuke Kawakami , Yuta Saito

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

The ability to direct a Probabilistic Boolean Network (PBN) to a desired state is important to applications such as targeted therapeutics in cancer biology. Reinforcement Learning (RL) has been proposed as a framework that solves a…

Machine Learning · Computer Science 2022-10-26 Sotiris Moschoyiannis , Evangelos Chatzaroulas , Vytenis Sliogeris , Yuhu Wu

Offline reinforcement learning (RL) aims to learn a policy using only pre-collected and fixed data. Although avoiding the time-consuming online interactions in RL, it poses challenges for out-of-distribution (OOD) state actions and often…

Machine Learning · Computer Science 2023-06-23 Jinxin Liu , Ziqi Zhang , Zhenyu Wei , Zifeng Zhuang , Yachen Kang , Sibo Gai , Donglin Wang

Offline reinforcement learning (RL) aims to learn an optimal policy from pre-collected data. However, it faces challenges of distributional shift, where the learned policy may encounter unseen scenarios not covered in the offline data.…

Machine Learning · Computer Science 2025-05-27 Jin Zhu , Xin Zhou , Jiaang Yao , Gholamali Aminian , Omar Rivasplata , Simon Little , Lexin Li , Chengchun Shi

Improving the multi-step reasoning ability of large language models (LLMs) with offline reinforcement learning (RL) is essential for quickly adapting them to complex tasks. While Direct Preference Optimization (DPO) has shown promise in…

Machine Learning · Computer Science 2024-12-30 Huaijie Wang , Shibo Hao , Hanze Dong , Shenao Zhang , Yilin Bao , Ziran Yang , Yi Wu

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Model-based offline reinforcement learning (RL) aims to find highly rewarding policy, by leveraging a previously collected static dataset and a dynamics model. While the dynamics model learned through reuse of the static dataset, its…

Machine Learning · Computer Science 2022-11-01 Kaiyang Guo , Yunfeng Shao , Yanhui Geng

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

Reinforcement learning (RL) has shown great promise with algorithms learning in environments with large state and action spaces purely from scalar reward signals. A crucial challenge for current deep RL algorithms is that they require a…

Machine Learning · Computer Science 2023-11-23 Shivakanth Sujit , Pedro H. M. Braga , Jorg Bornschein , Samira Ebrahimi Kahou

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Daniel Tabas , Baosen Zhang

Controlling inter-area oscillation (IAO) across wide areas is crucial for the stability of modern power systems. Recent advances in deep learning, combined with the extensive deployment of phasor measurement units (PMUs) and generator…

Systems and Control · Electrical Eng. & Systems 2025-07-04 Siyuan Liang , Long Huo , Wenyu Qin , Xin Chen , Peiyuan Sun

This study considers multiple reconfigurable intelligent surfaces (RISs)-aided multiuser downlink systems with the goal of jointly optimizing the transmitter precoding and RIS phase shift matrix to maximize spectrum efficiency. Unlike prior…

Information Theory · Computer Science 2025-10-01 Po-Heng Chou , Bo-Ren Zheng , Wan-Jen Huang , Walid Saad , Yu Tsao , Ronald Y. Chang

This work studies offline Reinforcement Learning (RL) in a class of non-Markovian environments called Regular Decision Processes (RDPs). In RDPs, the unknown dependency of future observations and rewards from the past interactions can be…

Machine Learning · Computer Science 2024-09-05 Ahana Deb , Roberto Cipollone , Anders Jonsson , Alessandro Ronca , Mohammad Sadegh Talebi

Massive reinforcement learning (RL) data are typically collected to train policies offline without the need for interactions, but the large data volume can cause training inefficiencies. To tackle this issue, we formulate offline behavior…

Machine Learning · Computer Science 2024-10-31 Shiye Lei , Sen Zhang , Dacheng Tao

At the group-level, deep brain stimulation leads to significant therapeutic benefit in a multitude of neurological and neuropsychiatric disorders. At the single-patient level, however, symptoms may sometimes persist despite "optimal"…

Intelligent reflecting surface (IRS) is a promising technology to assist downlink information transmissions from a multi-antenna access point (AP) to a receiver. In this paper, we minimize the AP's transmit power by a joint optimization of…

Signal Processing · Electrical Eng. & Systems 2020-05-26 Jiaye Lin , Yuze Zou , Xiaoru Dong , Shimin Gong , Dinh Thai Hoang , Dusit Niyato
‹ Prev 1 3 4 5 6 7 10 Next ›