English
Related papers

Related papers: Offline Learning of Closed-Loop Deep Brain Stimula…

200 papers

Conventional deep brain stimulation (DBS) of basal ganglia uses high-frequency regular electrical pulses to treat Parkinsonian motor symptoms and has a series of limitations. Relatively new and not yet clinically tested optogenetic…

Neurons and Cognition · Quantitative Biology 2021-04-26 Shivakeshavan Ratnadurai-Giridharan , Chung Cheung , Leonid Rubchinsky

Deep brain stimulation (DBS) is a neurosurgical procedure successfully used to treat conditions such as Parkinson's disease. Electrostimulation, carried out by implanting electrodes into an identified focus in the brain, makes it possible…

Signal Processing · Electrical Eng. & Systems 2023-08-23 Arkadiusz Nowacki , Ewelina Kołpa , Mateusz Szychiewicz , Konrad Ciecierski

Energy efficiency has become an integral aspect of modern computing infrastructure design, impacting the performance, cost, scalability, and durability of production systems. The incorporation of power actuation and sensing capabilities in…

Machine Learning · Computer Science 2026-01-19 Akhilesh Raj , Swann Perarnau , Aniruddha Gokhale , Solomon Bekele Abera

Deep brain stimulation (DBS) is a surgical treatment for Parkinson's Disease. Static models based on quasi-static approximation are common approaches for DBS modeling. While this simplification has been validated for bioelectric sources,…

Neurons and Cognition · Quantitative Biology 2016-08-18 Pablo A. Alvarado , Mauricio A. Álvarez , Álvaro A. Orozco

A large scale computational model of the basal ganglia (BG) network is proposed to describes movement disorder including deep brain stimulation (DBS). The model of this complex network considers four areas of the basal ganglia network: the…

Neurons and Cognition · Quantitative Biology 2021-03-15 Konstantinos Spiliotis , Jens Starke , Denise Franz , Angelika Richter , Rüdiger Köhling

Deep brain stimulation(DBS)has become an effective intervention for advanced Parkinson's disease, but the exact mechanism of DBS is still unclear. In this review, we discuss the history of DBS, the anatomy and internal architecture of the…

Neurons and Cognition · Quantitative Biology 2023-03-24 Yongtong Wu , Kejia Hu , Shenquan Liu

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Machine Learning · Computer Science 2022-11-15 Shengpu Tang , Felipe Vieira Frujeri , Dipendra Misra , Alex Lamb , John Langford , Paul Mineiro , Sebastian Kochman

Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we…

Systems and Control · Electrical Eng. & Systems 2022-01-14 Nathan P. Lawrence , Michael G. Forbes , Philip D. Loewen , Daniel G. McClement , Johan U. Backstrom , R. Bhushan Gopaluni

Training deep neural networks (DNNs) using traditional backpropagation (BP) presents challenges in terms of computational complexity and energy consumption, particularly for on-device learning where computational resources are limited.…

Neural and Evolutionary Computing · Computer Science 2025-07-08 Marco Paul E. Apolinario , Arani Roy , Kaushik Roy

Offline reinforcement learning (RL) algorithms are applied to learn performant, well-generalizing policies when provided with a static dataset of interactions. Many recent approaches to offline RL have seen substantial success, but with one…

Machine Learning · Computer Science 2024-07-30 Padmanaba Srinivasan , William Knottenbelt

We study the sequential decision-making problem for automated weaning of mechanical circulatory support (MCS) devices in cardiogenic shock patients. MCS devices are percutaneous micro-axial flow pumps that provide left ventricular unloading…

Machine Learning · Computer Science 2025-11-11 Aysin Tumay , Sophia Sun , Sonia Fereidooni , Aaron Dumas , Elise Jortberg , Rose Yu

Many state-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to…

Machine Learning · Computer Science 2025-07-30 Ruturaj Sambhus , Aydin Gokce , Stephen Welch , Connor W. Herron , Alexander Leonessa

Offline reinforcement learning (offline RL) offers a promising framework for developing control strategies in chemical process systems using historical data, without the risks or costs of online experimentation. This work investigates the…

Systems and Control · Electrical Eng. & Systems 2025-07-31 Alex Durkin , Jasper Stolte , Matthew Jones , Raghuraman Pitchumani , Bei Li , Christian Michler , Mehmet Mercangöz

We study off-dynamics Reinforcement Learning (RL), where the policy is trained on a source domain and deployed to a distinct target domain. We aim to solve this problem via online distributionally robust Markov decision processes (DRMDPs),…

Machine Learning · Computer Science 2024-02-26 Zhishuai Liu , Pan Xu

Multiscale modelling presents a multifaceted perspective into understanding the mechanisms of the brain and how neurodegenerative disorders like Parkinson's disease (PD) manifest and evolve over time. In this study, we propose a novel…

Neurons and Cognition · Quantitative Biology 2025-09-18 Aaron Herrera , Hina Shaheen

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

Robotics · Computer Science 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Reinforcement learning (RL) can be used to learn treatment policies and aid decision making in healthcare. However, given the need for generalization over complex state/action spaces, the incorporation of function approximators (e.g., deep…

Machine Learning · Computer Science 2021-07-26 Shengpu Tang , Jenna Wiens

Deep reinforcement learning (DRL) is a machine learning-based method suited for complex and high-dimensional control problems. In this study, a real-time control system based on DRL is developed for long-term voltage stability events. The…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Hannes Hagmar , Le Anh Tuan , Robert Eriksson

Accurate assessment of Parkinsonian tremor is vital for monitoring disease progression and evaluating treatment efficacy. We introduce a pixel-based deep learning model designed to analyse postural tremor in Parkinson's disease (PD) from…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Felipe Duque-Quiceno , Grzegorz Sarapata , Yuriy Dushin , Miles Allen , Jonathan O'Keeffe

Deep brain stimulation (DBS) has the potential to improve the quality of life of people with a variety of neurological diseases. A key challenge in DBS is in the placement of a stimulation electrode in the anatomical location that maximizes…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Camilo Bermudez , William Rodriguez , Yuankai Huo , Allison E. Hainline , Rui Li , Robert Shults , Pierre D. DHaese , Peter E. Konrad , Benoit M. Dawant , Bennett A. Landman