English
Related papers

Related papers: Value-Based Reinforcement Learning for Digital Twi…

200 papers

Single-domain offline reinforcement learning (RL) often suffers from limited data coverage, while cross-domain offline RL handles this issue by leveraging additional data from other domains with dynamics shifts. However, existing studies…

Machine Learning · Computer Science 2026-03-10 Zhongjian Qiao , Rui Yang , Jiafei Lyu , Xiu Li , Zhongxiang Dai , Zhuoran Yang , Siyang Gao , Shuang Qiu

Studies that broaden drone applications into complex tasks require a stable control framework. Recently, deep reinforcement learning (RL) algorithms have been exploited in many studies for robot control to accomplish complex tasks.…

In recent times, a variety of Reinforcement Learning (RL) algorithms have been proposed for optimal tracking problem of continuous time nonlinear systems with input constraints. Most of these algorithms are based on the notion of uniform…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Amardeep Mishra , Satadal Ghosh

Fine tuning distributed systems is considered to be a craftsmanship, relying on intuition and experience. This becomes even more challenging when the systems need to react in near real time, as streaming engines have to do to maintain…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-17 Luis M. Vaquero , Felix Cuadrado

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

This paper proposes a fully dynamic Deep Reinforcement Learning (DRL) method for rebalancing dockless bike-sharing systems, overcoming the limitations of periodic, system-wide interventions. We model the service through a graph-based…

Systems and Control · Electrical Eng. & Systems 2026-05-15 Edoardo Scarpel , Alberto Pettena , Matteo Cederle , Federico Chiariotti , Marco Fabris , Gian Antonio Susto

Aiming at the local overload of multi-controller deployment in software-defined networks, a load balancing mechanism of SDN controller based on reinforcement learning is designed. The initial paired migrate-out domain and migrate-in domain…

Networking and Internet Architecture · Computer Science 2021-03-12 Zhuo Li , Xu Zhou , Junruo Gao , Yifang Qin

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

Machine Learning · Computer Science 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

In order to make better use of deep reinforcement learning in the creation of sensing policies for resource-constrained IoT devices, we present and study a novel reward function based on the Fisher information value. This reward function…

Machine Learning · Computer Science 2020-10-09 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

Digital twins, integral to cloud platforms, bridge physical and virtual worlds, fostering collaboration among stakeholders in manufacturing and processing. However, the cloud platforms face challenges like service outages, vulnerabilities,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-05 Deepika Saxena , Ashutosh Kumar Singh

Assigning importance weights to adversarial data has achieved great success in training adversarially robust networks under limited model capacity. However, existing instance-reweighted adversarial training (AT) methods heavily depend on…

Machine Learning · Computer Science 2023-08-02 Daouda Sow , Sen Lin , Zhangyang Wang , Yingbin Liang

In this paper, we present a solution to a design problem of control strategies for multi-agent cooperative transport. Although existing learning-based methods assume that the number of agents is the same as that in the training environment,…

Robotics · Computer Science 2022-12-06 Kazuki Shibata , Tomohiko Jimbo , Takamitsu Matsubara

Buildings with Heating, Ventilation, and Air Conditioning (HVAC) systems play a crucial role in ensuring indoor comfort and efficiency. While traditionally governed by physics-based models, the emergence of big data has enabled data-driven…

Machine Learning · Computer Science 2025-03-26 Gautham Udayakumar Bekal , Ahmed Ghareeb , Ashish Pujari

Although the emergence of 6G IoT networks has accelerated the deployment of enhanced smart city services, the resource limitations of IoT devices remain as a significant problem. Given this limitation, meeting the low-latency service…

Networking and Internet Architecture · Computer Science 2025-08-27 Kubra Duran , Lal Verda Cakir , Sana Ullah Jan , Kerem Gursu , Berk Canberk

We study off-dynamics Reinforcement Learning (RL), where the policy is trained on a source domain and deployed to a distinct target domain. We aim to solve this problem via online distributionally robust Markov decision processes (DRMDPs),…

Machine Learning · Computer Science 2024-02-26 Zhishuai Liu , Pan Xu

We describe the offline machine learning (ML) development for an effort to precisely regulate the Gradient Magnet Power Supply (GMPS) at the Fermilab Booster accelerator complex via a Field-Programmable Gate Array (FPGA). As part of this…

Accelerator Physics · Physics 2021-05-28 D. Kafkes , M. Schram

This paper proposes a novel localization framework based on collaborative training or federated learning paradigm, for highly accurate localization of autonomous vehicles. More specifically, we build on the standard approach of KalmanNet, a…

Robotics · Computer Science 2025-02-14 Nikos Piperigkos , Alexandros Gkillas , Christos Anagnostopoulos , Aris S. Lalos

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar