English
Related papers

Related papers: Safe Hierarchical Reinforcement Learning for CubeS…

200 papers

In a warehouse environment, tasks appear dynamically. Consequently, a task management system that matches them with the workforce too early (e.g., weeks in advance) is necessarily sub-optimal. Also, the rapidly increasing size of the action…

Machine Learning · Computer Science 2022-03-08 Diogo S. Carvalho , Biswa Sengupta

Diffusion probabilistic models have set a new standard for generative fidelity but are hindered by a slow iterative sampling process. A powerful training-free strategy to accelerate this process is Schedule Optimization, which aims to find…

Machine Learning · Computer Science 2026-05-20 Aihua Zhu , Rui Su , Qinglin Zhao , Li Feng , Meng Shen , Shibo He

Hierarchical Reinforcement Learning (HRL) algorithms have been demonstrated to perform well on high-dimensional decision making and robotic control tasks. However, because they solely optimize for rewards, the agent tends to search the same…

Robotics · Computer Science 2022-12-27 Kandai Watanabe , Mathew Strong , Omer Eldar

Multi-goal robot manipulation tasks with sparse rewards are difficult for reinforcement learning (RL) algorithms due to the inefficiency in collecting successful experiences. Recent algorithms such as Hindsight Experience Replay (HER)…

Robotics · Computer Science 2024-02-26 Erdi Sayar , Zhenshan Bing , Carlo D'Eramo , Ozgur S. Oguz , Alois Knoll

Safety is crucial for robotic missions within an uncertain environment. Common safety requirements such as collision avoidance are only state-dependent, which can be restrictive for complex missions. In this work, we address a more general…

Robotics · Computer Science 2023-02-13 Meng Guo , Tianjun Liao , Junjie Wang , Zhongkui Li

Reinforcement learning (RL)-based methods have achieved significant success in managing grid-interactive efficient buildings (GEBs). However, RL does not carry intrinsic guarantees of constraint satisfaction, which may lead to severe safety…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Xiang Huo , Boming Liu , Jin Dong , Jianming Lian , Mingxi Liu

This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission…

Artificial Intelligence · Computer Science 2025-05-15 Ardian Selmonaj , Oleg Szehr , Giacomo Del Rio , Alessandro Antonucci , Adrian Schneider , Michael Rüegsegger

We address the problem of safe policy learning in multi-agent safety-critical autonomous systems. In such systems, it is necessary for each agent to meet the safety requirements at all times while also cooperating with other agents to…

Cyber-physical systems, such as mobile robots, must respond adaptively to dynamic operating conditions. Effective operation of these systems requires that sensing and actuation tasks are performed in a timely manner. Additionally, execution…

Machine Learning · Computer Science 2012-03-19 Robert Glaubius , Terry Tidwell , Christopher Gill , William D. Smart

CubeSats have democratised access to space for universities, start-ups and emerging space nations, but the same design decisions that reduce cost and complexity introduce distinctive cybersecurity risks. Existing risk assessment…

Cryptography and Security · Computer Science 2026-04-02 Jonathan Shelby

In hierarchical reinforcement learning a major challenge is determining appropriate low-level policies. We propose an unsupervised learning scheme, based on asymmetric self-play from Sukhbaatar et al. (2018), that automatically learns a…

Machine Learning · Computer Science 2018-11-26 Sainbayar Sukhbaatar , Emily Denton , Arthur Szlam , Rob Fergus

The growing adoption of Electric Buses (EBs) represents a significant step toward sustainable development. By utilizing Internet of Things (IoT) systems, charging stations can autonomously determine charging schedules based on real-time…

Machine Learning · Computer Science 2025-05-16 Jiaju Qi , Lei Lei , Thorsteinn Jonsson , Dusit Niyato

The integration of Electric Buses (EBs) with renewable energy sources such as photovoltaic (PV) panels is a promising approach to promote sustainable and low-carbon public transportation. However, optimizing EB charging schedules to…

Machine Learning · Computer Science 2025-12-04 Jiaju Qi , Lei Lei , Thorsteinn Jonsson , Dusit Niyato

Millions of battery-powered sensors deployed for monitoring purposes in a multitude of scenarios, e.g., agriculture, smart cities, industry, etc., require energy-efficient solutions to prolong their lifetime. When these sensors observe a…

Machine Learning · Computer Science 2021-09-30 Jernej Hribar , Andrei Marinescu , Alessandro Chiumento , Luiz A. DaSilva

In this paper, we propose a novel hierarchical framework for robot navigation in dynamic environments with heterogeneous constraints. Our approach leverages a graph neural network trained via reinforcement learning (RL) to efficiently…

Robotics · Computer Science 2025-07-24 Huajian Liu , Yixuan Feng , Wei Dong , Kunpeng Fan , Chao Wang , Yongzhuo Gao

The Uncertain Agile Earth Observation Satellite Scheduling Problem (UAEOSSP) is a novel combinatorial optimization problem and a practical engineering challenge that aligns with the current demands of space technology development. It…

Artificial Intelligence · Computer Science 2026-03-19 Junhua Xue , Yuning Chen , Mingyan Shao , Yangming Zhou , Qinghua Wu , Yingwu Chen

Edge computing faces unprecedented resource orchestration challenges from multi-dimensional heterogeneity across device architectures, diverse task requirements in CPU-intensive, GPU-intensive, I/O-intensive, and dynamic network conditions.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Jianyong Zhu , Hao Chen , Juan Zhang , Fangda Guo , Albert Y. Zomaya , Renyu Yang

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Low earth orbit (LEO) satellite communications can provide ubiquitous and reliable services, making it an essential part of the Internet of Everything network. Beam hopping (BH) is an emerging technology for effectively addressing the issue…

Networking and Internet Architecture · Computer Science 2023-12-05 Shuang Zheng , Xing Zhang , Peng Wang , Wenbo Wang

The charging scheduling problem of Electric Buses (EBs) is investigated based on Deep Reinforcement Learning (DRL). A Markov Decision Process (MDP) is conceived, where the time horizon includes multiple charging and operating periods in a…

Machine Learning · Computer Science 2025-05-16 Jiaju Qi , Lei Lei , Thorsteinn Jonsson , Lajos Hanzo