English
Related papers

Related papers: Learning a Shield from Catastrophic Action Effects…

200 papers

Safety is one of the main challenges in applying reinforcement learning to realistic environmental tasks. To ensure safety during and after training process, existing methods tend to adopt overly conservative policy to avoid unsafe…

Machine Learning · Computer Science 2023-06-27 Xiao Zhang , Hai Zhang , Hongtu Zhou , Chang Huang , Di Zhang , Chen Ye , Junqiao Zhao

Simulation provides a safe and efficient way to generate useful data for learning complex robotic tasks. However, matching simulation and real-world dynamics can be quite challenging, especially for systems that have a large number of…

Robotics · Computer Science 2021-03-16 Visak Kumar , Sehoon Ha , C. Karen Liu

The interactive partially observable Markov decision process (I-POMDP) is a recently developed framework which extends the POMDP to the multi-agent setting by including agent models in the state space. This paper argues for formulating the…

Robotics · Computer Science 2012-04-03 Mark P. Woodward , Robert J. Wood

The goal of continual learning is to find a model that solves multiple learning tasks which are presented sequentially to the learner. A key challenge in this setting is that the learner may forget how to solve a previous task when learning…

Machine Learning · Computer Science 2023-06-09 Liangzu Peng , Paris V. Giampouras , René Vidal

Centralized training with decentralized execution (CTDE) is a standard framework for cooperative multi-agent policy-gradient reinforcement learning, allowing agents to learn from joint information while acting from local observations.…

Machine Learning · Computer Science 2026-05-12 Chulabhaya Wijesundara , Andrea Baisero , Zhongheng Li , Gregory Castañón , Alan Carlin , Christopher Amato

This paper presents the concept of an adaptive safe padding that forces Reinforcement Learning (RL) to synthesise optimal control policies while ensuring safety during the learning process. Policies are synthesised to satisfy a goal,…

Machine Learning · Computer Science 2020-03-24 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Safe and optimal controller synthesis for switched-controlled hybrid systems, which combine differential equations and discrete changes of the system's state, is known to be intricately hard. Reinforcement learning has been leveraged to…

Logic in Computer Science · Computer Science 2023-12-15 Asger Horn Brorholt , Peter Gjøl Jensen , Kim Guldstrand Larsen , Florian Lorber , Christian Schilling

Deep reinforcement learning has emerged as a powerful tool for a variety of learning tasks, however deep nets typically exhibit forgetting when learning multiple tasks in sequence. To mitigate forgetting, we propose an experience replay…

Artificial Intelligence · Computer Science 2018-03-01 David Isele , Akansel Cosgun

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

Machine Learning · Computer Science 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

Catastrophic forgetting is the notorious vulnerability of neural networks to the change of the data distribution while learning. This phenomenon has long been considered a major obstacle for allowing the use of learning agents in realistic…

Machine Learning · Statistics 2019-02-13 Chen Zeno , Itay Golan , Elad Hoffer , Daniel Soudry

Safe Reinforcement learning (Safe RL) aims at learning optimal policies while staying safe. A popular solution to Safe RL is shielding, which uses a logical safety specification to prevent an RL agent from taking unsafe actions. However,…

Artificial Intelligence · Computer Science 2023-03-07 Wen-Chi Yang , Giuseppe Marra , Gavin Rens , Luc De Raedt

Shielding is a common method used to guarantee the safety of a system under a black-box controller, such as a neural network controller from deep reinforcement learning (DRL), with simpler, verified controllers. Existing shielding methods…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Robert Reed , Morteza Lahijanian

In this paper, we are interested in systems with multiple agents that wish to collaborate in order to accomplish a common task while a) agents have different information (decentralized information) and b) agents do not know the model of the…

Optimization and Control · Mathematics 2020-12-04 Jalal Arabneydi , Aditya Mahajan

Predictive process monitoring (PPM) focuses on predicting future process trajectories, including next activity predictions. This is crucial in dynamic environments where processes change or face uncertainty. However, current frameworks…

Machine Learning · Computer Science 2026-04-03 Marwan Hassani , Tamara Verbeek , Sjoerd van Straten

Policy search can in principle acquire complex strategies for control of robots and other autonomous systems. When the policy is trained to process raw sensory inputs, such as images and depth maps, it can also acquire a strategy that…

Machine Learning · Computer Science 2017-02-28 Gregory Kahn , Tianhao Zhang , Sergey Levine , Pieter Abbeel

This paper puts forward the concept that learning to take safe actions in unknown environments, even with probability one guarantees, can be achieved without the need for an unbounded number of exploratory trials. This is indeed possible,…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Agustin Castellano , Hancheng Min , Juan Bazerque , Enrique Mallada

Deep reinforcement learning algorithms can learn complex behavioral skills, but real-world application of these methods requires a large amount of experience to be collected by the agent. In practical settings, such as robotics, this…

Machine Learning · Computer Science 2017-11-21 Benjamin Eysenbach , Shixiang Gu , Julian Ibarz , Sergey Levine

Cascading failures, triggered by a local perturbation, can be catastrophic and cause irreparable damages in a wide area. Hence, blocking the devastating cascades is an important issue in real world networks. One of the ways to control the…

Physics and Society · Physics 2024-06-28 Davood Fazli , Mozhgan Khanjanianpak , Nahid Azimi-Tafreshi

As an important psychological and social experiment, the Iterated Prisoner's Dilemma (IPD) treats the choice to cooperate or defect as an atomic action. We propose to study the behaviors of online learning algorithms in the Iterated…

Computer Science and Game Theory · Computer Science 2022-08-30 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi

In the classic herding model, agents receive private signals about an underlying binary state of nature, and act sequentially to choose one of two possible actions, after observing the actions of their predecessors. We investigate what…

Computer Science and Game Theory · Computer Science 2018-02-21 Yu Cheng , Wade Hann-Caruthers , Omer Tamuz