English
Related papers

Related papers: Improved Safe Real-time Heuristic Search

200 papers

Safe exploration is a key to applying reinforcement learning (RL) in safety-critical systems. Existing safe exploration methods guaranteed safety under the assumption of regularity, and it has been difficult to apply them to large-scale…

Machine Learning · Computer Science 2021-11-10 Akifumi Wachi , Yunyue Wei , Yanan Sui

In real-time embedded systems (RTS), failures due to security breaches can cause serious damage to the system, the environment and/or injury to humans. Therefore, it is very important to understand the potential threats and attacks against…

Cryptography and Security · Computer Science 2017-05-09 Chien-Ying Chen , AmirEmad Ghassami , Sibin Mohan , Negar Kiyavash , Rakesh B. Bobba , Rodolfo Pellizzoni , Man-Ki Yoon

Machine learning has successfully framed many sequential decision making problems as either supervised prediction, or optimal decision-making policy identification via reinforcement learning. In data-constrained offline settings, both…

Machine Learning · Computer Science 2022-02-21 Mehdi Fatemi , Taylor W. Killian , Jayakumar Subramanian , Marzyeh Ghassemi

Reinforcement Learning (RL) algorithms have achieved remarkable performance in decision making and control tasks due to their ability to reason about long-term, cumulative reward using trial and error. However, during RL training, applying…

Robotics · Computer Science 2021-03-03 Yifei Simon Shao , Chao Chen , Shreyas Kousik , Ram Vasudevan

In this paper, we consider the important problem of safe exploration in reinforcement learning. While reinforcement learning is well-suited to domains with complex transition dynamics and high-dimensional state-action spaces, an additional…

Machine Learning · Computer Science 2014-02-05 Javier Garcia , Fernando Fernandez

Aerial robots hold great potential for aiding Search and Rescue (SAR) efforts over large areas. Traditional approaches typically searches an area exhaustively, thereby ignoring that the density of victims varies based on predictable…

Robotics · Computer Science 2019-03-26 Olov Andersson , Per Sidén , Johan Dahlin , Patrick Doherty , Mattias Villani

Cyber Physical Systems (CPS) are becoming ubiquitous and affect the physical world, yet security is seldom at the forefront of their design. This is especially true of robotic control algorithms which seldom consider the effect of a cyber…

Robotics · Computer Science 2018-03-07 Alexander Ivanov , Mark Campbell

The fast-growing demand for fully autonomous aerial operations in shared spaces necessitates developing trustworthy agents that can safely and seamlessly navigate in crowded, dynamic spaces. In this work, we propose Social Robot Tree Search…

Robotics · Computer Science 2023-04-05 Ingrid Navarro , Jay Patrikar , Joao P. A. Dantas , Rohan Baijal , Ian Higgins , Sebastian Scherer , Jean Oh

The paper presents a comprehensive performance evaluation of some heuristic search algorithms in the context of autonomous systems and robotics. The objective of the study is to evaluate and compare the performance of different search…

Multiagent Systems · Computer Science 2023-10-05 Aya Kherrour , Marco Robol , Marco Roveri , Paolo Giorgini

We introduce a novel simulation-based approach to identify hazards that result from unexpected worker behavior in human-robot collaboration. Simulation-based safety testing must take into account the fact that human behavior is variable and…

Robotics · Computer Science 2021-11-30 Tom P. Huck , Christoph Ledermann , Torsten Kröger

Safety is one of the main challenges in applying reinforcement learning to realistic environmental tasks. To ensure safety during and after training process, existing methods tend to adopt overly conservative policy to avoid unsafe…

Machine Learning · Computer Science 2023-06-27 Xiao Zhang , Hai Zhang , Hongtu Zhou , Chang Huang , Di Zhang , Chen Ye , Junqiao Zhao

This paper investigates the optimal signal detection problem with a particular interest in large-scale multiple-input multiple-output (MIMO) systems. The problem is NP-hard and can be solved optimally by searching the shortest path on the…

Machine Learning · Computer Science 2022-03-22 Le He , Ke He , Lisheng Fan , Xianfu Lei , Arumugam Nallanathan , George K. Karagiannidis

Reinforcement Learning (RL) algorithms show amazing performance in recent years, but placing RL in real-world applications such as self-driven vehicles may suffer safety problems. A self-driven vehicle moving to a target position following…

Systems and Control · Electrical Eng. & Systems 2022-07-05 Huanhui Cao , Zhiyuan Cai , Hairuo Wei , Wenjie Lu , Lin Zhang , Hao Xiong

We present a novel technique for online safety verification of autonomous systems, which performs reachability analysis efficiently for both bounded and unbounded horizons by employing neural barrier certificates. Our approach uses barrier…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Alessandro Abate , Sergiy Bogomolov , Alec Edwards , Kostiantyn Potomkin , Sadegh Soudjani , Paolo Zuliani

Anytime heuristic search algorithms try to find a (potentially suboptimal) solution as quickly as possible and then work to find better and better solutions until an optimal solution is obtained or time is exhausted. The most widely-known…

Artificial Intelligence · Computer Science 2023-12-21 Sofia Lemons , Wheeler Ruml , Robert C. Holte , Carlos Linares López

Search agents connect LLMs to the Internet, enabling them to access broader and more up-to-date information. However, this also introduces a new threat surface: unreliable search results can mislead agents into producing unsafe outputs.…

Artificial Intelligence · Computer Science 2026-05-29 Jianshuo Dong , Sheng Guo , Hao Wang , Xun Chen , Zhuotao Liu , Tianwei Zhang , Ke Xu , Minlie Huang , Han Qiu

High-performance autonomy often must operate at the boundaries of safety. When external agents are present in a system, the process of ensuring safety without sacrificing performance becomes extremely difficult. In this paper, we present an…

Robotics · Computer Science 2021-10-05 Stanley Bak , Johannes Betz , Abhinav Chawla , Hongrui Zheng , Rahul Mangharam

Sequential decision making using Markov Decision Process underpins many realworld applications. Both model-based and model free methods have achieved strong results in these settings. However, real-world tasks must balance reward…

Machine Learning · Computer Science 2026-04-01 Janaka Chathuranga Brahmanage , Akshat Kumar

Safe exploration is a challenging and important problem in model-free reinforcement learning (RL). Often the safety cost is sparse and unknown, which unavoidably leads to constraint violations -- a phenomenon ideally to be avoided in…

Machine Learning · Computer Science 2022-10-13 Aivar Sootla , Alexander I. Cowen-Rivers , Jun Wang , Haitham Bou Ammar

The growing complexity of modern Cyber-Physical Systems (CPS) and the frequent communication between their components make them vulnerable to malicious attacks. As a result, secure state estimation is a critical requirement for the control…

Optimization and Control · Mathematics 2020-10-09 Xusheng Luo , Miroslav Pajic , Michael M. Zavlanos