English
Related papers

Related papers: Runtime Verification of Learning Properties for Re…

200 papers

Reinforcement Learning (RL) has become an increasingly important research area as the success of machine learning algorithms and methods grows. To combat the safety concerns surrounding the freedom given to RL agents while training, there…

Machine Learning · Computer Science 2024-05-22 Nathaniel Hamilton , Kyle Dunlap , Taylor T Johnson , Kerianne L Hobbs

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

Artificial Intelligence · Computer Science 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

AI methods are used in societally important settings, ranging from credit to employment to housing, and it is crucial to provide fairness in regard to algorithmic decision making. Moreover, many settings are dynamic, with populations…

Machine Learning · Computer Science 2022-11-09 Zhun Deng , He Sun , Zhiwei Steven Wu , Linjun Zhang , David C. Parkes

The problem of Reinforcement Learning (RL) in an unknown nonlinear dynamical system is equivalent to the search for an optimal feedback law utilizing the simulations/ rollouts of the dynamical system. Most RL techniques search over a…

Machine Learning · Computer Science 2022-03-25 Ran Wang , Karthikeya S. Parunandi , Aayushman Sharma , Raman Goyal , Suman Chakravorty

A Reinforcement Learning (RL) system depends on a set of initial conditions (hyperparameters) that affect the system's performance. However, defining a good choice of hyperparameters is a challenging problem. Hyperparameter tuning often…

Reinforcement Learning (RL) trains agents to learn optimal behavior by maximizing reward signals from experience datasets. However, RL training often faces memory limitations, leading to execution latencies and prolonged training times. To…

Trusting software systems, particularly autonomous ones, is challenging. To address this, formal verification techniques can ensure these systems behave as expected. Runtime Verification (RV) is a leading, lightweight method for verifying…

Formal Languages and Automata Theory · Computer Science 2024-08-22 Angelo Ferrando , Vadim Malvone

Applications of reinforcement learning (RL) are popular in autonomous driving tasks. That being said, tuning the performance of an RL agent and guaranteeing the generalization performance across variety of different driving scenarios is…

Artificial Intelligence · Computer Science 2021-08-03 Anil Ozturk , Mustafa Burak Gunel , Resul Dagdanov , Mirac Ekim Vural , Ferhat Yurdakul , Melih Dal , Nazim Kemal Ure

Runtime verification is an effective automated method for specification-based offline testing and analysis as well as online monitoring of complex systems. The specification language is often a variant of regular expressions or a popular…

Logic in Computer Science · Computer Science 2014-11-11 Ramy Medhat , Yogi Joshi , Borzoo Bonakdarpour , Sebastian Fischmeister

Reinforcement learning (RL) systems have countless applications, from energy-grid management to protein design. However, such real-world scenarios are often extremely difficult, combinatorial in nature, and require complex coordination…

Reinforcement learning (RL) agents need to be robust to variations in safety-critical environments. While system identification methods provide a way to infer the variation from online experience, they can fail in settings where fast…

Machine Learning · Computer Science 2022-03-07 Annie Xie , Shagun Sodhani , Chelsea Finn , Joelle Pineau , Amy Zhang

In recent years, \emph{Reinforcement Learning} (RL) has made remarkable progress, achieving superhuman performance in a wide range of simulated environments. As research moves toward deploying RL in real-world applications, the field faces…

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

Machine Learning · Computer Science 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

Reinforcement learning (RL) is a promising solution for autonomous vehicles to deal with complex and uncertain traffic environments. The RL training process is however expensive, unsafe, and time consuming. Algorithms are often developed…

Robotics · Computer Science 2022-11-29 Kevin Voogd , Jean Pierre Allamaa , Javier Alonso-Mora , Tong Duy Son

Reinforcement Learning (RL) algorithms suffer from the dependency on accurately engineered reward functions to properly guide the learning agents to do the required tasks. Preference-based reinforcement learning (PbRL) addresses that by…

Artificial Intelligence · Computer Science 2024-08-23 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

This paper addresses the problem of improving response times of robots implemented in the Robotic Operating System (ROS) using formal verification of computational-time feasibility. In order to verify the real time behaviour of a robot…

Robotics · Computer Science 2016-11-11 Mohammed Y. Hazim , Hongyang Qu , Sandor M. Veres

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

Reinforcement Learning (RL) has achieved tremendous success in many complex decision-making tasks. However, safety concerns are raised during deploying RL in real-world applications, leading to a growing demand for safe RL algorithms, such…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Long Yang , Yali Du , Guang Chen , Florian Walter , Jun Wang , Alois Knoll

Runtime enforcement refers to the theories, techniques, and tools for enforcing correct behavior with respect to a formal specification of systems at runtime. In this paper, we are interested in techniques for constructing runtime enforcers…

Artificial Intelligence · Computer Science 2022-08-31 Bettina Könighofer , Roderick Bloem , Rüdiger Ehlers , Christian Pek