English
Related papers

Related papers: Conformal Signal Temporal Logic for Robust Reinfor…

200 papers

For safe operation, autonomous vehicles have to obey traffic rules that are set forth in legal documents formulated in natural language. Temporal logic is a suitable concept to formalize such traffic rules. Still, temporal logic rules often…

Machine Learning · Computer Science 2024-05-20 Hanna Krasowski , Matthias Althoff

We present a mathematical programming-based method for model predictive control of cyber-physical systems subject to signal temporal logic (STL) specifications. We describe the use of STL to specify a wide range of properties of these…

Learning control policies for complex, long-horizon tasks is a central challenge in robotics and autonomous systems. Signal Temporal Logic (STL) offers a powerful and expressive language for specifying such tasks, but its non-Markovian…

Robotics · Computer Science 2025-10-02 Yue Meng , Fei Chen , Chuchu Fan

Reinforcement learning (RL) has revolutionized decision-making across a wide range of domains over the past few decades. Yet, deploying RL policies in real-world scenarios presents the crucial challenge of ensuring safety. Traditional safe…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Lunet Yifru , Ali Baheri

Reinforcement learning has been applied to many interesting problems such as the famous TD-gammon and the inverted helicopter flight. However, little effort has been put into developing methods to learn policies for complex persistent tasks…

Artificial Intelligence · Computer Science 2016-06-22 Xiao Li , Calin Belta

In this paper, we demonstrate a Symbolic Reinforcement Learning (SRL) architecture for safe control in Radio Access Network (RAN) applications. In our automated tool, a user can select a high-level safety specifications expressed in Linear…

Artificial Intelligence · Computer Science 2021-03-12 Alexandros Nikou , Anusha Mujumdar , Marin Orlic , Aneta Vulgarakis Feljan

The paper addresses task assignment and trajectory generation for collaborative inspection missions using a fleet of multi-rotors, focusing on the wind turbine inspection scenario. The proposed solution enables safe and feasible…

Robotics · Computer Science 2025-01-16 Giuseppe Silano , Alvaro Caballero , Davide Liuzza , Luigi Iannelli , Stjepan Bogdan , Martin Saska

Safety verification for autonomous vehicles (AVs) and ground robots is crucial for ensuring reliable operation given their uncertain environments. Formal language tools provide a robust and sound method to verify safety rules for such…

Robotics · Computer Science 2025-01-24 Aditya Parameshwaran , Yue Wang

In this paper, we consider the problem of learning a neural network controller for a system required to satisfy a Signal Temporal Logic (STL) specification. We exploit STL quantitative semantics to define a notion of robust satisfaction.…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Wenliang Liu , Wei Xiao , Calin Belta

Signal Temporal Logic (STL) is a formalism used to rigorously specify requirements of cyberphysical systems (CPS), i.e., systems mixing digital or discrete components in interaction with a continuous environment or analog com- ponents. STL…

Systems and Control · Computer Science 2015-06-30 Jyotirmoy V. Deshmukh , Alexandre Donzé , Shromona Ghosh , Xiaoqing Jin , Garvit Juniwal , Sanjit A. Seshia

This paper studies satisfaction of temporal properties on unknown stochastic processes that have continuous state spaces. We show how reinforcement learning (RL) can be applied for computing policies that are finite-memory and deterministic…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Milad Kazemi , Sadegh Soudjani

Signal Temporal Logic (STL) inference seeks to extract human-interpretable rules from time-series data, but existing methods lack formal confidence guarantees for the inferred rules. Conformal prediction (CP) is a technique that can provide…

Machine Learning · Computer Science 2025-10-23 Danyang Li , Yixuan Wang , Matthew Cleaveland , Mingyu Cai , Roberto Tron

We introduce a metric that can quantify the temporal relaxation of Signal Temporal Logic (STL) specifications and facilitate resilient control synthesis in the face of infeasibilities. The proposed metric quantifies a cumulative notion of…

Systems and Control · Electrical Eng. & Systems 2022-12-13 Ali Tevfik Buyukkocak , Derya Aksaray

Control synthesis from temporal logic specifications has gained popularity in recent years. In this paper, we use a model predictive approach to control discrete time linear systems with additive bounded disturbances subject to constraints…

Systems and Control · Computer Science 2016-05-24 Sadra Sadraddini , Calin Belta

Shielding is widely used to enforce safety in reinforcement learning (RL), ensuring that an agent's actions remain compliant with formal specifications. Classical shielding approaches, however, are often static, in the sense that they…

Artificial Intelligence · Computer Science 2026-02-23 Tiberiu-Andrei Georgescu , Alexander W. Goodall , Dalal Alrajeh , Francesco Belardinelli , Sebastian Uchitel

Linear temporal logic (LTL) has recently been adopted as a powerful formalism for specifying complex, temporally extended tasks in multi-task reinforcement learning (RL). However, learning policies that efficiently satisfy arbitrary…

Artificial Intelligence · Computer Science 2025-04-01 Mathias Jackermeier , Alessandro Abate

For performing robotic manipulation tasks, the core problem is determining suitable trajectories that fulfill the task requirements. Various approaches to compute such trajectories exist, being learning and optimization the main driving…

Robotics · Computer Science 2022-09-08 Akshay Dhonthi , Philipp Schillinger , Leonel Rozo , Daniele Nardi

Signal Temporal Logic (STL) inference learns interpretable logical rules for temporal behaviors in dynamical systems. To ensure the correctness of learned STL formulas, recent approaches have incorporated conformal prediction as a…

Machine Learning · Computer Science 2026-03-31 Yixuan Wang , Danyang Li , Matthew Cleaveland , Roberto Tron , Mingyu Cai

Deep Reinforcement Learning (DRL) has the potential to be used for synthesizing feedback controllers (agents) for various complex systems with unknown dynamics. These systems are expected to satisfy diverse safety and liveness properties…

Artificial Intelligence · Computer Science 2022-12-05 Nikhil Kumar Singh , Indranil Saha

Signal Temporal Logic (STL) is a widely recognized formal specification language to express rigorous temporal requirements on mixed analog signals produced by cyber-physical systems (CPS). A relevant problem in CPS design is how to…

Logic in Computer Science · Computer Science 2025-07-30 Beatrice Melani , Ezio Bartocci , Michele Chiari