English
Related papers

Related papers: Signal Temporal Logic Neural Predictive Control

200 papers

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively…

Artificial Intelligence · Computer Science 2017-03-03 Xiao Li , Cristian-Ioan Vasile , Calin Belta

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

We present a robust control framework for time-critical systems in which satisfying real-time constraints robustly is of utmost importance for the safety of the system. Signal Temporal Logic (STL) provides a formal means to express a large…

Systems and Control · Electrical Eng. & Systems 2021-12-15 Alena Rodionova , Lars Lindemann , Manfred Morari , George J. Pappas

In this paper, we consider the problem of learning a neural network controller for a system required to satisfy a Signal Temporal Logic (STL) specification. We exploit STL quantitative semantics to define a notion of robust satisfaction.…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Wenliang Liu , Wei Xiao , Calin Belta

We apply deep reinforcement learning (DRL) to design of a networked controller with network delays to complete a temporal control task that is described by a signal temporal logic (STL) formula. STL is useful to deal with a specification…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Junya Ikemoto , Toshimitsu Ushio

We propose a Reinforcement Learning (RL) based control design framework for handling complex tasks. The approach extends the concept of Reward Machines (RM) with Signal Temporal Logic (STL) formulas that can be used for event generation.…

Artificial Intelligence · Computer Science 2026-04-17 Ana María Gómez Ruiz , Thao Dang , Alexandre Donzé

Signal temporal logic (STL) is an expressive language to specify time-bound real-world robotic tasks and safety specifications. Recently, there has been an interest in learning optimal policies to satisfy STL specifications via…

Machine Learning · Computer Science 2020-02-19 Harish Venkataraman , Derya Aksaray , Peter Seiler

Signal Temporal Logic (STL) is a powerful specification language for describing complex temporal behaviors of continuous signals, making it well-suited for high-level robotic task descriptions. However, generating executable plans for STL…

Robotics · Computer Science 2025-10-28 Ruijia Liu , Ancheng Hou , Xiao Yu , Xiang Yin

Signal Temporal Logic (STL) is a powerful formal language for specifying real-time specifications of Cyber-Physical Systems (CPS). Transforming specifications written in natural language into STL formulas automatically has attracted…

Formal Languages and Automata Theory · Computer Science 2025-11-12 Yue Fang , Jin Zhi , Jie An , Hongshen Chen , Xiaohong Chen , Naijun Zhan

Control synthesis from temporal logic specifications has gained popularity in recent years. In this paper, we use a model predictive approach to control discrete time linear systems with additive bounded disturbances subject to constraints…

Systems and Control · Computer Science 2016-05-24 Sadra Sadraddini , Calin Belta

Signal Temporal Logic (STL) is a formal language over continuous-time signals (such as trajectories of a multi-agent system) that allows for the specification of complex spatial and temporal system requirements (such as staying sufficiently…

Robotics · Computer Science 2023-10-17 Joris Verhagen , Lars Lindemann , Jana Tumova

This paper addresses the planning and control problem for nonlinear systems under Signal Temporal Logic (STL) specifications. We first decompose an STL task into finite local tasks. A sampling-based method generates sequences of local…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Zuodong Pan , Xu Fang , Wei Ren

Offline safe reinforcement learning (RL) aims to train a constraint satisfaction policy from a fixed dataset. Current state-of-the-art approaches are based on supervised learning with a conditioned policy. However, these approaches fall…

Machine Learning · Computer Science 2025-01-28 Zijian Guo , Weichao Zhou , Wenchao Li

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

Several methods have been proposed recently to learn neural network (NN) controllers for autonomous agents, with unknown and stochastic dynamics, tasked with complex missions captured by Linear Temporal Logic (LTL). Due to the…

Robotics · Computer Science 2023-11-23 Jun Wang , Haojun Chen , Zihe Sun , Yiannis Kantaros

This study proposes a novel planning framework based on a model predictive control formulation that incorporates signal temporal logic (STL) specifications for task completion guarantees and robustness quantification. This marks the…

Robotics · Computer Science 2023-09-26 Zhaoyuan Gu , Rongming Guo , William Yates , Yipu Chen , Ye Zhao

Reinforcement learning (RL) has revolutionized decision-making across a wide range of domains over the past few decades. Yet, deploying RL policies in real-world scenarios presents the crucial challenge of ensuring safety. Traditional safe…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Lunet Yifru , Ali Baheri

In this paper, we consider the problem of synthesizing a controller in the presence of uncertainty such that the resulting closed-loop system satisfies certain hard constraints while optimizing certain (soft) performance objectives. We…

Systems and Control · Electrical Eng. & Systems 2022-10-17 Navid Hashemi , Xin Qin , Jyotirmoy V. Deshmukh , Georgios Fainekos , Bardh Hoxha , Danil Prokhorov , Tomoya Yamaguchi

Signal Temporal Logic (STL) inference seeks to extract human-interpretable rules from time-series data, but existing methods lack formal confidence guarantees for the inferred rules. Conformal prediction (CP) is a technique that can provide…

Machine Learning · Computer Science 2025-10-23 Danyang Li , Yixuan Wang , Matthew Cleaveland , Mingyu Cai , Roberto Tron