English
Related papers

Related papers: Signal Temporal Logic Neural Predictive Control

200 papers

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

There has been substantial progress in the inference of formal behavioural specifications from sample trajectories, for example, using Linear Temporal Logic (LTL). However, these techniques cannot handle specifications that correctly…

Logic in Computer Science · Computer Science 2025-05-20 Rajarshi Roy , Yash Pote , David Parker , Marta Kwiatkowska

Train timetable rescheduling (TTR) aims to promptly restore the original operation of trains after unexpected disturbances or disruptions. Currently, this work is still done manually by train dispatchers, which is challenging to maintain…

Machine Learning · Computer Science 2024-01-17 Peng Yue , Yaochu Jin , Xuewu Dai , Zhenhua Feng , Dongliang Cui

There has been a growing interest in extracting formal descriptions of the system behaviors from data. Signal Temporal Logic (STL) is an expressive formal language used to describe spatial-temporal properties with interpretability. This…

Logic in Computer Science · Computer Science 2024-05-16 Danyang Li , Mingyu Cai , Cristian-Ioan Vasile , Roberto Tron

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

Real-world scenarios are characterized by timing uncertainties, e.g., delays, and disturbances. Algorithms with temporal robustness are crucial in guaranteeing the successful execution of tasks and missions in such scenarios. We study…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Nhan-Khanh Le , Erfaun Noorani , Sandra Hirche , John Baras

Control Barrier Functions (CBFs) have been used to enforce safety and task specifications expressed in Signal Temporal Logic (STL). However, existing CBF-STL approaches typically rely on fixed hyperparameters and per-step optimization,…

Systems and Control · Electrical Eng. & Systems 2026-01-29 Wenliang Liu , Shuo Liu , Wei Xiao , Calin A. Belta

Continuously learning new tasks using high-level ideas or knowledge is a key capability of humans. In this paper, we propose Lifelong reinforcement learning with Sequential linear temporal logic formulas and Reward Machines (LSRM), which…

Artificial Intelligence · Computer Science 2021-11-19 Xuejing Zheng , Chao Yu , Chen Chen , Jianye Hao , Hankz Hankui Zhuo

Reinforcement learning (RL) with linear temporal logic (LTL) objectives can allow robots to carry out symbolic event plans in unknown environments. Most existing methods assume that the event detector can accurately map environmental states…

Robotics · Computer Science 2023-09-07 Wataru Hatanaka , Ryota Yamashina , Takamitsu Matsubara

Signal Temporal Logic (STL) is expressive formal language that specifies spatio-temporal requirements in robotics. Its quantitative robustness semantics can be easily integrated with optimization-based control frameworks. However, STL…

Robotics · Computer Science 2026-03-10 Tianhao Wu , Yiwei Lyu

Deep reinforcement learning has gradually shown its latent decision-making ability in urban rail transit autonomous operation. However, since reinforcement learning can not neither guarantee safety during learning nor execution, this is…

Artificial Intelligence · Computer Science 2024-01-09 Zicong Zhao

Safe reinforcement learning (RL) trains a policy to maximize the task reward while satisfying safety constraints. While prior works focus on the performance optimality, we find that the optimal solutions of many safe RL problems are not…

Machine Learning · Computer Science 2023-03-03 Zuxin Liu , Zijian Guo , Zhepeng Cen , Huan Zhang , Jie Tan , Bo Li , Ding Zhao

Apprenticeship learning crucially depends on effectively learning rewards, and hence control policies from user demonstrations. Of particular difficulty is the setting where the desired task consists of a number of sub-goals with temporal…

Robotics · Computer Science 2023-11-10 Aniruddh G. Puranic , Jyotirmoy V. Deshmukh , Stefanos Nikolaidis

This paper presents control strategies based on time-varying convergent higher order control barrier functions for a class of leader-follower multi-agent systems under signal temporal logic (STL) tasks. Each agent is assigned a local STL…

Systems and Control · Electrical Eng. & Systems 2021-10-12 Maryam Sharifi , Dimos V. Dimarogonas

Reinforcement Learning (RL) provides a powerful framework for decision-making in complex environments. However, implementing RL in hardware-efficient and bio-inspired ways remains a challenge. This paper presents a novel Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2023-08-09 Sergio F. Chevtchenko , Yeshwanth Bethi , Teresa B. Ludermir , Saeed Afshar

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu

We propose a framework that can incrementally expand the explanatory temporal logic rule set to explain the occurrence of temporal events. Leveraging the temporal point process modeling and learning framework, the rule content and weights…

Machine Learning · Computer Science 2023-08-14 Chao Yang , Lu Wang , Kun Gao , Shuang Li

Imitation learning methods have demonstrated considerable success in teaching autonomous systems complex tasks through expert demonstrations. However, a limitation of these methods is their lack of interpretability, particularly in…

Machine Learning · Computer Science 2025-07-21 Wenliang Liu , Danyang Li , Erfan Aasi , Daniela Rus , Roberto Tron , Calin Belta

Signal Temporal Logic (STL), has recently seen extensive development, owing to its rich expressivenes for autonomous planning and control. Nevertheless, existing verification and control synthesis methods are limited with respect to the…

Robotics · Computer Science 2026-05-28 Panagiotis Rousseas , Dimos V. Dimarogonas