English
Related papers

Related papers: Model-based Reinforcement Learning from Signal Tem…

200 papers

In many real-world applications, safety constraints for reinforcement learning (RL) algorithms are either unknown or not explicitly defined. We propose a framework that concurrently learns safety constraints and optimal RL policies in such…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Lunet Yifru , Ali Baheri

Although deep reinforcement learning has recently been very successful at learning complex behaviors, it requires a tremendous amount of data to learn a task. One of the fundamental reasons causing this limitation lies in the nature of the…

Robotics · Computer Science 2022-09-19 Zhenshan Bing , Alexander Koch , Xiangtong Yao , Kai Huang , Alois Knoll

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim

This paper addresses the problem of learning optimal policies for satisfying signal temporal logic (STL) specifications by agents with unknown stochastic dynamics. The system is modeled as a Markov decision process, in which the states…

Systems and Control · Computer Science 2016-09-26 Derya Aksaray , Austin Jones , Zhaodan Kong , Mac Schwager , Calin Belta

Reinforcement Learning (RL) uses rewards to guide learning, yet reward design is typically hand-crafted using heuristics that can be difficult to tune. We propose a Control Barrier Function (CBF)-informed reward design for Multi-Agent RL…

Robotics · Computer Science 2026-05-19 Jianye Xu , Bassam Alrifaee

Signal Temporal Logic (STL) is a powerful specification language for describing complex temporal behaviors of continuous signals, making it well-suited for high-level robotic task descriptions. However, generating executable plans for STL…

Robotics · Computer Science 2025-10-28 Ruijia Liu , Ancheng Hou , Xiao Yu , Xiang Yin

Signal Temporal Logic (STL) robustness is a common objective for optimal robot control, but its dependence on history limits the robot's decision-making capabilities when used in Model Predictive Control (MPC) approaches. In this work, we…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Roland Ilyes , Lara Brudermüller , Nick Hawes , Bruno Lacerda

Time-series data can represent the behaviors of autonomous systems, such as drones and self-driving cars. The task of binary and multi-class classification for time-series data has become a prominent area of research. Neural networks…

Machine Learning · Statistics 2024-06-26 Danyang Li , Roberto Tron

Reward specification is one of the most tricky problems in Reinforcement Learning, which usually requires tedious hand engineering in practice. One promising approach to tackle this challenge is to adopt existing expert video demonstrations…

Artificial Intelligence · Computer Science 2024-11-05 Yuwei Fu , Haichao Zhang , Di Wu , Wei Xu , Benoit Boulet

Model-free reinforcement learning (RL) is a powerful, general tool for learning complex behaviors. However, its sample efficiency is often impractically large for solving challenging real-world problems, even with off-policy algorithms such…

Machine Learning · Computer Science 2020-02-25 Vitchyr Pong , Shixiang Gu , Murtaza Dalal , Sergey Levine

Online monitoring aims to evaluate or to predict, at runtime, whether or not the behaviors of a system satisfy some desired specification. It plays a key role in safety-critical cyber-physical systems. In this work, we propose a new…

Systems and Control · Electrical Eng. & Systems 2023-11-10 Xinyi Yu , Weijie Dong , Xiang Yin , Shaoyuan Li

Large Language Models (LLMs) have shown impressive performance in mathematical reasoning tasks when guided by Chain-of-Thought (CoT) prompting. However, they tend to produce highly confident yet incorrect outputs, which poses significant…

Machine Learning · Computer Science 2025-06-11 Zhenjiang Mao , Artem Bisliouk , Rohith Reddy Nama , Ivan Ruchkin

With the increasing power of computers and the rapid development of self-learning methodologies such as machine learning and artificial intelligence, the problem of constructing an automatic Financial Trading Systems (FTFs) becomes an…

Trading and Market Microstructure · Quantitative Finance 2019-08-29 Haoqian Li , Thomas Lau

Reinforcement Learning (RL) is a powerful method for controlling dynamic systems, but its learning mechanism can lead to unpredictable actions that undermine the safety of critical systems. Here, we propose RL with Adaptive Regularization…

Machine Learning · Computer Science 2024-11-01 Haozhe Tian , Homayoun Hamedmoghadam , Robert Shorten , Pietro Ferraro

Reinforcement learning (RL) has become a foundational approach for enabling intelligent robotic behavior in dynamic and uncertain environments. This work presents an in-depth review of RL principles, advanced deep reinforcement learning…

Robotics · Computer Science 2026-03-17 Kumater Ter , Abolanle Adetifa , Daniel Udekwe

Residual reinforcement learning (RL) has been proposed as a way to solve challenging robotic tasks by adapting control actions from a conventional feedback controller to maximize a reward signal. We extend the residual formulation to learn…

Machine Learning · Computer Science 2021-06-16 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

We consider the problem of steering a system with unknown, stochastic dynamics to satisfy a rich, temporally layered task given as a signal temporal logic formula. We represent the system as a Markov decision process in which the states are…

Systems and Control · Computer Science 2015-10-23 Austin Jones , Derya Aksaray , Zhaodan Kong , Mac Schwager , Calin Belta

This paper delves into designing stabilizing feedback control gains for continuous linear systems with unknown state matrix, in which the control is subject to a general structural constraint. We bring forth the ideas from reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Sayak Mukherjee , Thanh Long Vu

Real-time and human-interpretable decision-making in cyber-physical systems is a significant but challenging task, which usually requires predictions of possible future events from limited data. In this paper, we introduce a…

Machine Learning · Computer Science 2021-12-30 Erfan Aasi , Mingyu Cai , Cristian Ioan Vasile , Calin Belta

This paper proposes a specification-guided framework for control of nonlinear systems with linear temporal logic (LTL) specifications. In contrast with well-known abstraction-based methods, the proposed framework directly characterizes the…

Systems and Control · Electrical Eng. & Systems 2022-05-03 Yinan Li , Zhibing Sun , Jun Liu