English
Related papers

Related papers: Semantically Labelled Automata for Multi-Task Rein…

200 papers

LCRL is a software tool that implements model-free Reinforcement Learning (RL) algorithms over unknown Markov Decision Processes (MDPs), synthesising policies that satisfy a given linear temporal specification with maximal probability. LCRL…

Machine Learning · Computer Science 2022-09-22 Hosein Hasanbeig , Daniel Kroening , Alessandro Abate

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

Unlike the standard Reinforcement Learning (RL) model, many real-world tasks are non-Markovian, whose rewards are predicated on state history rather than solely on the current state. Solving a non-Markovian task, frequently applied in…

Machine Learning · Computer Science 2023-10-19 Ruixuan Miao , Xu Lu , Cong Tian , Bin Yu , Zhenhua Duan

Ensuring that reinforcement learning (RL) controllers satisfy safety and reliability constraints in real-world settings remains challenging: state-avoidance and constrained Markov decision processes often fail to capture trajectory-level…

Machine Learning · Computer Science 2026-04-06 Alper Kamil Bozkurt , Calin Belta , Ming C. Lin

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

Artificial Intelligence · Computer Science 2024-08-20 Ruiqi Zhang , Jing Hou , Florian Walter , Shangding Gu , Jiayi Guan , Florian Röhrbein , Yali Du , Panpan Cai , Guang Chen , Alois Knoll

Research in robotic planning with temporal logic specifications, such as Linear Temporal Logic (LTL), has relied on single formulas. However, as task complexity increases, LTL formulas become lengthy, making them difficult to interpret and…

Robotics · Computer Science 2025-06-06 Xusheng Luo , Changliu Liu

Reward engineering is an important aspect of reinforcement learning. Whether or not the user's intentions can be correctly encapsulated in the reward function can significantly impact the learning outcome. Current methods rely on manually…

Artificial Intelligence · Computer Science 2017-09-28 Xiao Li , Yao Ma , Calin Belta

Signal temporal logic (STL) is an expressive language to specify time-bound real-world robotic tasks and safety specifications. Recently, there has been an interest in learning optimal policies to satisfy STL specifications via…

Machine Learning · Computer Science 2020-02-19 Harish Venkataraman , Derya Aksaray , Peter Seiler

One of the fundamental challenges in reinforcement learning (RL) is to take a complex task and be able to decompose it to subtasks that are simpler for the RL agent to learn. In this paper, we report on our work that would identify subtasks…

Artificial Intelligence · Computer Science 2024-10-04 Alireza Kheirandish , Duo Xu , Faramarz Fekri

Transfer learning (TL) is a promising way to improve the sample efficiency of reinforcement learning. However, how to efficiently transfer knowledge across tasks with different state-action spaces is investigated at an early stage. Most…

Machine Learning · Computer Science 2021-05-11 Yu Chen , Yingfeng Chen , Zhipeng Hu , Tianpei Yang , Changjie Fan , Yang Yu , Jianye Hao

Linear Temporal Logic (LTL) is a widely used specification framework for linear time properties of systems. The standard approach for verifying such properties is by transforming LTL formulae to suitable $\omega$-automata and then applying…

Formal Languages and Automata Theory · Computer Science 2017-10-19 Martin Sulzmann , Peter Thiemann

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because…

Information Retrieval · Computer Science 2023-03-13 Ziru Liu , Jiejie Tian , Qingpeng Cai , Xiangyu Zhao , Jingtong Gao , Shuchang Liu , Dayou Chen , Tonghao He , Dong Zheng , Peng Jiang , Kun Gai

Most recent successes in robot reinforcement learning involve learning a specialized single-task agent. However, robots capable of performing multiple tasks can be much more valuable in real-world applications. Multi-task reinforcement…

Robotics · Computer Science 2024-07-19 Elie Aljalbout , Nikolaos Sotirakis , Patrick van der Smagt , Maximilian Karl , Nutan Chen

Embodied agents operating in household environments must interpret ambiguous and under-specified human instructions. A capable household robot should recognize ambiguity and ask relevant clarification questions to infer the user intent…

Artificial Intelligence · Computer Science 2025-10-06 Ram Ramrakhya , Matthew Chang , Xavier Puig , Ruta Desai , Zsolt Kira , Roozbeh Mottaghi

Automaton based approaches have enabled robots to perform various complex tasks. However, most existing automaton based algorithms highly rely on the manually customized representation of states for the considered task, limiting its…

Robotics · Computer Science 2023-07-18 Hao Zhang , Hao Wang , Zhen Kan

Natural Language-conditioned reinforcement learning (RL) enables the agents to follow human instructions. Previous approaches generally implemented language-conditioned RL by providing human instructions in natural language (NL) and…

Computation and Language · Computer Science 2023-02-21 Jing-Cheng Pang , Xin-Yu Yang , Si-Hang Yang , Yang Yu

Solving long-horizon, temporally-extended tasks using Reinforcement Learning (RL) is challenging, compounded by the common practice of learning without prior knowledge (or tabula rasa learning). Humans can generate and execute plans with…

Machine Learning · Computer Science 2023-11-10 Bharat Prakash , Tim Oates , Tinoosh Mohsenin

While the complexity of translating future linear temporal logic (LTL) into automata on infinite words is well-understood, the size increase involved in turning automata back to LTL is not. In particular, there is no known elementary bound…

Formal Languages and Automata Theory · Computer Science 2022-05-10 Udi Boker , Karoliina Lehtinen , Salomon Sickert

Skills learned through (deep) reinforcement learning often generalizes poorly across domains and re-training is necessary when presented with a new task. We present a framework that combines techniques in \textit{formal methods} with…

Artificial Intelligence · Computer Science 2018-05-22 Xiao Li , Yao Ma , Calin Belta

This paper investigates the problem of designing control policies that satisfy high-level specifications described by signal temporal logic (STL) in unknown, stochastic environments. While many existing works concentrate on optimizing the…

Systems and Control · Electrical Eng. & Systems 2024-12-16 Siqi Wang , Shaoyuan Li , Li Yin , Xiang Yin