English
Related papers

Related papers: Generalizing LTL Instructions via Future Dependent…

200 papers

We address the problem of teaching a deep reinforcement learning (RL) agent to follow instructions in multi-task environments. Instructions are expressed in a well-known formal language -- linear temporal logic (LTL) -- and can specify a…

Artificial Intelligence · Computer Science 2021-07-07 Pashootan Vaezipoor , Andrew Li , Rodrigo Toro Icarte , Sheila McIlraith

Linear temporal logic (LTL) is a compelling framework for specifying complex, structured tasks for reinforcement learning (RL) agents. Recent work has shown that interpreting LTL instructions as finite automata, which can be seen as…

Artificial Intelligence · Computer Science 2025-12-03 Mattia Giuri , Mathias Jackermeier , Alessandro Abate

Linear temporal logic (LTL) has recently been adopted as a powerful formalism for specifying complex, temporally extended tasks in multi-task reinforcement learning (RL). However, learning policies that efficiently satisfy arbitrary…

Artificial Intelligence · Computer Science 2025-04-01 Mathias Jackermeier , Alessandro Abate

We study instruction following in multi-task reinforcement learning, where an agent must zero-shot execute novel tasks not seen during training. In this setting, linear temporal logic (LTL) has recently been adopted as a powerful framework…

Machine Learning · Computer Science 2026-02-17 Mathias Jackermeier , Mattia Giuri , Jacques Cloete , Alessandro Abate

Generalizing to complex and temporally extended task objectives and safety constraints remains a critical challenge in reinforcement learning (RL). Linear temporal logic (LTL) offers a unified formalism to specify such requirements, yet…

Artificial Intelligence · Computer Science 2025-11-11 Zijian Guo , İlker Işık , H. M. Sabbir Ahmad , Wenchao Li

Techniques based on Reinforcement Learning (RL) are increasingly being used to design control policies for robotic systems. RL fundamentally relies on state-based reward functions to encode desired behavior of the robot and bad reward…

Robotics · Computer Science 2020-11-11 Parv Kapoor , Anand Balakrishnan , Jyotirmoy V. Deshmukh

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively…

Artificial Intelligence · Computer Science 2017-03-03 Xiao Li , Cristian-Ioan Vasile , Calin Belta

A central challenge in multi-task reinforcement learning (RL) is to train generalist policies capable of performing tasks not seen during training. To facilitate such generalization, linear temporal logic (LTL) has emerged as a powerful…

Machine Learning · Computer Science 2026-05-08 Jacques Cloete , Mathias Jackermeier , Ioannis Havoutis , Alessandro Abate

We study the problem of policy optimization (PO) with linear temporal logic (LTL) constraints. The language of LTL allows flexible description of tasks that may be unnatural to encode as a scalar cost function. We consider LTL-constrained…

Machine Learning · Computer Science 2022-10-21 Cameron Voloshin , Hoang M. Le , Swarat Chaudhuri , Yisong Yue

Linear Temporal Logic (LTL) is a widely used task specification language for autonomous systems. To mitigate the significant manual effort and expertise required to define LTL-encoded tasks, several methods have been proposed for…

Computation and Language · Computer Science 2026-02-23 David Smith Sundarsingh , Jun Wang , Jyotirmoy V. Deshmukh , Yiannis Kantaros

To make robots accessible to a broad audience, it is critical to endow them with the ability to take universal modes of communication, like commands given in natural language, and extract a concrete desired task specification, defined using…

Computation and Language · Computer Science 2023-03-22 Jiayi Pan , Glen Chou , Dmitry Berenson

There is a surge of interest in using formal languages such as Linear Temporal Logic (LTL) to precisely and succinctly specify complex tasks and derive reward functions for Reinforcement Learning (RL). However, existing methods often assign…

Robotics · Computer Science 2025-05-20 Minjae Kwon , Ingy ElSayed-Aly , Lu Feng

We study multi-task reinforcement learning (RL), a setting in which an agent learns a single, universal policy capable of generalising to arbitrary, possibly unseen tasks. We consider tasks specified as linear temporal logic (LTL) formulae,…

Artificial Intelligence · Computer Science 2026-02-09 Alessandro Abate , Giuseppe De Giacomo , Mathias Jackermeier , Jan Kretínský , Maximilian Prokop , Christoph Weinhuber

In this work we address the problem of training a Reinforcement Learning agent to follow multiple temporally-extended instructions expressed in Linear Temporal Logic in sub-symbolic environments. Previous multi-task work has mostly relied…

Machine Learning · Computer Science 2026-02-11 Matteo Pannacci , Andrea Fanti , Elena Umili , Roberto Capobianco

Learning control policies for complex, long-horizon tasks is a central challenge in robotics and autonomous systems. Signal Temporal Logic (STL) offers a powerful and expressive language for specifying such tasks, but its non-Markovian…

Robotics · Computer Science 2025-10-02 Yue Meng , Fei Chen , Chuchu Fan

This paper presents a model-free reinforcement learning (RL) algorithm to synthesize a control policy that maximizes the satisfaction probability of linear temporal logic (LTL) specifications. Due to the consideration of environment and…

Formal Languages and Automata Theory · Computer Science 2022-01-04 Mingyu Cai , Shaoping Xiao , Baoluo Li , Zhiliang Li , Zhen Kan

We present a method for learning multi-stage tasks from demonstrations by learning the logical structure and atomic propositions of a consistent linear temporal logic (LTL) formula. The learner is given successful but potentially suboptimal…

Robotics · Computer Science 2020-06-04 Glen Chou , Necmiye Ozay , Dmitry Berenson

In this paper we present a method for automatically planning robust optimal paths for a group of robots that satisfy a common high level mission specification. Each robot's motion in the environment is modeled as a weighted transition…

Robotics · Computer Science 2015-03-13 Alphan Ulusoy , Stephen L. Smith , Xu Chu Ding , Calin Belta

Linear temporal logic (LTL) is a specification language for finite sequences (called traces) widely used in program verification, motion planning in robotics, process mining, and many other areas. We consider the problem of learning LTL…

Artificial Intelligence · Computer Science 2026-01-22 Ritam Raha , Rajarshi Roy , Nathanaël Fijalkow , Daniel Neider

Offline reinforcement learning (RL) enables policy learning from pre-collected datasets, avoiding costly and risky online interactions, but it often struggles with long-horizon tasks involving sparse rewards. Existing goal-conditioned and…

Machine Learning · Computer Science 2026-01-14 Chengyang Gu , Yuxin Pan , Hui Xiong , Yize Chen
‹ Prev 1 2 3 10 Next ›