English
Related papers

Related papers: Explaining Multi-stage Tasks by Learning Temporal …

200 papers

This paper investigates whether recent advances in Large Language Models (LLMs) can assist in translating human explanations into a format that can robustly support learning Linear Temporal Logic (LTL) from demonstrations. Both LLMs and…

Artificial Intelligence · Computer Science 2024-04-04 Ashutosh Gupta , John Komp , Abhay Singh Rajput , Krishna Shankaranarayanan , Ashutosh Trivedi , Namrita Varshney

The successes of reinforcement learning in recent years are underpinned by the characterization of suitable reward functions. However, in settings where such rewards are non-intuitive, difficult to define, or otherwise error-prone in their…

Formal Languages and Automata Theory · Computer Science 2023-03-02 Mohammad Afzal , Sankalp Gambhir , Ashutosh Gupta , Krishna S , Ashutosh Trivedi , Alvaro Velasquez

Autonomous agents often face the challenge of interpreting uncertain natural language instructions for planning tasks. Representing these instructions as Linear Temporal Logic (LTL) enables planners to synthesize actionable plans. We…

Robotics · Computer Science 2025-09-30 Kumar Manas , Stefan Zwicklbauer , Adrian Paschke

Autonomous systems increasingly rely on human feedback to align their behavior, expressed as pairwise comparisons, rankings, or demonstrations. While existing methods can adapt behaviors, they often fail to guarantee safety in…

Robotics · Computer Science 2026-03-12 Ruya Karagulle , Cristian-Ioan Vasile , Necmiye Ozay

Learning from Demonstration (LfD) seeks to democratize robotics by enabling non-roboticist end-users to teach robots to perform a task by providing a human demonstration. However, modern LfD techniques, e.g. inverse reinforcement learning…

Robotics · Computer Science 2020-11-24 Letian Chen , Rohan Paleja , Matthew Gombolay

In this paper, we propose a model-free reinforcement learning method to synthesize control policies for motion planning problems with continuous states and actions. The robot is modelled as a labeled discrete-time Markov decision process…

Artificial Intelligence · Computer Science 2020-10-01 Chuanzheng Wang , Yinan Li , Stephen L. Smith , Jun Liu

In this paper, we present an optimization based method for path planning of a mobile robot subject to time bounded temporal constraints, in a dynamic environment. Temporal logic (TL) can address very complex task specification such as…

Systems and Control · Computer Science 2016-04-29 Yuchen Zhou , Dipankar Maity , John S. Baras

This paper addresses the problem of designing control policies for agents with unknown stochastic dynamics and control objectives specified using Linear Temporal Logic (LTL). Recent Deep Reinforcement Learning (DRL) algorithms have aimed to…

Robotics · Computer Science 2025-04-23 Jun Wang , Hosein Hasanbeig , Kaiyuan Tan , Zihe Sun , Yiannis Kantaros

To make robots accessible to a broad audience, it is critical to endow them with the ability to take universal modes of communication, like commands given in natural language, and extract a concrete desired task specification, defined using…

Computation and Language · Computer Science 2023-03-22 Jiayi Pan , Glen Chou , Dmitry Berenson

In this paper we initiate the study of the computational complexity of learning linear temporal logic (LTL) formulas from examples. We construct approximation algorithms for fragments of LTL and prove hardness results; in particular we…

Formal Languages and Automata Theory · Computer Science 2021-02-02 Nathanaël Fijalkow , Guillaume Lagarde

Learning robot control policies from demonstrations is a powerful paradigm, yet real-world data is often suboptimal, noisy, or otherwise imperfect, posing significant challenges for imitation and reinforcement learning. In this work, we…

Machine Learning · Computer Science 2026-04-07 Aniruddh G. Puranic , Sebastian Schirmer , John S. Baras , Calin Belta

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each…

Machine Learning · Computer Science 2018-08-13 Kyriacos Shiarlis , Markus Wulfmeier , Sasha Salter , Shimon Whiteson , Ingmar Posner

Temporal logic specifications play an important role in a wide range of software analysis tasks, such as model checking, automated synthesis, program comprehension, and runtime monitoring. Given a set of positive and negative examples,…

Software Engineering · Computer Science 2025-01-03 Changjian Zhang , Parv Kapoor , Ian Dardik , Leyi Cui , Romulo Meira-Goes , David Garlan , Eunsuk Kang

Multi-agent hierarchical reinforcement learning (MAHRL) has been studied as an effective means to solve intelligent decision problems in complex and large-scale environments. However, most current MAHRL algorithms follow the traditional way…

Artificial Intelligence · Computer Science 2024-11-05 Chanjuan Liu , Jinmiao Cong , Bingcai Chen , Yaochu Jin , Enqiang Zhu

In this paper, we consider the automated planning of optimal paths for a robotic team satisfying a high level mission specification. Each robot in the team is modeled as a weighted transition system where the weights have associated…

Robotics · Computer Science 2015-03-13 Alphan Ulusoy , Stephen L. Smith , Calin Belta

Learning linear temporal logic (LTL) formulas from examples labeled as positive or negative has found applications in inferring descriptions of system behavior. We summarize two methods to learn LTL formulas from examples in two different…

Logic in Computer Science · Computer Science 2022-12-05 Jean-Raphaël Gaglione , Rajarshi Roy , Nasim Baharisangari , Daniel Neider , Zhe Xu , Ufuk Topcu

Linear Temporal Logic (LTL) offers a precise means for constraining the behavior of reinforcement learning agents. However, in many settings where both satisfaction and optimality conditions are present, LTL is insufficient to capture both.…

Machine Learning · Computer Science 2025-03-26 Ameesh Shah , Cameron Voloshin , Chenxi Yang , Abhinav Verma , Swarat Chaudhuri , Sanjit A. Seshia

Learning formulas in Linear Temporal Logic (LTLf) from finite traces is a fundamental research problem which has found applications in artificial intelligence, software engineering, programming languages, formal methods, control of…

Artificial Intelligence · Computer Science 2026-01-14 Gabriel Bathie , Nathanaël Fijalkow , Théo Matricon , Baptiste Mouillon , Pierre Vandenhove

Multi-task learning (MTL) has emerged as a pivotal paradigm in machine learning by leveraging shared structures across multiple related tasks. Despite its empirical success, the development of likelihood-based efficiently solvable…

Machine Learning · Computer Science 2026-05-07 Shihong Ding , Fangyu Du , Cong Fang

This paper addresses the problem of learning control policies for mobile robots, modeled as unknown Markov Decision Processes (MDPs), that are tasked with temporal logic missions, such as sequencing, coverage, or surveillance. The MDP…

Robotics · Computer Science 2022-07-13 Yiannis Kantaros