English
Related papers

Related papers: Explaining Multi-stage Tasks by Learning Temporal …

200 papers

Learning-from-demonstrations is an emerging paradigm to obtain effective robot control policies for complex tasks via reinforcement learning without the need to explicitly design reward functions. However, it is susceptible to imperfections…

Robotics · Computer Science 2021-02-16 Aniruddh G. Puranic , Jyotirmoy V. Deshmukh , Stefanos Nikolaidis

Reinforcement learning has been applied to many interesting problems such as the famous TD-gammon and the inverted helicopter flight. However, little effort has been put into developing methods to learn policies for complex persistent tasks…

Artificial Intelligence · Computer Science 2016-06-22 Xiao Li , Calin Belta

We develop an algorithm for the motion and task planning of a system comprised of multiple robots and unactuated objects under tasks expressed as Linear Temporal Logic (LTL) constraints. The robots and objects evolve subject to uncertain…

Systems and Control · Electrical Eng. & Systems 2022-04-26 Christos K. Verginis , Yiannis Kantaros , Dimos V. Dimarogonas

Linear temporal logic (LTL) is a specification language for finite sequences (called traces) widely used in program verification, motion planning in robotics, process mining, and many other areas. We consider the problem of learning LTL…

Artificial Intelligence · Computer Science 2026-01-22 Ritam Raha , Rajarshi Roy , Nathanaël Fijalkow , Daniel Neider

Recent work has addressed using formulas in linear temporal logic (LTL) as specifications for agents planning in Markov Decision Processes (MDPs). We consider the inverse problem: inferring an LTL specification from demonstrated behavior…

Systems and Control · Computer Science 2017-11-02 Daniel Kasenberg , Matthias Scheutz

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

Tasks with complex temporal structures and long horizons pose a challenge for reinforcement learning agents due to the difficulty in specifying the tasks in terms of reward functions as well as large variances in the learning signals. We…

Artificial Intelligence · Computer Science 2018-09-27 Xiao Li , Yao Ma , Calin Belta

We study instruction following in multi-task reinforcement learning, where an agent must zero-shot execute novel tasks not seen during training. In this setting, linear temporal logic (LTL) has recently been adopted as a powerful framework…

Machine Learning · Computer Science 2026-02-17 Mathias Jackermeier , Mattia Giuri , Jacques Cloete , Alessandro Abate

Multi-Task Learning (MTL) can enhance a classifier's generalization performance by learning multiple related tasks simultaneously. Conventional MTL works under the offline or batch setting, and suffers from expensive training cost and poor…

Machine Learning · Computer Science 2017-06-28 Peng Yang , Peilin Zhao , Xin Gao

Learning from Demonstration (LfD) is a popular approach for robots to acquire new skills, but most LfD methods suffer from imperfections in human demonstrations. Prior work typically treats these suboptimalities as random noise. In this…

Robotics · Computer Science 2025-12-18 Shijie Fang , Hang Yu , Qidi Fang , Reuben M. Aronson , Elaine S. Short

Past research into robotic planning with temporal logic specifications, notably Linear Temporal Logic (LTL), was largely based on a single formula for individual or groups of robots. But with increasing task complexity, LTL formulas…

Robotics · Computer Science 2024-05-27 Xusheng Luo , Shaojun Xu , Ruixuan Liu , Changliu Liu

Signal Temporal Logic (STL) is an efficient technique for describing temporal constraints. It can play a significant role in robotic manipulation, for example, to optimize the robot performance according to task-dependent metrics. In this…

Robotics · Computer Science 2021-10-04 Akshay Dhonthi , Philipp Schillinger , Leonel Rozo , Daniele Nardi

Automating robotic surgery via learning from demonstration (LfD) techniques is extremely challenging. This is because surgical tasks often involve sequential decision-making processes with complex interactions of physical objects and have…

Robotics · Computer Science 2024-10-11 Zohre Karimi , Shing-Hei Ho , Bao Thach , Alan Kuntz , Daniel S. Brown

This paper presents an incremental replanning algorithm, dubbed LTL-D*, for temporal-logic-based task planning in a dynamically changing environment. Unexpected changes in the environment may lead to failures in satisfying a task…

Robotics · Computer Science 2024-04-02 Jiming Ren , Haris Miller , Karen M. Feigh , Samuel Coogan , Ye Zhao

We consider the problem of learning temporal logic formulas from examples of system behavior. Learning temporal properties has crystallized as an effective mean to explain complex temporal behaviors. Several efficient algorithms have been…

Logic in Computer Science · Computer Science 2024-08-09 Benjamin Bordais , Daniel Neider , Rajarshi Roy

There has been substantial progress in the inference of formal behavioural specifications from sample trajectories, for example, using Linear Temporal Logic (LTL). However, these techniques cannot handle specifications that correctly…

Logic in Computer Science · Computer Science 2025-05-20 Rajarshi Roy , Yash Pote , David Parker , Marta Kwiatkowska

Automaton based approaches have enabled robots to perform various complex tasks. However, most existing automaton based algorithms highly rely on the manually customized representation of states for the considered task, limiting its…

Robotics · Computer Science 2023-07-18 Hao Zhang , Hao Wang , Zhen Kan

We address the problem of learning temporal properties from the branching-time behavior of systems. Existing research in this field has mostly focused on learning linear temporal properties specified using popular logics, such as Linear…

Logic in Computer Science · Computer Science 2024-07-01 Benjamin Bordais , Daniel Neider , Rajarshi Roy

We present a reinforcement learning (RL) framework to synthesize a control policy from a given linear temporal logic (LTL) specification in an unknown stochastic environment that can be modeled as a Markov Decision Process (MDP).…

Robotics · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Michael M. Zavlanos , Miroslav Pajic

We address the problem of learning human-interpretable descriptions of a complex system from a finite set of positive and negative examples of its behavior. In contrast to most of the recent work in this area, which focuses on descriptions…

Machine Learning · Computer Science 2020-02-11 Rajarshi Roy , Dana Fisman , Daniel Neider