中文
相关论文

相关论文: Explaining Multi-stage Tasks by Learning Temporal …

200 篇论文

We present a method to find an optimal policy with respect to a reward function for a discounted Markov decision process under general linear temporal logic (LTL) specifications. Previous work has either focused on maximizing a cumulative…

系统与控制 · 电气工程与系统科学 2021-03-24 Krishna C. Kalagarla , Rahul Jain , Pierluigi Nuzzo

We investigate the problem of optimal control synthesis for Markov Decision Processes (MDPs), addressing both qualitative and quantitative objectives. Specifically, we require the system to satisfy a qualitative task specified by a Linear…

系统与控制 · 电气工程与系统科学 2025-09-19 Yu Chen , Xuanyuan Yin , Shaoyuan Li , Xiang Yin

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

机器人学 · 计算机科学 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

This work studies the planning problem for robotic systems under both quantifiable and unquantifiable uncertainty. The objective is to enable the robotic systems to optimally fulfill high-level tasks specified by Linear Temporal Logic (LTL)…

机器人学 · 计算机科学 2025-02-28 Pian Yu , Yong Li , David Parker , Marta Kwiatkowska

Multi-robot task allocation in construction automation has traditionally relied on optimization methods such as Dynamic Programming and Reinforcement Learning. This research introduces the LangGraph-based Task Allocation Agent (LTAA), an…

机器人学 · 计算机科学 2025-12-03 Shyam prasad reddy Kaitha , Hongrui Yu

Synthesis from linear temporal logic (LTL) specifications provides assured controllers for systems operating in stochastic and potentially adversarial environments. Automatic synthesis tools, however, require a model of the environment to…

人工智能 · 计算机科学 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Michael M. Zavlanos , Miroslav Pajic

We present a novel method for imitation learning for control requirements expressed using Signal Temporal Logic (STL). More concretely we focus on the problem of training a neural network to imitate a complex controller. The learning…

机器人学 · 计算机科学 2024-03-26 Thao Dang , Alexandre Donzé , Inzemamul Haque , Nikolaos Kekatos , Indranil Saha

Transferring high-level knowledge from a source task to a target task is an effective way to expedite reinforcement learning (RL). For example, propositional logic and first-order logic have been used as representations of such knowledge.…

人工智能 · 计算机科学 2019-09-11 Zhe Xu , Ufuk Topcu

Linear Temporal Logic (LTL) is a formal way of specifying complex objectives for planning problems modeled as Markov Decision Processes (MDPs). The planning problem aims to find the optimal policy that maximizes the satisfaction probability…

机器人学 · 计算机科学 2024-08-13 Zetong Xuan , Yu Wang

This paper studies satisfaction of temporal properties on unknown stochastic processes that have continuous state spaces. We show how reinforcement learning (RL) can be applied for computing policies that are finite-memory and deterministic…

系统与控制 · 电气工程与系统科学 2020-09-29 Milad Kazemi , Sadegh Soudjani

Multi-task learning (MTL) has been widely adopted for its ability to simultaneously learn multiple tasks. While existing gradient manipulation methods often yield more balanced solutions than simple scalarization-based approaches, they…

机器学习 · 计算机科学 2025-09-29 Peiyao Xiao , Chaosheng Dong , Shaofeng Zou , Kaiyi Ji

Signal Temporal Logic (STL) is widely used to specify timed and safety-critical tasks for cyber-physical systems, but writing STL formulas directly is difficult for non-expert users. Natural language (NL) provides a convenient interface,…

计算与语言 · 计算机科学 2026-03-31 Kosei Fushimi , Kazunobu Serizawa , Junya Ikemoto , Kazumune Hashimoto

We consider the problem of steering a system with unknown, stochastic dynamics to satisfy a rich, temporally layered task given as a signal temporal logic formula. We represent the system as a Markov decision process in which the states are…

系统与控制 · 计算机科学 2015-10-23 Austin Jones , Derya Aksaray , Zhaodan Kong , Mac Schwager , Calin Belta

Linear Temporal Logic (LTL) is a widely used task specification language for autonomous systems. To mitigate the significant manual effort and expertise required to define LTL-encoded tasks, several methods have been proposed for…

计算与语言 · 计算机科学 2026-02-23 David Smith Sundarsingh , Jun Wang , Jyotirmoy V. Deshmukh , Yiannis Kantaros

In a multi-task learning (MTL) setting, a single model is trained to tackle a diverse set of tasks jointly. Despite rapid progress in the field, MTL remains challenging due to optimization issues such as conflicting and dominating…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Dmitry Senushkin , Nikolay Patakin , Arseny Kuznetsov , Anton Konushin

Learning from Demonstrations (LfD) allows robots to learn skills from human users, but its effectiveness can suffer due to sub-optimal teaching, especially from untrained demonstrators. Active LfD aims to improve this by letting robots…

机器人学 · 计算机科学 2025-03-05 Muhan Hou , Koen Hindriks , A. E. Eiben , Kim Baraka

Natural language is an intuitive way for humans to communicate tasks to a robot. While natural language (NL) is ambiguous, real world tasks and their safety requirements need to be communicated unambiguously. Signal Temporal Logic (STL) is…

形式语言与自动机理论 · 计算机科学 2022-07-05 Sara Mohammadinejad , Jesse Thomason , Jyotirmoy V. Deshmukh

Reinforcement Learning (RL) is a widely employed machine learning architecture that has been applied to a variety of control problems. However, applications in safety-critical domains require a systematic and formal approach to specifying…

机器学习 · 计算机科学 2023-06-07 Hosein Hasanbeig , Daniel Kroening , Alessandro Abate

Teaching a deep reinforcement learning (RL) agent to follow instructions in multi-task environments is a challenging problem. We consider that user defines every task by a linear temporal logic (LTL) formula. However, some causal…

机器人学 · 计算机科学 2022-07-14 Duo Xu , Faramarz Fekri

Chain-of-Thought (CoT) prompting has emerged as a powerful approach to enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing implementations, such as in-context learning and fine-tuning, remain costly and…

计算与语言 · 计算机科学 2025-10-02 Li Li , Ziyi Wang , Yongliang Wu , Jianfei Cai , Xu Yang