English
Related papers

Related papers: Generalization of Compositional Tasks with Logical…

200 papers

The ability to plan with temporal abstractions is central to intelligent decision-making. Rather than reasoning over primitive actions, we study agents that compose pre-trained policies as temporally extended actions, enabling solutions to…

Machine Learning · Computer Science 2026-02-24 Jesse Farebrother , Matteo Pirotta , Andrea Tirinzoni , Marc G. Bellemare , Alessandro Lazaric , Ahmed Touati

Among various branches of offline reinforcement learning (RL) methods, goal-conditioned supervised learning (GCSL) has gained increasing popularity as it formulates the offline RL problem as a sequential modeling task, therefore bypassing…

Machine Learning · Computer Science 2024-12-17 Guan Wang , Haoyi Niu , Jianxiong Li , Li Jiang , Jianming Hu , Xianyuan Zhan

Humanoid robots must master numerous tasks with sparse rewards, posing a challenge for reinforcement learning (RL). We propose a method combining RL and automated planning to address this. Our approach uses short goal-conditioned policies…

Artificial Intelligence · Computer Science 2025-01-06 Gavin B. Rens

Reinforcement Learning (RL) has made significant strides in enabling artificial agents to learn diverse behaviors. However, learning an effective policy often requires a large number of environment interactions. To mitigate sample…

Artificial Intelligence · Computer Science 2024-04-04 Yash Shukla , Tanushree Burman , Abhishek Kulkarni , Robert Wright , Alvaro Velasquez , Jivko Sinapov

While large language models (LLMs) demonstrate strong reasoning capabilities utilizing reinforcement learning (RL) with verifiable reward, whether large vision-language models (VLMs) can directly inherit such capabilities through similar…

Artificial Intelligence · Computer Science 2025-05-27 Tianle Li , Jihai Zhang , Yongming Rao , Yu Cheng

LLMs have shown remarkable proficiency in general language understanding and reasoning. However, they consistently underperform in spatial reasoning that severely limits their application, particularly in embodied intelligence. Inspired by…

Artificial Intelligence · Computer Science 2026-05-28 Yi Wang , Haojie Lu , Zhaofan Zhang , Li Chen , Sihong Xie

We study the problem of control synthesis for multi-agent systems, to achieve complex, high-level, long-term goals that are assigned to each agent individually. As the agents might not be capable of satisfying their respective goals by…

Robotics · Computer Science 2014-03-18 Jana Tumova , Dimos V. Dimarogonas

Offline reinforcement learning enables learning from a fixed dataset, without further interactions with the environment. The lack of environmental interactions makes the policy training vulnerable to state-action pairs far from the training…

Machine Learning · Statistics 2022-10-11 Shentao Yang , Zhendong Wang , Huangjie Zheng , Yihao Feng , Mingyuan Zhou

Rewriting logic is naturally concurrent: several subterms of the state term can be rewritten simultaneously. But state terms are global, which makes compositionality difficult to achieve. Compositionality here means being able to decompose…

Logic in Computer Science · Computer Science 2020-01-31 Óscar Martín , Alberto Verdejo , Narciso Martí-Oliet

We study the problem of plan synthesis for multi-agent systems, to achieve complex, high-level, long-term goals that are assigned to each agent individually. As the agents might not be capable of satisfying their respective goals by…

Systems and Control · Computer Science 2016-10-27 Jana Tumova , Dimos V. Dimarogonas

Large Language Models (LLMs) enable intelligent multi-robot collaboration but face fundamental trade-offs: open-loop methods that compile tasks into formal representations for external executors produce sound plans but lack adaptability in…

Artificial Intelligence · Computer Science 2026-03-10 Shaobin Ling , Yun Wang , Chenyou Fan , Tin Lun Lam , Junjie Hu

Transferring high-level knowledge from a source task to a target task is an effective way to expedite reinforcement learning (RL). For example, propositional logic and first-order logic have been used as representations of such knowledge.…

Artificial Intelligence · Computer Science 2019-09-11 Zhe Xu , Ufuk Topcu

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

Machine Learning · Computer Science 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

We propose a novel planning technique for satisfying tasks specified in temporal logic in partially revealed environments. We define high-level actions derived from the environment and the given task itself, and estimate how each action…

Large language models (LLMs) are commonly adapted for diverse downstream tasks via parameter-efficient fine-tuning techniques such as Low-Rank Adapters (LoRA). While adapters can be combined to handle multiple tasks separately, standard…

Tasks with complex temporal structures and long horizons pose a challenge for reinforcement learning agents due to the difficulty in specifying the tasks in terms of reward functions as well as large variances in the learning signals. We…

Artificial Intelligence · Computer Science 2018-09-27 Xiao Li , Yao Ma , Calin Belta

Offline goal-conditioned reinforcement learning (GCRL) is a practical reinforcement learning paradigm that aims to learn goal-conditioned policies from reward-free offline data. Despite recent advances in hierarchical architectures such as…

Machine Learning · Computer Science 2026-04-13 Zhiqiang Dong , Teng Pang , Rongjian Xu , Guoqiang Wu

Recent advancements in large language models (LLMs) have enabled their use as agents for planning complex tasks. Existing methods typically rely on a thought-action-observation (TAO) process to enhance LLM performance, but these approaches…

Artificial Intelligence · Computer Science 2025-04-18 Zheng Wang , Shu Xian Teo , Jun Jie Chew , Wei Shi

Goal-Conditioned Reinforcement Learning (GCRL) can enable agents to spontaneously set diverse goals to learn a set of skills. Despite the excellent works proposed in various fields, reaching distant goals in temporally extended tasks…

Robotics · Computer Science 2023-07-21 Zhifeng Qian , Mingyu You , Hongjun Zhou , Xuanhui Xu , Bin He

Hierarchical reinforcement learning (HRL) learns to make decisions on multiple levels of temporal abstraction. A key challenge in HRL is that the low-level policy changes over time, making it difficult for the high-level policy to generate…

Machine Learning · Computer Science 2025-05-29 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen