English
Related papers

Related papers: Auto-Dreamer: Learning Offline Memory Consolidatio…

200 papers

Continuous offline reinforcement learning (CORL) combines continuous and offline reinforcement learning, enabling agents to learn multiple tasks from static datasets without forgetting prior tasks. However, CORL faces challenges in…

Machine Learning · Computer Science 2024-04-09 Kaixin Huang , Li Shen , Chen Zhao , Chun Yuan , Dacheng Tao

Continual RL requires an agent to learn new tasks without forgetting previous ones, while improving on both past and future tasks. The most common approaches use model-free algorithms and replay buffers can help to mitigate catastrophic…

Machine Learning · Computer Science 2024-07-17 Luke Yang , Levin Kuhlmann , Gideon Kowadlo

Online continual learning aims to learn from a non-IID stream of data from a number of different tasks, where the learner is only allowed to consider data once. Methods are typically allowed to use a limited buffer to store some of the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Kai Wang , Luis Herranz , Joost van de Weijer

The recent advancement of autonomous agents powered by Large Language Models (LLMs) has demonstrated significant potential for automating tasks on mobile devices through graphical user interfaces (GUIs). Despite initial progress, these…

Human-Computer Interaction · Computer Science 2025-07-30 Yi Kong , Dianxi Shi , Guoli Yang , Zhang ke-di , Chenlin Huang , Xiaopeng Li , Songchang Jin

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

Inspired by a personal dream about knowledge-sharing barriers in an everyday hardware project, this paper proposes a Jung-inspired "Dream Layer" for LLM companions, reframing controlled offline hallucinations as a resource for learning and…

Artificial Intelligence · Computer Science 2026-01-13 V. Cheung

Most multi-agent systems rely exclusively on autoregressive language models (ARMs) that are based on sequential generation. Although effective for fluent text, ARMs limit global reasoning and plan revision. On the other hand, Discrete…

Machine Learning · Computer Science 2026-03-11 Lina Berrayana , Ahmed Heakl , Abdullah Sohail , Thomas Hofmann , Salman Khan , Wei Chen

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching…

Machine Learning · Computer Science 2023-09-14 Siddarth Venkatraman , Shivesh Khaitan , Ravi Tej Akella , John Dolan , Jeff Schneider , Glen Berseth

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Artificial Intelligence · Computer Science 2026-03-20 Thomas Palmeira Ferraz , Romain Deffayet , Vassilina Nikoulina , Hervé Déjean , Stéphane Clinchant

Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role…

Artificial Intelligence · Computer Science 2026-01-13 Sizhe Yuen , Francisco Gomez Medina , Ting Su , Yali Du , Adam J. Sobey

As learning-based robotic controllers are typically trained offline and deployed with fixed parameters, their ability to cope with unforeseen changes during operation is limited. Biologically inspired, this work presents a framework for…

Robotics · Computer Science 2026-03-05 Fabian Domberg , Georg Schildbach

The pursuit of autonomous agents capable of temporally coherent planning is hindered by a fundamental flaw in current vision-language models (VLMs): they lack cognitive inertia. Operating on isolated snapshots, these models cannot form a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Pei Liu , Qingtian Ning , Xinyan Lu , Haipeng Liu , Weiliang Ma , Dangen She , Peng Jia , Xianpeng Lang , Jun Ma

We introduce Scenario Dreamer, a fully data-driven generative simulator for autonomous vehicle planning that generates both the initial traffic scene - comprising a lane graph and agent bounding boxes - and closed-loop agent behaviours.…

Robotics · Computer Science 2025-03-31 Luke Rowe , Roger Girgis , Anthony Gosselin , Liam Paull , Christopher Pal , Felix Heide

In this work we apply deep reinforcement learning to the problems of navigating a three-dimensional environment and inferring the locations of human speaker audio sources within, in the case where the only available information is the raw…

Sound · Computer Science 2021-11-30 Petros Giannakopoulos , Aggelos Pikrakis , Yannis Cotronis

Augmented Reality (AR) systems are increasingly integrating foundation models, such as Multimodal Large Language Models (MLLMs), to provide more context-aware and adaptive user experiences. This integration has led to the development of AR…

Artificial Intelligence · Computer Science 2025-08-13 Dongwook Choi , Taeyoon Kwon , Dongil Yang , Hyojun Kim , Jinyoung Yeo

Recent advancements in large language models (LLMs) have enabled understanding webpage contexts, product details, and human instructions. Utilizing LLMs as the foundational architecture for either reward models or policies in reinforcement…

Machine Learning · Computer Science 2024-08-30 Shuang Feng , Grace Feng

Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations such as blur, noise, rain, and compression artifacts. Recent restoration agents, powered by vision-language models and large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jianglin Lu , Yuanwei Wu , Ziyi Zhao , Hongcheng Wang , Felix Jimenez , Abrar Majeedi , Yun Fu

In this work, we propose several online methods to build a \emph{learning curriculum} from a given set of target-task-specific training tasks in order to speed up reinforcement learning (RL). These methods can decrease the total training…

Machine Learning · Computer Science 2017-11-22 Vikas Jain , Theja Tulabandhula

Long-horizon agentic reasoning requires large language models to act over long interaction histories containing thoughts, tool calls, observations, and partial conclusions. The challenge is not merely that these histories grow long, but…

Artificial Intelligence · Computer Science 2026-05-26 Yuyang Hu , Hongjin Qian , Shuting Wang , Jiongnan Liu , Ziliang Zhao , Jiejun Tan , Zheng Liu , Zhicheng Dou

It is desirable for an agent to be able to solve a rich variety of problems that can be specified through language in the same environment. A popular approach towards obtaining such agents is to reuse skills learned in prior tasks to…

Machine Learning · Computer Science 2024-03-19 Geraud Nangue Tasse , Devon Jarvis , Steven James , Benjamin Rosman