English
Related papers

Related papers: Mastering Memory Tasks with World Models

200 papers

Large Language Models (LLMs) were shown to struggle with long-term planning, which may be caused by the limited way in which they explore the space of possible solutions. We propose an architecture where a Reinforcement Learning (RL) Agent…

Machine Learning · Computer Science 2024-10-18 Yoav Alon , Cristina David

Reinforcement Learning (RL) has made significant strides in complex tasks but struggles in multi-task settings with different embodiments. World model methods offer scalability by learning a simulation of the environment but often rely on…

Machine Learning · Computer Science 2025-02-25 Ignat Georgiev , Varun Giridhar , Nicklas Hansen , Animesh Garg

Enhancing the temporal understanding of Multimodal Large Language Models (MLLMs) is essential for advancing long-form video analysis, enabling tasks such as temporal localization, action detection, and time-sensitive question answering.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tao Wu , Li Yang , Gen Zhan , Yabin Zhang , Yiting Liao , Junlin Li , Deliang Fu , Li Zhang , Limin Wang

Video diffusion models have recently shown promise for world modeling through autoregressive frame prediction conditioned on actions. However, they struggle to maintain long-term memory due to the high computational cost associated with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ryan Po , Yotam Nitzan , Richard Zhang , Berlin Chen , Tri Dao , Eli Shechtman , Gordon Wetzstein , Xun Huang

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

Machine Learning · Computer Science 2021-02-04 Mirza Ramicic , Andrea Bonarini

Sample efficiency has been one of the major challenges for deep reinforcement learning. Recently, model-based reinforcement learning has been proposed to address this challenge by performing planning on imaginary trajectories with a learned…

Machine Learning · Computer Science 2020-10-26 Guangxiang Zhu , Minghao Zhang , Honglak Lee , Chongjie Zhang

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

Machine Learning · Computer Science 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

Computation and Language · Computer Science 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

Recent advancements in Multimodal Large Language Models (MLLMs), particularly through Reinforcement Learning with Verifiable Rewards (RLVR), have significantly enhanced their reasoning abilities. However, a critical gap persists: these…

Artificial Intelligence · Computer Science 2025-07-14 Inclusion AI , : , Fudong Wang , Jiajia Liu , Jingdong Chen , Jun Zhou , Kaixiang Ji , Lixiang Ru , Qingpei Guo , Ruobing Zheng , Tianqi Li , Yi Yuan , Yifan Mao , Yuting Xiao , Ziping Ma

Recent studies have demonstrated the effectiveness of LLM test-time scaling. However, existing approaches to incentivize LLMs' deep thinking abilities generally require large-scale data or significant training efforts. Meanwhile, it remains…

Computation and Language · Computer Science 2025-02-19 Ruotian Ma , Peisong Wang , Cheng Liu , Xingyan Liu , Jiaqi Chen , Bang Zhang , Xin Zhou , Nan Du , Jia Li

Humans excel at performing complex tasks by leveraging long-term memory across temporal and spatial experiences. In contrast, current Large Language Models (LLMs) struggle to effectively plan and act in dynamic, multi-room 3D environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wenbo Hu , Yining Hong , Yanjun Wang , Leison Gao , Zibu Wei , Xingcheng Yao , Nanyun Peng , Yonatan Bitton , Idan Szpektor , Kai-Wei Chang

Reinforcement Learning (RL) has achieved significant success in application domains such as robotics, games and health care. However, training RL agents is very time consuming. Current implementations exhibit poor performance due to…

Machine Learning · Computer Science 2021-12-24 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

Reinforcement Learning is a mature technology, often suggested as a potential route towards Artificial General Intelligence, with the ambitious goal of replicating the wide range of abilities found in natural and artificial intelligence,…

Machine Learning · Computer Science 2025-11-25 Markus D. Solbach , John K. Tsotsos

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

Machine Learning · Computer Science 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Parallel thinking has emerged as a novel approach for enhancing the reasoning capabilities of large language models (LLMs) by exploring multiple reasoning paths concurrently. However, activating such capabilities through training remains…

Computation and Language · Computer Science 2025-09-15 Tong Zheng , Hongming Zhang , Wenhao Yu , Xiaoyang Wang , Runpeng Dai , Rui Liu , Huiwen Bao , Chengsong Huang , Heng Huang , Dong Yu

Large language model (LLM)-based agents have shown strong potential in multi-task scenarios, owing to their ability to transfer knowledge across diverse tasks. However, existing approaches often treat prior experiences and knowledge as…

Artificial Intelligence · Computer Science 2025-09-17 Shicheng Ye , Chao Yu , Kaiqiang Ke , Chengdong Xu , Yinqi Wei

Large language models face challenges in long-context question answering, where key evidence of a query may be dispersed across millions of tokens. Existing works equip large language models with a memory buffer that is dynamically updated…

Computation and Language · Computer Science 2026-03-03 Yaorui Shi , Yuxin Chen , Siyuan Wang , Sihang Li , Hengxing Cai , Qi Gu , Xiang Wang , An Zhang

State-of-the-art meta reinforcement learning algorithms typically assume the setting of a single agent interacting with its environment in a sequential manner. A negative side-effect of this sequential execution paradigm is that, as the…

Artificial Intelligence · Computer Science 2019-03-08 Emilio Parisotto , Soham Ghosh , Sai Bhargav Yalamanchi , Varsha Chinnaobireddy , Yuhuai Wu , Ruslan Salakhutdinov

Vision-and-Language Navigation (VLN) requires agents to follow natural language instructions through environments, with memory-persistent variants demanding progressive improvement through accumulated experience. Existing approaches for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yunzhe Xu , Yiyuan Pan , Zhe Liu
‹ Prev 1 4 5 6 7 8 10 Next ›