English
Related papers

Related papers: FindingDory: A Benchmark to Evaluate Memory in Emb…

200 papers

As robots become increasingly capable of operating over extended periods -- spanning days, weeks, and even months -- they are expected to accumulate knowledge of their environments and leverage this experience to assist humans more…

Embodied cognition argues that intelligence arises from sensorimotor interaction rather than passive observation. It raises an intriguing question: do modern vision-language models (VLMs), trained largely in a disembodied manner, exhibit…

Artificial Intelligence · Computer Science 2025-11-27 Qineng Wang , Wenlong Huang , Yu Zhou , Hang Yin , Tianwei Bao , Jianwen Lyu , Weiyu Liu , Ruohan Zhang , Jiajun Wu , Li Fei-Fei , Manling Li

For service robots to become general-purpose in everyday household environments, they need not only a large library of primitive skills, but also the ability to quickly learn novel tasks specified by users. Fine-tuning neural networks on a…

Robotics · Computer Science 2023-01-16 Yuqian Jiang , Qiaozi Gao , Govind Thattai , Gaurav Sukhatme

Large language models (LLMs) have achieved impressive linguistic capabilities. However, a key limitation persists in their lack of human-like memory faculties. LLMs exhibit constrained memory retention across sequential interactions,…

Computation and Language · Computer Science 2024-05-29 Jing Guo , Nan Li , Jianchuan Qi , Hang Yang , Ruiqiao Li , Yuzhen Feng , Si Zhang , Ming Xu

Memory-augmented language agents are increasingly deployed in affective applications such as emotional support, where understanding and responding to users' latent emotional needs is critical. However, existing research often treats memory…

Computation and Language · Computer Science 2026-05-27 Xing Fu , Yulin Hu , Mengtong Ji , Haozhen Li , Yixin Sun , Weixiang Zhao , Yanyan Zhao , Bing Qin

The enhancement of generalization in robots by large vision-language models (LVLMs) is increasingly evident. Therefore, the embodied cognitive abilities of LVLMs based on egocentric videos are of great interest. However, current datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ronghao Dang , Yuqian Yuan , Wenqi Zhang , Yifei Xin , Boqiang Zhang , Long Li , Liuyi Wang , Qinyang Zeng , Xin Li , Lidong Bing

As embodied agents operate in increasingly complex environments, the ability to perceive, track, and reason about individual object instances over time becomes essential, especially in tasks requiring sequenced interactions with visually…

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Spatial reasoning plays a vital role in both human cognition and machine intelligence, prompting new research into language models' (LMs) capabilities in this regard. However, existing benchmarks reveal shortcomings in evaluating…

Computation and Language · Computer Science 2024-05-27 Fangjun Li , David C. Hogg , Anthony G. Cohn

Recent Vision-Language-Action (VLA) models report impressive success rates on standard robotic benchmarks, fueling optimism about general-purpose physical intelligence. However, recent evidence suggests a systematic misalignment between…

Robotics · Computer Science 2026-04-21 Haiweng Xu , Sipeng Zheng , Hao Luo , Wanpeng Zhang , Ziheng Xi , Zongqing Lu

Memory is crucial for enabling agents to tackle complex tasks with temporal and spatial dependencies. While many reinforcement learning (RL) algorithms incorporate memory, the field lacks a universal benchmark to assess an agent's memory…

Machine Learning · Computer Science 2026-03-05 Egor Cherepanov , Nikita Kachaev , Alexey K. Kovalev , Aleksandr I. Panov

Embodied agents can identify and report safety hazards in the home environments. Accurately evaluating their capabilities in home safety inspection tasks is curcial, but existing benchmarks suffer from two key limitations. First, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Siyuan Gao , Jiashu Yao , Haoyu Wen , Yuhang Guo , Zeming Liu , Heyan Huang

Recent advancements in Vision Language Models (VLMs) have expanded their capabilities to interactive agent tasks, yet existing benchmarks remain limited to single-agent or text-only environments. In contrast, real-world scenarios often…

Artificial Intelligence · Computer Science 2026-04-14 Zelai Xu , Zhexuan Xu , Xiangmin Yi , Huining Yuan , Mo Guang , Kaiwen Long , Xinlei Chen , Yi Wu , Chao Yu , Yu Wang

When an LLM-based embodied agent fails at a household task, the culprit could be misidentified objects, forgotten sub-goals, or poor action sequencing -- yet existing benchmarks report only a single success rate, making it impossible to…

Robotics · Computer Science 2026-05-13 Yunn Kang Lim , Pengzhan Sun , Ziyi Bai , Xun Xu , Angela Yao , Xulei Yang , Shijie Li

Vision-Language-Action (VLA) models have recently enabled embodied agents to perform increasingly complex tasks by jointly reasoning over visual, linguistic, and motor modalities. However, we find that the prevailing notion of…

Machine Learning · Computer Science 2026-03-20 Zhuofan Li , Hongkun Yang , Zhenyang Chen , Yangxuan Chen , Yingyan , Lin , Chaojian Li

With the integration of large language models (LLMs), embodied agents have strong capabilities to understand and plan complicated natural language instructions. However, a foreseeable issue is that those embodied agents can also flawlessly…

Cryptography and Security · Computer Science 2025-11-03 Sheng Yin , Xianghe Pang , Yuanzhuo Ding , Menglan Chen , Yutong Bi , Yichen Xiong , Wenhao Huang , Zhen Xiang , Jing Shao , Siheng Chen

We introduce OceanGym, the first comprehensive benchmark for ocean underwater embodied agents, designed to advance AI in one of the most demanding real-world environments. Unlike terrestrial or aerial domains, underwater settings present…

Computation and Language · Computer Science 2025-11-26 Yida Xue , Mingjun Mao , Xiangyuan Ru , Yuqi Zhu , Baochang Ren , Shuofei Qiao , Mengru Wang , Shumin Deng , Xinyu An , Ningyu Zhang , Ying Chen , Huajun Chen

Advancing safe autonomous systems through reinforcement learning (RL) requires robust benchmarks to evaluate performance, analyze methods, and assess agent competencies. Humans primarily rely on embodied visual perception to safely navigate…

Artificial Intelligence · Computer Science 2025-03-12 Tristan Tomilin , Meng Fang , Mykola Pechenizkiy

Large Language Models (LLMs) represent a landmark achievement in Artificial Intelligence (AI), demonstrating unprecedented proficiency in procedural tasks such as text generation, code completion, and conversational coherence. These…

Artificial Intelligence · Computer Science 2025-05-07 Schaun Wheeler , Olivier Jeunen

With the growing adoption of large language model agents in persistent real-world roles, they naturally encounter continuous streams of tasks. A key limitation, however, is their failure to learn from the accumulated interaction history,…

‹ Prev 1 8 9 10 Next ›