English
Related papers

Related papers: EvoEmpirBench: Dynamic Spatial Reasoning with Agen…

200 papers

Large language models (LLMs) perform well on step-by-step reasoning benchmarks such as mathematics and code generation, yet their ability to carry out robust long-horizon planning under realistic constraints remains insufficiently…

Artificial Intelligence · Computer Science 2026-04-21 Petr Anokhin , Roman Khalikov , Stefan Rebrikov , Viktor Volkov , Artyom Sorokin , Vincent Bissonnette

Spatial cognition is fundamental to real-world multimodal intelligence, allowing models to effectively interact with the physical environment. While multimodal large language models (MLLMs) have made significant strides, existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-08 Peiran Xu , Sudong Wang , Yao Zhu , Jianing Li , Gege Qi , Yunjian Zhang

Agents in the real world must make not only logical but also timely judgments. This requires continuous awareness of the dynamic environment: hazards emerge, opportunities arise, and other agents act, while the agent's reasoning is still…

Artificial Intelligence · Computer Science 2025-11-10 Yule Wen , Yixin Ye , Yanzhe Zhang , Diyi Yang , Hao Zhu

The growing interest in embodied agents increases the demand for spatiotemporal video understanding, yet existing benchmarks largely emphasize extractive reasoning, where answers can be explicitly presented within spatiotemporal events. It…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Seunghwan Bang , Hwanjun Song

Agentic multimodal models should not only comprehend text and images, but also actively invoke external tools, such as code execution environments and web search, and integrate these operations into reasoning. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jack Hong , Chenxiao Zhao , ChengLin Zhu , Weiheng Lu , Guohai Xu , Xing Yu

Real-world mathematical modeling is inherently an experiential and collaborative endeavor. Domain experts rarely solve complex problems from scratch; instead, they draw upon analogies from historical cases and subject their hypotheses to…

Multiagent Systems · Computer Science 2026-04-03 Junhao Jia , Huangwei Chen , Ruiying Sun , Yanhui Song , Haishuai Wang , Jiajun Bu , Lei Wu

We introduce Spatial Reasoning Models (SRMs), a framework to perform reasoning over sets of continuous variables via denoising generative models. SRMs infer continuous representations on a set of unobserved variables, given observations on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Christopher Wewer , Bart Pogodzinski , Bernt Schiele , Jan Eric Lenssen

Multimodal large language models (MLLMs) have advanced static visual--spatial reasoning, yet they often fail to preserve long-horizon spatial coherence in embodied settings where beliefs must be continuously revised from egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chih-Ting Liao , Xi Xiao , Chunlei Meng , Zhangquan Chen , Yitong Qiao , Weilin Zhou , Tianyang Wang , Xu Zheng , Xin Cao

Planning has been a cornerstone of artificial intelligence for solving complex problems, and recent progress in LLM-based multi-agent frameworks have begun to extend this capability. However, the role of human-like memory within these…

Multiagent Systems · Computer Science 2025-12-09 Wenzhe Fan , Ning Yan , Masood Mortazavi

Escape rooms present a unique cognitive challenge that demands exploration-driven planning: with the sole instruction to 'escape the room', players must actively search their environment, collecting information, and finding solutions…

Artificial Intelligence · Computer Science 2025-05-28 Seungwon Lim , Sungwoong Kim , Jihwan Yu , Sungjae Lee , Jiwan Chung , Youngjae Yu

Recent advances in agentic Large Language Models (LLMs) have positioned them as generalist planners capable of reasoning and acting across diverse tasks. However, existing agent benchmarks largely focus on symbolic or weakly grounded…

Artificial Intelligence · Computer Science 2026-01-19 Weiyi Wang , Xinchi Chen , Jingjing Gong , Xuanjing Huang , Xipeng Qiu

Long-term memory is crucial for agents in specialized web environments, where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmarks for agents mostly…

Computation and Language · Computer Science 2026-05-13 Di Wu , Zixiang Ji , Asmi Kawatkar , Bryan Kwan , Jia-Chen Gu , Nanyun Peng , Kai-Wei Chang

Large Language Model (LLM) agents, while proficient in the digital realm, face a significant gap in physical-world deployment due to the challenge of forming and maintaining a robust spatial mental model. We identify three core cognitive…

Artificial Intelligence · Computer Science 2026-01-05 Huan-ang Gao , Zikang Zhang , Tianwei Luo , Kaisen Yang , Xinzhe Juan , Jiahao Qiu , Tianxing Chen , Bingxiang He , Hao Zhao , Hao Zhou , Shilong Liu , Mengdi Wang

Augmented Reality (AR) systems are increasingly integrating foundation models, such as Multimodal Large Language Models (MLLMs), to provide more context-aware and adaptive user experiences. This integration has led to the development of AR…

Artificial Intelligence · Computer Science 2025-08-13 Dongwook Choi , Taeyoon Kwon , Dongil Yang , Hyojun Kim , Jinyoung Yeo

Next-generation AI must manage vast personal data, diverse tools, and multi-step reasoning, yet most benchmarks remain context-free and single-turn. We present ASTRA-bench (Assistant Skills in Tool-use, Reasoning \& Action-planning), a…

Artificial Intelligence · Computer Science 2026-03-03 Zidi Xiu , David Q. Sun , Kevin Cheng , Maitrik Patel , Josh Date , Yizhe Zhang , Jiarui Lu , Omar Attia , Raviteja Vemulapalli , Oncel Tuzel , Meng Cao , Samy Bengio

Models like OpenAI-o3 pioneer visual grounded reasoning by dynamically referencing visual regions, just like human "thinking with images". However, no benchmark exists to evaluate these capabilities holistically. To bridge this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Haochen Wang , Xiangtai Li , Zilong Huang , Anran Wang , Jiacong Wang , Tao Zhang , Jiani Zheng , Sule Bai , Zijian Kang , Jiashi Feng , Zhuochen Wang , Zhaoxiang Zhang

Realizing endogenous narrative evolution in LLM-based multi-agent systems is hindered by the inherent stochasticity of generative emergence. In particular, long-horizon simulations suffer from social memory stacking, where conflicting…

Computation and Language · Computer Science 2026-04-15 Shiyu He , Minchi Kuang , Mengxian Wang , Bin Hu , Tingxiang Gu

Despite rapid progress in Multimodal Large Language Models (MLLMs), visual spatial reasoning remains unreliable when correct answers depend on how a scene would appear under unseen or alternative viewpoints. Recent work addresses this by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Shoubin Yu , Yue Zhang , Zun Wang , Jaehong Yoon , Huaxiu Yao , Mingyu Ding , Mohit Bansal

Reasoning about dynamic spatial relationships is essential, as both observers and objects often move simultaneously. Although vision-language models (VLMs) and visual expertise models excel in 2D tasks and static scenarios, their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Ziang Zhang , Zehan Wang , Guanghao Zhang , Weilong Dai , Yan Xia , Ziang Yan , Minjie Hong , Zhou Zhao

The recent rapid development of Large Vision-Language Models (LVLMs) has indicated their potential for embodied tasks.However, the critical skill of spatial understanding in embodied environments has not been thoroughly evaluated, leaving…

Artificial Intelligence · Computer Science 2024-06-11 Mengfei Du , Binhao Wu , Zejun Li , Xuanjing Huang , Zhongyu Wei