English
Related papers

Related papers: ToolScope: An Agentic Framework for Vision-Guided …

200 papers

Existing evaluations of multimodal large language models (MLLMs) on spatial intelligence are typically fragmented and limited in scope. In this work, we aim to conduct a holistic assessment of the spatial understanding capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haoning Wu , Xiao Huang , Yaohui Chen , Ya Zhang , Yanfeng Wang , Weidi Xie

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

Recent advances in Large Language Models (LLMs) and Large Reasoning Models (LRMs) have enabled agentic search systems that interleave multi-step reasoning with external tool use. However, existing frameworks largely rely on unstructured…

Information Retrieval · Computer Science 2025-12-29 Shuting Wang , Qiaolin Xia , Vich Wang , Herberttli , Bobsimons , Zhicheng Dou

Recent advances in Large Language Models (LLMs) and multimodal foundation models have significantly broadened their application in robotics and collaborative systems. However, effective multi-agent interaction necessitates robust…

Recent advancements in Large Language Models (LLMs) have led to a rapid growth of agentic systems capable of handling a wide range of complex tasks. However, current research largely relies on manual, task-specific design, limiting their…

Computation and Language · Computer Science 2025-02-28 Yu Shang , Yu Li , Keyu Zhao , Likai Ma , Jiahe Liu , Fengli Xu , Yong Li

Vision-and-Language Navigation (VLN) requires an embodied agent to ground complex natural-language instructions into long-horizon navigation in unseen environments. While Vision-Language Models (VLMs) offer strong 2D semantic understanding,…

Robotics · Computer Science 2026-03-19 Zihao Xin , Wentong Li , Yixuan Jiang , Ziyuan Huang , Bin Wang , Piji Li , Jianke Zhu , Jie Qin , Shengjun Huang

A navigable agent needs to understand both high-level semantic instructions and precise spatial perceptions. Building navigation agents centered on Multimodal Large Language Models (MLLMs) demonstrates a promising solution due to their…

Robotics · Computer Science 2026-02-18 Zerui Li , Hongpei Zheng , Fangguo Zhao , Aidan Chan , Jian Zhou , Sihao Lin , Shijie Li , Qi Wu

Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an…

Artificial Intelligence · Computer Science 2026-05-05 Wenyi Wu , Sibo Zhu , Kun Zhou , Biwei Huang

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

Solving complex reasoning tasks may involve visual understanding, domain knowledge retrieval, numerical calculation, and multi-step reasoning. Existing methods augment large language models (LLMs) with external tools but are restricted to…

Machine Learning · Computer Science 2026-04-15 Pan Lu , Bowen Chen , Sheng Liu , Rahul Thapa , Joseph Boen , James Zou

Large Language Model (LLM) Agents exhibit inherent reasoning abilities through the collaboration of multiple tools. However, during agent inference, existing methods often suffer from (i) locally myopic generation, due to the absence of…

Artificial Intelligence · Computer Science 2026-01-15 Jian Zhang , Zhiyuan Wang , Zhangqi Wang , Yu He , Haoran Luo , li yuan , Lingling Zhang , Rui Mao , Qika Lin , Jun Liu

The rapid development of large language model (LLM)-based agents has unlocked new possibilities for autonomous multi-turn reasoning and tool-augmented decision-making. However, their real-world deployment is hindered by severe…

Spreadsheets are ubiquitous across the World Wide Web, playing a critical role in enhancing work efficiency across various domains. Large language model (LLM) has been recently attempted for automatic spreadsheet manipulation but has not…

Artificial Intelligence · Computer Science 2025-03-04 Yibin Chen , Yifu Yuan , Zeyu Zhang , Yan Zheng , Jinyi Liu , Fei Ni , Jianye Hao , Hangyu Mao , Fuzheng Zhang

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

Multimodal Large Language Models (MLLMs) are increasingly applied in real-world scenarios where user-provided images are often imperfect, requiring active image manipulations such as cropping, editing, or enhancement to uncover salient…

Effective tool use is essential for agentic AI, yet training agents to utilize tools remains challenging due to manually designed rewards, limited training data, and poor multi-tool selection, resulting in slow adaptation, wasted…

Artificial Intelligence · Computer Science 2026-01-13 Quy Minh Le , Minh Sao Khue Luu , Khanh-Tung Tran , Duc-Hai Nguyen , Hoang-Quoc-Viet Pham , Quan Le , Hoang Thanh Lam , Hoang D. Nguyen

While Vision-Language Models (VLMs) can solve complex tasks through agentic reasoning, their capabilities remain largely constrained to text-oriented chain-of-thought or isolated tool invocation. They fail to exhibit the human-like…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yong Xien Chng , Tao Hu , Wenwen Tong , Xueheng Li , Jiandong Chen , Haojia Yu , Jiefan Lu , Hewei Guo , Hanming Deng , Chengjun Xie , Gao Huang , Dahua Lin , Lewei Lu

While Vision-Language Models (VLMs) have significantly advanced Computer-Using Agents (CUAs), current frameworks struggle with robustness in long-horizon workflows and generalization in novel domains. These limitations stem from a lack of…

While vision-language models (VLMs) have demonstrated remarkable performance across various tasks combining textual and visual information, they continue to struggle with fine-grained visual perception tasks that require detailed…

Computation and Language · Computer Science 2025-11-12 Zhehao Zhang , Ryan Rossi , Tong Yu , Franck Dernoncourt , Ruiyi Zhang , Jiuxiang Gu , Sungchul Kim , Xiang Chen , Zichao Wang , Nedim Lipka