English
Related papers

Related papers: TOBench: A Task-Oriented Omni-Modal Benchmark for …

200 papers

We introduce MCP-Bench, a benchmark for evaluating large language models (LLMs) on realistic, multi-step tasks that demand tool use, cross-tool coordination, precise parameter control, and planning/reasoning for solving tasks. Built on the…

Computation and Language · Computer Science 2025-08-29 Zhenting Wang , Qi Chang , Hemani Patel , Shashank Biju , Cheng-En Wu , Quan Liu , Aolin Ding , Alireza Rezazadeh , Ankit Shah , Yujia Bao , Eugene Siow

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

Recent advances in large language models (LLMs) have enabled the emergence of general-purpose agents for automating end-to-end machine learning (ML) workflows, including data analysis, feature engineering, model training, and competition…

Artificial Intelligence · Computer Science 2025-09-12 Hangyi Jia , Yuxi Qian , Hanwen Tong , Xinhui Wu , Lin Chen , Feng Wei

As multimodal large language models (MLLMs) advance, MLLM-based virtual agents have demonstrated remarkable performance. However, existing benchmarks face significant limitations, including uncontrollable task complexity, extensive manual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Wendong Bu , Yang Wu , Qifan Yu , Minghe Gao , Bingchen Miao , Zhenkui Zhang , Kaihang Pan , Yunfei Li , Mengze Li , Wei Ji , Juncheng Li , Siliang Tang , Yueting Zhuang

Recent advancements extend Multimodal Large Language Models (MLLMs) beyond standard visual question answering to utilizing external tools for advanced visual tasks. Despite this progress, precisely executing and effectively composing…

Artificial Intelligence · Computer Science 2026-03-20 Xuanyu Zhu , Yuhao Dong , Rundong Wang , Yang Shi , Zhipeng Wu , Yinlun Peng , YiFan Zhang , Yihang Lou , Yuanxing Zhang , Ziwei Liu , Yan Bai , Yuan Zhou

We present M^3-Bench, the first benchmark for evaluating multimodal tool use under the Model Context Protocol. The benchmark targets realistic, multi-hop and multi-threaded workflows that require visual grounding and textual reasoning,…

Artificial Intelligence · Computer Science 2026-02-05 Yang Zhou , Mingyu Zhao , Zhenting Wang , Difei Gu , Bangwei Guo , Ruosong Ye , Ligong Han , Can Jin , Dimitris N. Metaxas

We present MEGA-Bench, an evaluation suite that scales multimodal evaluation to over 500 real-world tasks, to address the highly heterogeneous daily use cases of end users. Our objective is to optimize for a set of high-quality data samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Jiacheng Chen , Tianhao Liang , Sherman Siu , Zhengqing Wang , Kai Wang , Yubo Wang , Yuansheng Ni , Wang Zhu , Ziyan Jiang , Bohan Lyu , Dongfu Jiang , Xuan He , Yuan Liu , Hexiang Hu , Xiang Yue , Wenhu Chen

Large Language Models (LLMs) are increasingly serving as autonomous agents, and their utilization of external tools via the Model Context Protocol (MCP) is considered a future trend. Current MCP evaluation sets suffer from issues such as…

Artificial Intelligence · Computer Science 2026-01-22 Wenrui Liu , Zixiang Liu , Elsie Dai , Wenhan Yu , Lei Yu , Tong Yang , Jinjun Han , Hong Gao

The development of autonomous machine learning (ML) agents capable of end-to-end data science workflows represents a significant frontier in artificial intelligence. These agents must orchestrate complex sequences of data analysis, feature…

Machine Learning · Computer Science 2026-02-24 Yaswanth Chittepu , Raghavendra Addanki , Tung Mai , Anup Rao , Branislav Kveton

Model Context Protocol (MCP) has become a key infrastructure for connecting LLMs with external tools, scaling to 10,000+ MCP servers with diverse tools. Unfortunately, there is still a large gap between real-world MCP usage and current…

Artificial Intelligence · Computer Science 2026-02-27 Guozhao Mo , Wenliang Zhong , Jiawei Chen , Qianhao Yuan , Xuanang Chen , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Le Sun

In recent years, the remarkable progress of large language models (LLMs) has sparked interest in task automation, which involves decomposing complex tasks described by user instructions into sub-tasks and invoking external tools to execute…

Computation and Language · Computer Science 2024-11-04 Yongliang Shen , Kaitao Song , Xu Tan , Wenqi Zhang , Kan Ren , Siyu Yuan , Weiming Lu , Dongsheng Li , Yueting Zhuang

Terminals provide a powerful interface for AI agents by exposing diverse tools for automating complex workflows, yet existing terminal-agent benchmarks largely focus on tasks grounded in text, code, and structured files. However, many…

Multimedia · Computer Science 2026-05-13 Chiyeong Heo , Jaechang Kim , Junhyuk Kwon , Hoyoung Kim , Dongmin Park , Jonghyun Lee , Jungseul Ok

Large language models (LLMs) demonstrate strong potential as agents for tool invocation due to their advanced comprehension and planning capabilities. Users increasingly rely on LLM-based agents to solve complex missions through iterative…

Artificial Intelligence · Computer Science 2025-04-17 Peijie Yu , Yifan Yang , Jinjian Li , Zelong Zhang , Haorui Wang , Xiao Feng , Feng Zhang

While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions. Unlike mathematical reasoning where errors are often rectifiable via backtracking, tool-use failures frequently induce…

Artificial Intelligence · Computer Science 2026-03-17 Shengda Fan , Xuyan Ye , Yupeng Huo , Zhi-Yuan Chen , Yiju Guo , Shenzhi Yang , Wenkai Yang , Shuqi Ye , Jingwen Chen , Haotian Chen , Xin Cong , Yankai Lin

Large Language Models (LLMs) are evolving from text generators into reasoning agents. This transition makes their ability to use external tools a critical capability. However, evaluating this skill presents a significant challenge. Existing…

Computation and Language · Computer Science 2025-10-14 Fei Lei , Yibo Yang , Wenxiu Sun , Dahua Lin

With advances in decision-making and reasoning capabilities, multimodal agents show strong potential in computer application scenarios. Past evaluations have mainly assessed GUI interaction skills, while tool invocation abilities, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Hongrui Jia , Jitong Liao , Xi Zhang , Haiyang Xu , Tianbao Xie , Chaoya Jiang , Ming Yan , Si Liu , Wei Ye , Fei Huang

We introduce WorkBench: a benchmark dataset for evaluating agents' ability to execute tasks in a workplace setting. WorkBench contains a sandbox environment with five databases, 26 tools, and 690 tasks. These tasks represent common business…

Computation and Language · Computer Science 2024-08-06 Olly Styles , Sam Miller , Patricio Cerda-Mardini , Tanaya Guha , Victor Sanchez , Bertie Vidgen

As LLM-based agents are increasingly deployed in real-life scenarios, existing benchmarks fail to capture their inherent complexity of handling extensive information, leveraging diverse resources, and managing dynamic user interactions. To…

Computation and Language · Computer Science 2025-10-20 Wei He , Yueqing Sun , Hongyan Hao , Xueyuan Hao , Zhikang Xia , Qi Gu , Chengcheng Han , Dengchang Zhao , Hui Su , Kefeng Zhang , Man Gao , Xi Su , Xiaodong Cai , Xunliang Cai , Yu Yang , Yunke Zhao

LLM agents are increasingly deployed as executable systems that use tools, modify workspaces, and produce concrete artifacts. In such workflows, performance depends not only on the base model, but also on the harness: the system layer that…

Artificial Intelligence · Computer Science 2026-05-28 Yilun Yao , Xinyu Tan , Chao-Hsuan Liu , Yaoming Li , Zhengyang Wang , Wenhan Yu , Zhewen Tan , Yuxuan Tian , Guangxiang Zhao , Lin Sun , Xiangzheng Zhang , Tong Yang
‹ Prev 1 2 3 10 Next ›