English
Related papers

Related papers: TerminalWorld: Benchmarking Agents on Real-World T…

200 papers

The resurgence of autonomous agents built using large language models (LLMs) to solve complex real-world tasks has brought increased focus on LLMs' fundamental ability of tool or function calling. At the core of these agents, an LLM must…

The prevalence of scientific workflows with high computational demands calls for their execution on various distributed computing platforms, including large-scale leadership-class high-performance computing (HPC) clusters. To handle the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-10 Tainã Coleman , Henri Casanova , Ketan Maheshwari , Loïc Pottier , Sean R. Wilkinson , Justin Wozniak , Frédéric Suter , Mallikarjun Shankar , Rafael Ferreira da Silva

While LLM/VLM-powered AI agents have advanced rapidly in math, coding, and computer use, their applications in complex physical and social environments remain challenging. Building agents that can survive and thrive in the real world (for…

The rapid development of GUI foundation models and mobile GUI agents has spurred numerous evaluation benchmarks, yet most rely on simulated environments or open-source applications, leaving real-world closed-source applications largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yifan Sui , Xin Huang , Hongbing Li , Fang Xu , Jiahe Lv , Haolong Yan , Yeqing Shen , Litao Liu , Zhimin Fan , Ziyang Meng , Jia Wang , Junbo Qi , Kaijun Tan , Zheng Ge , Xiangyu Zhang , Daxin Jiang , Osamu Yoshie

Enhancing large language models (LLMs) with real-time APIs can help generate more accurate and up-to-date responses. However, evaluating the function calling abilities of LLMs in real-world scenarios remains under-explored due to the…

Computation and Language · Computer Science 2025-01-20 Lucen Zhong , Zhengxiao Du , Xiaohan Zhang , Haiyi Hu , Jie Tang

We introduce DRBench, a benchmark for evaluating AI agents on complex, open-ended deep research tasks in enterprise settings. Unlike prior benchmarks that focus on simple questions or web-only queries, DRBench evaluates agents on multi-step…

(M)LLM-powered computer use agents (CUA) are emerging as a transformative technique to automate human-computer interaction. However, existing CUA benchmarks predominantly target GUI agents, whose evaluation methods are susceptible to UI…

As large language models grow more capable, general AI agents have become increasingly prevalent in practical applications. However, existing benchmarks face significant limitations, failing to represent real-world user tasks accurately. To…

Artificial Intelligence · Computer Science 2026-03-04 Hao Li , Huan Wang , Jinjie Gu , Wenjie Wang , Chenyi Zhuang , Sikang Bian

The ability of large language models (LLMs) to mimic human-like intelligence has led to a surge in LLM-based autonomous agents. Though recent LLMs seem capable of planning and reasoning given user instructions, their effectiveness in…

We present MobileGym, a browser-hosted, lightweight, fully controllable environment for everyday mobile use, targeting interaction fidelity without replicating proprietary backends. It enables two capabilities previously out of reach for…

Artificial Intelligence · Computer Science 2026-05-28 Dingbang Wu , Rui Hao , Haiyang Wang , Shuzhe Wu , Han Xiao , Zhenghong Li , Bojiang Zhou , Zheng Ju , Zichen Liu , Lue Fan , Zhaoxiang Zhang

The evolution of AI coding agents has shifted the frontier from simple snippet completion to autonomous repository-level engineering. However, evaluating these agents remains ill-posed in general code repository generation, where the lack…

Software Engineering · Computer Science 2026-02-27 Xuefeng Li , Nir Ben-Israel , Yotam Raz , Belal Ahmed , Doron Serebro , Antoine Raux

Developing and evaluating e-commerce web agents requires environments that preserve meaningful task structure while enabling controllable, reproducible, and scalable scientific comparison. Existing methodologies force a tradeoff: live…

Artificial Intelligence · Computer Science 2026-05-18 Chinmay Savadikar , Mingyu Zhao , Yuanzheng Zhu , Han Li , Shuang Xie , Alberto Castelo , Tianfu Wu , Lingyun Wang

Recent advancements in large language models (LLMs) have significantly enhanced their reasoning capabilities. However, they continue to struggle with basic character-level tasks, such as counting letters in words, a problem rooted in their…

Computation and Language · Computer Science 2026-01-15 Shuyang Hou , Yi Hu , Muhan Zhang

Effective de-escalation is critical for law enforcement safety and community trust, yet traditional training methods lack scalability and realism. While Large Language Models (LLMs) enable dynamic, open-ended simulations, their substantial…

Computation and Language · Computer Science 2026-05-08 Md Hasebul Hasan , Krity Haque Charu , Eshwara Prasad Sridhar , Shuchisnigdha Deb , Mohammad A. Islam

We introduce FinWorkBench (a.k.a. Finch) for evaluating AI agents on real-world, enterprise-grade finance and accounting workflows that interleave data entry, structuring, formatting, web search, cross-file retrieval, calculation, modeling,…

Artificial Intelligence · Computer Science 2026-04-17 Haoyu Dong , Pengkun Zhang , Yan Gao , Xuanyu Dong , Yilin Cheng , Mingzhe Lu , Zikun Zhu , Adina Yakefu , Shuxin Zheng

Achieving mastery in real world software engineering tasks is fundamentally bottlenecked by the scarcity of large scale, high quality training data. Scaling such data has been limited by the complexity of environment setup, unit test…

End-to-end automation of realistic healthcare operations stresses three capabilities underrepresented in current benchmarks: policy density, decisions must be grounded in a large library of medical, insurance, and operational rules;…

Multimodal agents are making rapid progress on general computer-use tasks, yet existing benchmarks remain largely confined to browsers and basic desktop applications, falling short in professional software workflows that dominate real-world…

Software Engineering · Computer Science 2026-01-07 Jiaxin Ai , Yukang Feng , Fanrui Zhang , Jianwen Sun , Zizhen Li , Chuanhao Li , Yifan Chang , Wenxiao Wu , Ruoxi Wang , Mingliang Zhai , Kaipeng Zhang

Modern AI agents execute real-world side effects through tool calls such as file operations, shell commands, HTTP requests, and database queries. A single unsafe action, including accidental deletion, credential exposure, or data…

Artificial Intelligence · Computer Science 2026-05-07 Chenglin Yang

Recent advances in large language model (LLM) have empowered autonomous agents to perform multi-turn interactions with tools and environments. However, scaling such agent training is limited by the lack of diverse and reliable environments.…

Artificial Intelligence · Computer Science 2026-05-26 Zhaoyang Wang , Canwen Xu , Boyi Liu , Yite Wang , Siwei Han , Zhewei Yao , Huaxiu Yao , Yuxiong He