English
Related papers

Related papers: Windows Agent Arena: Evaluating Multi-Modal OS Age…

200 papers

Large language model (LLM)-based mobile agents are increasingly popular due to their capability to interact directly with mobile phone Graphic User Interfaces (GUIs) and their potential to autonomously manage daily tasks. Despite their…

Artificial Intelligence · Computer Science 2024-06-13 Luyuan Wang , Yongyu Deng , Yiwei Zha , Guodong Mao , Qinmin Wang , Tianchen Min , Wei Chen , Shoufa Chen

Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse feedback, and irreversible mistakes. Video games offer an ideal testbed with rich visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Mingyu Ouyang , Siyuan Hu , Kevin Qinghong Lin , Hwee Tou Ng , Mike Zheng Shou

The rapid evolution of Multi-modal Large Language Models (MLLMs) has advanced workflow automation; however, existing research mainly targets performance upper bounds in static environments, overlooking robustness for stochastic real-world…

Artificial Intelligence · Computer Science 2026-01-14 Daocheng Fu , Jianbiao Mei , Rong Wu , Xuemeng Yang , Jia Xu , Ding Wang , Pinlong Cai , Yong Liu , Licheng Wen , Botian Shi

With the rapid development of multimodal large language models (MLLMs), they are increasingly deployed as autonomous computer-use agents capable of accomplishing complex computer tasks. However, a pressing issue arises: Can the safety risk…

Artificial Intelligence · Computer Science 2025-06-23 Jingyi Yang , Shuai Shao , Dongrui Liu , Jing Shao

Numerous software analysis tools exist today, yet applying them to diverse open-source projects remains challenging due to environment setup, dependency resolution, and tool configuration. LLM-based agents offer a potential solution, yet no…

Software Engineering · Computer Science 2026-04-20 Islem Bouzenia , Cristian Cadar , Michael Pradel

We present HippoCamp, a new benchmark designed to evaluate agents' capabilities on multimodal file management. Unlike existing agent benchmarks that focus on tasks like web interaction, tool use, or software automation in generic settings,…

Artificial Intelligence · Computer Science 2026-04-02 Zhe Yang , Shulin Tian , Kairui Hu , Shuai Liu , Hoang-Nhat Nguyen , Yichi Zhang , Zujin Guo , Mengying Yu , Zinan Zhang , Jingkang Yang , Chen Change Loy , Ziwei Liu

Large Language Models (LLMs) are becoming increasingly powerful and capable of handling complex tasks, e.g., building single agents and multi-agent systems. Compared to single agents, multi-agent systems have higher requirements for the…

Computation and Language · Computer Science 2024-08-29 Wei Wang , Dan Zhang , Tao Feng , Boyan Wang , Jie Tang

To close the gap between LLM-based agents and humans in planning and reasoning, agents need large-scale, diverse environments for continuous learning -- yet building such environments is itself prohibitively expensive. We present C-World,…

Artificial Intelligence · Computer Science 2026-04-21 Ziqiao Xi , Shuang Liang , Qi Liu , Jiaqing Zhang , Letian Peng , Fang Nan , Meshal Nayim , Tianhui Zhang , Rishika Mundada , Lianhui Qin , Biwei Huang , Kun Zhou

LLM web agents now browse and take actions on the open web, yet current agent evaluations are constrained to sandboxed environments or artificial tasks. We introduce BrowserArena, a live open-web agent evaluation platform that collects…

Artificial Intelligence · Computer Science 2025-10-08 Sagnik Anupam , Davis Brown , Shuo Li , Eric Wong , Hamed Hassani , Osbert Bastani

Multimodal large language models (MLLMs) have enabled LLM-based agents to directly interact with application user interfaces (UIs), enhancing agents' performance in complex tasks. However, these agents often suffer from high latency and low…

Artificial Intelligence · Computer Science 2025-05-20 Junting Lu , Zhiyang Zhang , Fangkai Yang , Jue Zhang , Lu Wang , Chao Du , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Large Language Models (LLMs) increasingly act as function-call agents that invoke external tools to tackle tasks beyond their static knowledge. However, they typically invoke tools one at a time without a global view of task structure. As…

Artificial Intelligence · Computer Science 2026-05-22 Yan Jiang , Hao Zhou , Lizhong GU , Tianlong Li , Ruinan Jin , Wanqi Zhou , Ai Han

The rapid advancement of Large Language Models (LLMs) has catalyzed the development of autonomous agents capable of navigating complex environments. However, existing evaluations primarily adopt a deductive paradigm, where agents execute…

Web agents enable users to perform tasks on web browsers through natural language interaction. Evaluating web agents trajectories is an important problem, since it helps us determine whether the agent successfully completed the tasks.…

Customer Relationship Management (CRM) systems are vital for modern enterprises, providing a foundation for managing customer interactions and data. Integrating AI agents into CRM systems can automate routine processes and enhance…

Computation and Language · Computer Science 2025-02-18 Kung-Hsiang Huang , Akshara Prabhakar , Sidharth Dhawan , Yixin Mao , Huan Wang , Silvio Savarese , Caiming Xiong , Philippe Laban , Chien-Sheng Wu

World models (WMs) are intended to serve as internal simulators of the real world that enable agents to understand, anticipate, and act upon complex environments. Existing WM benchmarks remain narrowly focused on next-state prediction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 PAN Team , Qiyue Gao , Kun Zhou , Jiannan Xiang , Zihan Liu , Dequan Yang , Junrong Chen , Arif Ahmad , Cong Zeng , Ganesh Bannur , Xinqi Huang , Zheqi Liu , Yi Gu , Yichi Yang , Guangyi Liu , Zhiting Hu , Zhengzhong Liu , Eric Xing

Large Language Model (LLM) web agents often struggle with long-horizon web navigation and web task completion in new websites, producing inefficient action sequences unless fine-tuned on environment-specific data. We show that…

Agents, language model-based systems capable of reasoning, planning, and acting are widely adopted in real-world tasks, yet how their performance changes as these systems scale across key dimensions remains underexplored. We introduce…

Learning agents that are not only capable of taking tests, but also innovating is becoming a hot topic in AI. One of the most promising paths towards this vision is multi-agent learning, where agents act as the environment for each other,…

Multiagent Systems · Computer Science 2019-12-02 Yuhang Song , Andrzej Wojcicki , Thomas Lukasiewicz , Jianyi Wang , Abi Aryan , Zhenghua Xu , Mai Xu , Zihan Ding , Lianlong Wu

Computer-using agents have shown strong potential to boost human productivity and enable new application forms across platforms. While recent advances have led to usable applications, existing benchmarks fail to account for the internal…

Recent advances in large language models have enabled LLM-based agents to achieve strong performance on a variety of benchmarks. However, their performance in real-world deployments often that observed on benchmark settings, especially in…

Artificial Intelligence · Computer Science 2026-02-19 Ruipeng Wang , Yuxin Chen , Yukai Wang , Chang Wu , Junfeng Fang , Xiaodong Cai , Qi Gu , Hui Su , An Zhang , Xiang Wang , Xunliang Cai , Tat-Seng Chua