English
Related papers

Related papers: WebChoreArena: Evaluating Web Browsing Agents on R…

200 papers

Large language models (LLMs) have evolved into interactive agents that collaborate with users in real-world tasks. Effective collaboration in such settings increasingly depends on understanding the user beyond what is explicitly stated, as…

Artificial Intelligence · Computer Science 2026-05-27 Yuxin Chen , Yi Zhang , Zhengzhou Cai , Yaorui Shi , Zhiyuan Yao , Chenhang Cui , Jingnan Zheng , Yaqi Huo , Xi Su , Qi Gu , Xunliang Cai , Xiang Wang , An Zhang , Tat-Seng Chua

Automated web testing plays a critical role in ensuring high-quality user experiences and delivering business value. Traditional approaches primarily focus on code coverage and load testing, but often fall short of capturing complex user…

Software Engineering · Computer Science 2025-09-08 Naimeng Ye , Xiao Yu , Ruize Xu , Tianyi Peng , Zhou Yu

How much large language models (LLMs) can aid scientific discovery, notably in assisting academic peer review, is in heated debate. Between a literature digest and a human-comparable research assistant lies their practical application…

Computation and Language · Computer Science 2025-08-19 Tianyi Li , Yu Qin , Olivia R. Liu Sheng

Large language model (LLM)-based mobile agents are increasingly popular due to their capability to interact directly with mobile phone Graphic User Interfaces (GUIs) and their potential to autonomously manage daily tasks. Despite their…

Artificial Intelligence · Computer Science 2024-06-13 Luyuan Wang , Yongyu Deng , Yiwei Zha , Guodong Mao , Qinmin Wang , Tianchen Min , Wei Chen , Shoufa Chen

TextArena is an open-source collection of competitive text-based games for training and evaluation of agentic behavior in Large Language Models (LLMs). It spans 57+ unique environments (including single-player, two-player, and multi-player…

Computation and Language · Computer Science 2025-05-27 Leon Guertler , Bobby Cheng , Simon Yu , Bo Liu , Leshem Choshen , Cheston Tan

Modern web agents possess computer use abilities that allow them to interact with webpages by sending commands to a virtual keyboard and mouse. While such agents have considerable potential to assist human users with complex tasks,…

Artificial Intelligence · Computer Science 2025-07-25 Yixiao Song , Katherine Thai , Chau Minh Pham , Yapei Chang , Mazin Nadaf , Mohit Iyyer

Large Language Models (LLMs) show promise as data analysis agents, but existing benchmarks overlook the iterative nature of the field, where experts' decisions evolve with deeper insights of the dataset. To address this, we introduce…

Computation and Language · Computer Science 2025-06-09 Hanyu Li , Haoyu Liu , Tingyu Zhu , Tianyu Guo , Zeyu Zheng , Xiaotie Deng , Michael I. Jordan

While Large Language Models (LLMs) have demonstrated significant advancements in reasoning and agent-based problem-solving, current evaluation methodologies fail to adequately assess their capabilities: existing benchmarks either rely on…

Recent advancements in LLM-based agents have demonstrated remarkable capabilities in handling complex, knowledge-intensive tasks by integrating external tools. Among diverse choices of tools, search tools play a pivotal role in accessing…

Computation and Language · Computer Science 2025-10-28 Jiaxuan Gao , Wei Fu , Minyang Xie , Shusheng Xu , Chuyi He , Zhiyu Mei , Banghua Zhu , Yi Wu

Web automation employs intelligent agents to execute high-level tasks by mimicking human interactions with web interfaces. Despite the capabilities of recent Large Language Model (LLM)-based web agents, navigating complex, real-world…

Artificial Intelligence · Computer Science 2025-11-27 Jiayuan Zhang , Kaiquan Chen , Zhihao Lu , Enshen Zhou , Qian Yu , Jing Zhang

Large Language Models (LLMs) with agentic web search capabilities show strong potential for tasks requiring real-time information access and complex fact retrieval, yet evaluating such systems remains challenging. We introduce \bench, a…

Information Retrieval · Computer Science 2026-02-17 Yunfan Zhang , Kathleen McKeown , Smaranda Muresan

Personalized digital health support requires long-horizon, cross-dimensional reasoning over heterogeneous lifestyle signals, and recent advances in mobile sensing and large language models (LLMs) make such support increasingly feasible.…

Artificial Intelligence · Computer Science 2026-01-21 Ye Tian , Zihao Wang , Onat Gungor , Xiaoran Fan , Tajana Rosing

Large Language Models (LLMs) falter in multi-step interactions -- often hallucinating, repeating actions, or misinterpreting user corrections -- due to reliance on linear, unstructured context. This fragility stems from the lack of…

Artificial Intelligence · Computer Science 2025-05-27 Ye Ye

Large language models (LLMs) increasingly serve as the central control unit of AI agents, yet current approaches remain limited in their ability to deliver personalized interactions. While Retrieval Augmented Generation enhances LLM…

Artificial Intelligence · Computer Science 2025-10-10 Rebecca Westhäußer , Wolfgang Minker , Sebatian Zepf

Recent advancements in integrating large language models (LLMs) with application programming interfaces (APIs) have gained significant interest in both academia and industry. Recent work demonstrates that these API-based agents exhibit…

Software Engineering · Computer Science 2025-01-24 Haiyang Shen , Yue Li , Desong Meng , Dongqi Cai , Sheng Qi , Li Zhang , Mengwei Xu , Yun Ma

The recent advancement of autonomous agents powered by Large Language Models (LLMs) has demonstrated significant potential for automating tasks on mobile devices through graphical user interfaces (GUIs). Despite initial progress, these…

Human-Computer Interaction · Computer Science 2025-07-30 Yi Kong , Dianxi Shi , Guoli Yang , Zhang ke-di , Chenlin Huang , Xiaopeng Li , Songchang Jin

Whether in agentic workflows, social studies, or chat settings, large language models (LLMs) are increasingly being asked to replace humans in choosing which goals to pursue, rather than completing predefined tasks. However, the assumption…

Computation and Language · Computer Science 2026-05-14 Gaia Molinaro , Dave August , Danielle Perszyk , Anne G. E. Collins

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse feedback, and irreversible mistakes. Video games offer an ideal testbed with rich visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Mingyu Ouyang , Siyuan Hu , Kevin Qinghong Lin , Hwee Tou Ng , Mike Zheng Shou

Autonomous multimodal language models are rapidly evolving into web agents that can browse, click, and purchase items on behalf of users, posing a threat to display advertising designed for human eyes. Yet little is known about how these…

Information Retrieval · Computer Science 2025-11-13 Joel Nitu , Heidrun Mühle , Andreas Stöckl