English
Related papers

Related papers: Odysseys: Benchmarking Web Agents on Realistic Lon…

200 papers

While much work on web agents emphasizes the promise of autonomously performing tasks on behalf of users, in reality, agents often fall short on complex tasks in real-world contexts and modeling user preference. This presents an opportunity…

Artificial Intelligence · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Frank F. Xu , Tianyue Ou , Shuyan Zhou , Jeffrey P. Bigham , Graham Neubig

Optimization modeling stands as the engine of scientific decision-making in logistics and transportation, yet its adoption is hindered by a steep expertise threshold and the latency of manual workflows. Automating this process via Large…

Artificial Intelligence · Computer Science 2026-04-21 Beinuo Yang , Qishen Zhou , Junyi Li , Chenxing Su , Panagiotis Angeloudis , Simon Hu

Video production workflows offer a rich and demanding arena for evaluating multimodal AI agents: they require composite capabilities across text, image, audio, and video understanding, along with long-horizon planning, and tool use. To this…

Cryptography and Security · Computer Science 2026-05-28 Zongheng Cao , Yi Zheng , Rui Song , Xinyu Hu

Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents: small errors compound across steps, and even state-of-the-art models often hallucinate or lose coherence. We identify…

Artificial Intelligence · Computer Science 2025-10-13 Guangya Wan , Mingyang Ling , Xiaoqi Ren , Rujun Han , Sheng Li , Zizhao Zhang

Large language models are transitioning from generalpurpose knowledge engines to realworld problem solvers, yet optimizing them for deep search tasks remains challenging. The central bottleneck lies in the extreme sparsity of highquality…

Artificial Intelligence · Computer Science 2026-02-17 Zheng Chu , Xiao Wang , Jack Hong , Huiming Fan , Yuqi Huang , Yue Yang , Guohai Xu , Chenxiao Zhao , Cheng Xiang , Shengchao Hu , Dongdong Kuang , Ming Liu , Bing Qin , Xing Yu

LLM-based agents are increasingly expected to handle real-world assistant tasks, yet existing benchmarks typically evaluate them under isolated sources of difficulty, such as a single environment or fully specified instructions. This leaves…

Computation and Language · Computer Science 2026-04-16 Xiang Long , Li Du , Yilong Xu , Fangcheng Liu , Haoqing Wang , Ning Ding , Ziheng Li , Jianyuan Guo , Yehui Tang

While Graphical User Interface (GUI) agents have shown promising performance in automated device interaction, they primarily depend on static parametric knowledge from pre-training or instruction tuning. This reliance fundamentally limits…

Artificial Intelligence · Computer Science 2026-05-19 Jingjing Liu , Ziye Huang , Zihao Cheng , Zeming Liu , Jiahong Wu , Yuhang Guo , Kehai Chen , Yunhong Wang , Haifeng Wang

As AI agents integrate into enterprise applications, their evaluation demands benchmarks that reflect the complexity of real-world operations. Instead, existing benchmarks overemphasize open-domains such as code, use narrow accuracy…

Artificial Intelligence · Computer Science 2026-02-03 Amanda Dsouza , Ramya Ramakrishnan , Charles Dickens , Bhavishya Pohani , Christopher M Glaze

Autonomous web agents solve complex browsing tasks, yet existing benchmarks measure only whether an agent finishes a task, ignoring whether it does so safely or in a way enterprises can trust. To integrate these agents into critical…

Artificial Intelligence · Computer Science 2026-03-03 Ido Levy , Ben Wiesel , Sami Marreed , Alon Oved , Avi Yaeli , Segev Shlomov

The rapid evolution of Multi-modal Large Language Models (MLLMs) has advanced workflow automation; however, existing research mainly targets performance upper bounds in static environments, overlooking robustness for stochastic real-world…

Artificial Intelligence · Computer Science 2026-01-14 Daocheng Fu , Jianbiao Mei , Rong Wu , Xuemeng Yang , Jia Xu , Ding Wang , Pinlong Cai , Yong Liu , Licheng Wen , Botian Shi

We present TextAtari, a benchmark for evaluating language agents on very long-horizon decision-making tasks spanning up to 100,000 steps. By translating the visual state representations of classic Atari games into rich textual descriptions,…

Computation and Language · Computer Science 2025-06-11 Wenhao Li , Wenwu Li , Chuyun Shen , Junjie Sheng , Zixiao Huang , Di Wu , Yun Hua , Wei Yin , Xiangfeng Wang , Hongyuan Zha , Bo Jin

Search engines are the preferred tools for finding information on the Web. They are advancing to be the common helpers to answer any of our search needs. We use them to carry out simple look-up tasks and also to work on rather time…

Information Retrieval · Computer Science 2012-06-13 Georg Singer , Ulrich Norbisrath , Dirk Lewandowski

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…

AI agents have been developed for complex real-world tasks from coding to customer service. But AI agent evaluations suffer from many challenges that undermine our understanding of how well agents really work. We introduce the Holistic…

Modern web agents possess computer use abilities that allow them to interact with webpages by sending commands to a virtual keyboard and mouse. While such agents have considerable potential to assist human users with complex tasks,…

Artificial Intelligence · Computer Science 2025-07-25 Yixiao Song , Katherine Thai , Chau Minh Pham , Yapei Chang , Mazin Nadaf , Mohit Iyyer

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from…

Artificial Intelligence · Computer Science 2025-09-26 Kaiwen He , Zhiwei Wang , Chenyi Zhuang , Jinjie Gu

Recent studies have delved into constructing generalist agents for open-world environments like Minecraft. Despite the encouraging results, existing efforts mainly focus on solving basic programmatic tasks, e.g., material collection and…

Artificial Intelligence · Computer Science 2025-06-03 Shunyu Liu , Yaoru Li , Kongcheng Zhang , Zhenyu Cui , Wenkai Fang , Yuxuan Zheng , Tongya Zheng , Mingli Song

As multimodal large language models (MLLMs) advance, MLLM-based virtual agents have demonstrated remarkable performance. However, existing benchmarks face significant limitations, including uncontrollable task complexity, extensive manual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Wendong Bu , Yang Wu , Qifan Yu , Minghe Gao , Bingchen Miao , Zhenkui Zhang , Kaihang Pan , Yunfei Li , Mengze Li , Wei Ji , Juncheng Li , Siliang Tang , Yueting Zhuang

Large Language Models (LLMs), such as OpenAI-o1 and DeepSeek-R1, have demonstrated strong reasoning capabilities. To further enhance LLM capabilities, recent agentic systems, such as Deep Research, incorporate web interactions into LLM…

Artificial Intelligence · Computer Science 2025-10-21 Song Bian , Minghao Yan , Anand Jayarajan , Gennady Pekhimenko , Shivaram Venkataraman

General web-based agents are increasingly essential for interacting with complex web environments, yet their performance in real-world web applications remains poor, yielding extremely low accuracy even with state-of-the-art frontier…

Artificial Intelligence · Computer Science 2026-03-03 Segev Shlomov , Ben wiesel , Aviad Sela , Ido Levy , Liane Galanti , Roy Abitbol