English
Related papers

Related papers: HippoCamp: Benchmarking Contextual Agents on Perso…

200 papers

Modern Large Language Model (LLM) agents promise end to end assistance with real-world software tasks, yet existing benchmarks evaluate LLM agents almost exclusively in pre-baked environments where every dependency is pre-installed. To fill…

Software Engineering · Computer Science 2025-07-15 Avi Arora , Jinu Jang , Roshanak Zilouchian Moghaddam

Recent advancements in large language models (LLMs) have revealed their potential for achieving autonomous agents possessing human-level intelligence. However, existing benchmarks for evaluating LLM Agents either use static datasets,…

Computation and Language · Computer Science 2024-02-27 Junzhe Chen , Xuming Hu , Shuodi Liu , Shiyu Huang , Wei-Wei Tu , Zhaofeng He , Lijie Wen

Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing…

Large language and vision-language models increasingly power agents that act on a user's behalf through command-line interface (CLI) harnesses. However, most agent benchmarks still rely on synthetic sandboxes, short-horizon tasks,…

Recent advances in large language models (LLMs) have led to remarkable progress across domains, yet their capabilities in the humanities, particularly history, remain underexplored. Historical reasoning poses unique challenges for AI,…

The development of autonomous agents increasingly relies on Multimodal Language Models (MLMs) to perform tasks described in natural language with GUI environments, such as websites, desktop computers, or mobile phones. Existing benchmarks…

The rapid advances of multimodal agents built on large foundation models have largely overlooked their potential for language-based communication between agents in collaborative tasks. This oversight presents a critical gap in understanding…

Artificial Intelligence · Computer Science 2025-12-17 Timothy Ossowski , Danyal Maqbool , Jixuan Chen , Zefan Cai , Tyler Bradshaw , Junjie Hu

Autonomous embodied agents live on an Internet of multimedia websites. Can they hop around multimodal websites to complete complex user tasks? Existing benchmarks fail to assess them in a realistic, evolving environment for their embodiment…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shulin Tian , Ziniu Zhang , Liangyu Chen , Ziwei Liu

Current LLM agents are proficient at calling isolated APIs but struggle with the "last mile" of commercial software automation. In real-world scenarios, tools are not independent; they are atomic, interdependent, and prone to environmental…

Artificial Intelligence · Computer Science 2026-05-21 Yuanyang Li , Xue Yang , Longyue Wang , Weihua Luo , Hongyang Chen

AI agents increasingly operate over extended time horizons, yet their ability to retain, organize, and recall multimodal experiences remains a critical bottleneck. Building effective lifelong memory requires navigating a vast design space…

Artificial Intelligence · Computer Science 2026-04-03 Jiaqi Liu , Zipeng Ling , Shi Qiu , Yanqing Liu , Siwei Han , Peng Xia , Haoqin Tu , Zeyu Zheng , Cihang Xie , Charles Fleming , Mingyu Ding , Huaxiu Yao

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Multimodal large language models (MLLMs), equipped with increasingly advanced planning and tool-use capabilities, are evolving into autonomous agents capable of performing multimodal web browsing and deep search in open-world environments.…

As large language model (LLM)-based agents become increasingly integrated into daily digital interactions, their ability to reason across long interaction histories becomes crucial for providing personalized and contextually aware…

Machine Learning · Computer Science 2025-12-05 Andy Chung , Yichi Zhang , Kaixiang Lin , Aditya Rawal , Qiaozi Gao , Joyce Chai

While GUI agents have shown impressive capabilities in common computer-use tasks such as OSWorld, current benchmarks mainly focus on isolated and single-application tasks. This overlooks a critical real-world requirement of coordinating…

Artificial Intelligence · Computer Science 2026-05-01 Jinchao Li , Yunxin Li , Chenrui Zhao , Zhenran Xu , Baotian Hu , Min Zhang

Large Language Models (LLMs) and LLM-based agents show great promise in accelerating scientific research. Existing benchmarks for measuring this potential and guiding future development continue to evolve from pure recall and rote knowledge…

Large language models (LLMs) are increasingly envisioned as decision-support tools in clinical practice, yet safe clinical reasoning demands integrating heterogeneous knowledge bases -- trials, primary studies, regulatory documents, and…

Computation and Language · Computer Science 2025-05-22 Shan Chen , Pedro Moreira , Yuxin Xiao , Sam Schmidgall , Jeremy Warner , Hugo Aerts , Thomas Hartvigsen , Jack Gallifant , Danielle S. Bitterman

Recent advances in large language models (LLMs) have increased the demand for comprehensive benchmarks to evaluate their capabilities as human-like agents. Existing benchmarks, while useful, often focus on specific application scenarios,…

Recent advances in AI-assisted programming have empowered agents to execute complex workflows via command-line interfaces, however, existing benchmarks are limited by short task horizons, data contamination from GitHub scraping, and a lack…

Large language models are increasingly deployed in multi-agent systems to overcome context limitations by distributing information across agents. Yet whether agents can reliably compute with distributed information, rather than merely…

Multiagent Systems · Computer Science 2026-04-15 Yuzhe Zhang , Feiran Liu , Yi Shan , Xinyi Huang , Xin Yang , Yueqi Zhu , Xuxin Cheng , Cao Liu , Ke Zeng , Terry Jingchen Zhang , Wenyuan Jiang

The rapid advancement of Multimodal Large Language Models (MLLMs) has enabled browsing agents to acquire and reason over multimodal information in the real world. But existing benchmarks suffer from two limitations: insufficient evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhengbo Zhang , Jinbo Su , Zhaowen Zhou , Changtao Miao , Yuhan Hong , Qimeng Wu , Yumeng Liu , Feier Wu , Yihe Tian , Yuhao Liang , Zitong Shan , Wanke Xia , Yi-Fan Zhang , Bo Zhang , Zhe Li , Shiming Xiang , Ying Yan