English
Related papers

Related papers: KnowU-Bench: Towards Interactive, Proactive, and P…

200 papers

AI agents are expected to perform professional work across hundreds of occupational domains (from emergency department triage to nuclear reactor safety monitoring to customs import processing), yet existing benchmarks can only evaluate…

Computation and Language · Computer Science 2026-04-17 Xiaomeng Hu , Yinger Zhang , Fei Huang , Jianhong Tu , Yang Su , Lianghao Deng , Yuxuan Liu , Yantao Liu , Dayiheng Liu , Tsung-Yi Ho

Emotional intelligence (EI), the ability to perceive, understand, and respond appropriately to others' emotional states, is central to human communication, and increasingly important to assess as LLMs assume conversational roles in everyday…

Artificial Intelligence · Computer Science 2026-05-29 Kate M. Lubrano , Faisal Sayed , Ankita Rathod , Akshansh , Craver Corbyn Thomas-Smith , Mark E. Whiting , Karina Nguyen

The rapid growth of AI agent ecosystems is transforming how complex tasks are delegated and executed, creating a new challenge of identifying suitable agents for a given task. Unlike traditional tools, agent capabilities are often…

Artificial Intelligence · Computer Science 2026-04-27 Bin Wu , Arastun Mammadli , Xiaoyu Zhang , Emine Yilmaz

LLM-based agents are increasingly moving towards proactivity: rather than awaiting instruction, they exercise agency to anticipate user needs and solve them autonomously. However, evaluating proactivity is challenging; current benchmarks…

Artificial Intelligence · Computer Science 2026-02-20 Gil Pasternak , Dheeraj Rajagopal , Julia White , Dhruv Atreja , Matthew Thomas , George Hurn-Maloney , Ash Lewis

Current evaluation frameworks and benchmarks for LLM powered agents focus on text chat driven agents, these frameworks do not expose the persona of user to the agent, thus operating in a user agnostic environment. Importantly, in customer…

Emerging Technologies · Computer Science 2026-04-17 Anupam Purwar , Aditya Choudhary

As GUI agents increasingly rely on screenshots to perceive and operate digital environments, they may inadvertently expose sensitive information such as identities, accounts, locations, and behavioral traces. While existing benchmarks…

Cryptography and Security · Computer Science 2026-05-14 Yanxi Wang , Zhiling Zhang , Wenbo Zhou , Weiming Zhang , Jie Zhang , Qiannan Zhu , Yu Shi , Shuxin Zheng , Jiyan He

Recommender systems play a central role in numerous real-life applications, yet evaluating their performance remains a significant challenge due to the gap between offline metrics and online behaviors. Given the scarcity and limits (e.g.,…

Information Retrieval · Computer Science 2025-04-18 Nicolas Bougie , Narimasa Watanabe

In this paper, we introduce ECom-Bench, the first benchmark framework for evaluating LLM agent with multimodal capabilities in the e-commerce customer support domain. ECom-Bench features dynamic user simulation based on persona information…

Computation and Language · Computer Science 2025-11-11 Haoxin Wang , Xianhan Peng , Xucheng Huang , Yizhe Huang , Ming Gong , Chenghan Yang , Yang Liu , Ling Jiang

Recent advances in code agents have enabled automated software development at the project level, supported by large language models (LLMs). However, existing benchmarks for code agent evaluation face two major limitations. First, creating…

Software Engineering · Computer Science 2026-03-24 Lingyue Fu , Bolun Zhang , Hao Guan , Yaoming Zhu , Lin Qiu , Weiwen Liu , Xuezhi Cao , Xunliang Cai , Weinan Zhang , Yong Yu

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

With the advancement of multimodal large language models (MLLMs) and coding agents, the website development has shifted from manual programming to agent-based project-level code synthesis. Existing benchmarks rely on idealized assumptions,…

Artificial Intelligence · Computer Science 2026-05-01 Qiyao Wang , Haoran Hu , Longze Chen , Hongbo Wang , Hamid Alinejad-Rokny , Yuan Lin , Min Yang

Proactive AR agents promise context-aware assistance, but their interactions often rely on explicit voice prompts or responses, which can be disruptive or socially awkward. We introduce Sensible Agent, a framework designed for unobtrusive…

Human-Computer Interaction · Computer Science 2025-11-03 Geonsun Lee , Min Xia , Nels Numan , Xun Qian , David Li , Yanhe Chen , Achin Kulshrestha , Ishan Chatterjee , Yinda Zhang , Dinesh Manocha , David Kim , Ruofei Du

Agents centered around Large Language Models (LLMs) are now capable of automating mobile device operations for users. After fine-tuning to learn a user's mobile operations, these agents can adhere to high-level user instructions online.…

Human-Computer Interaction · Computer Science 2024-01-18 Tinghe Ding

Multi-agent systems, which consist of multiple AI models interacting within a shared environment, are increasingly used for persona-based interactions. However, if not carefully designed, these systems can reinforce implicit biases in large…

Computation and Language · Computer Science 2025-07-03 Imran Mirza , Cole Huang , Ishwara Vasista , Rohan Patil , Asli Akalin , Sean O'Brien , Kevin Zhu

Recent advancements in Large Language Models (LLMs) have led to the development of intelligent LLM-based agents capable of interacting with graphical user interfaces (GUIs). These agents demonstrate strong reasoning and adaptability,…

Artificial Intelligence · Computer Science 2025-04-16 Wenjia Jiang , Yangyang Zhuang , Chenxi Song , Xu Yang , Joey Tianyi Zhou , Chi Zhang

Existing Multimodal Large Language Models (MLLMs) remain primarily reactive, failing to continuously perceive environments or proactively assist users. While emerging benchmarks address proactivity, they are largely confined to alert…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Dongchuan Ran , Linyu Ou , Xueheng Li , Wenwen Tong , Chenxu Guo , Hewei Guo , Kaibing Wang , Lewei Lu

With the rise of smart personal devices, service-oriented human-agent interactions have become increasingly prevalent. This trend highlights the need for personalized dialogue assistants that can understand user-specific traits to…

Computation and Language · Computer Science 2025-11-27 Zhaopei Huang , Qifeng Dai , Guozheng Wu , Xiaopeng Wu , Kehan Chen , Chuan Yu , Xubin Li , Tiezheng Ge , Wenxuan Wang , Qin Jin

Exploratory GUI testing is essential for software quality but suffers from high manual costs. While Multi-modal Large Language Model (MLLM) agents excel in navigation, they fail to autonomously discover defects due to two core challenges:…

Artificial Intelligence · Computer Science 2026-01-09 Yifei Gao , Jiang Wu , Xiaoyi Chen , Yifan Yang , Zhe Cui , Tianyi Ma , Jiaming Zhang , Jitao Sang

Evaluating AI agents within complex, interactive environments that mirror real-world challenges is critical for understanding their practical capabilities. While existing agent benchmarks effectively assess skills like tool use or…

Artificial Intelligence · Computer Science 2025-08-15 Long Phan , Mantas Mazeika , Andy Zou , Dan Hendrycks

In e-commerce, LLM agents show promise for shopping tasks such as recommendations, budget management, and bundle deals, where accurately capturing user preferences from long-horizon conversations is critical. However, progress is limited by…

Computation and Language · Computer Science 2026-05-28 Zijian Yu , Kejun Xiao , Huaipeng Zhao , Tao Luo , Xiaoyi Zeng