English
Related papers

Related papers: DiagEval: Trajectory-Conditioned Diagnosis for Rel…

200 papers

Visual language model (VLM) agents show great promise in automating end-to-end (E2E) web testing against requirements in natural language. However, the probabilistic nature of language models can have inherent hallucinations. Therefore,…

Software Engineering · Computer Science 2026-04-24 Xiwen Teoh , Yun Lin , Duc-Minh Nguyen , Ruofei Ren , Wenjie Zhang , Jin Song Dong

Large language models are increasingly deployed as autonomous agents for multi-step workflows in real-world software environments. However, existing agent benchmarks are limited by trajectory-opaque grading, underspecified safety and…

Artificial Intelligence · Computer Science 2026-05-08 Bowen Ye , Rang Li , Qibin Yang , Yuanxin Liu , Linli Yao , Hanglong Lv , Zhihui Xie , Chenxin An , Lei Li , Lingpeng Kong , Qi Liu , Zhifang Sui , Tong Yang

A dialogue is essentially a multi-turn interaction among interlocutors. Effective evaluation metrics should reflect the dynamics of such interaction. Existing automatic metrics are focused very much on the turn-level quality, while ignoring…

Computation and Language · Computer Science 2021-06-08 Chen Zhang , Yiming Chen , Luis Fernando D'Haro , Yan Zhang , Thomas Friedrichs , Grandee Lee , Haizhou Li

Causal discovery is increasingly applied to large-scale telemetry data to estimate the effects of user-facing interventions, yet its reliability for decision-making in feedback-driven systems with strong self-selection remains unclear. In…

Artificial Intelligence · Computer Science 2026-02-10 Hoang Dang , Luan Pham , Minh Nguyen

Multi-agent systems powered by large language models (LLMs) are transforming enterprise automation, yet systematic evaluation methodologies for assessing tool-use reliability remain underdeveloped. We introduce a comprehensive diagnostic…

Artificial Intelligence · Computer Science 2026-01-26 Donghao Huang , Gauri Malwe , Zhaoxia Wang

Recently, LLM agents have made rapid progress in improving their programming capabilities. However, existing benchmarks lack the ability to automatically evaluate from users' perspective, and also lack the explainability of the results of…

Software Engineering · Computer Science 2025-06-03 Kaiyuan Liu , Youcheng Pan , Yang Xiang , Daojing He , Jing Li , Yexing Du , Tianrun Gao

Open-source native GUI agents still lag behind closed-source systems on long-horizon navigation tasks. This gap stems from two limitations: a shortage of high-quality, action-aligned reasoning data, and the direct adoption of generic…

Machine Learning · Computer Science 2026-05-27 Rui Yang , Qianhui Wu , Zhaoyang Wang , Hanyang Chen , Ke Yang , Hao Cheng , Huaxiu Yao , Baolin Peng , Huan Zhang , Jianfeng Gao , Tong Zhang

We address the problem of runtime trajectory anomaly detection, a critical capability for enabling trustworthy LLM agents. Current safety measures predominantly focus on static input/output filtering. However, we argue that ensuring LLM…

Cryptography and Security · Computer Science 2026-02-09 Yibing Liu , Chong Zhang , Zhongyi Han , Hansong Liu , Yong Wang , Yang Yu , Xiaoyan Wang , Yilong Yin

Automated Program Repair (APR) struggles with complex logic errors and silent failures. Current LLM-based APR methods are mostly static, relying on source code and basic test outputs, which fail to accurately capture complex runtime…

Software Engineering · Computer Science 2026-04-06 Jiaqing Wu , Tong Wu , Manqing Zhang , Yunwei Dong , Bo Shen

Comprehensive evaluation of mobile agents can significantly advance their development and real-world applicability. However, existing benchmarks lack practicality and scalability due to the extensive manual effort in defining task reward…

Artificial Intelligence · Computer Science 2025-09-25 Jiahui Sun , Zhichao Hua , Yubin Xia

The reliable evaluation of large language models (LLMs) in medical applications remains an open challenge, particularly in capturing the complexity of multi-turn doctor-patient interactions that unfold in real clinical environments.…

Artificial Intelligence · Computer Science 2025-10-15 Yuechun Yu , Han Ying , Haoan Jin , Wenjian Jiang , Dong Xian , Binghao Wang , Zhou Yang , Mengyue Wu

Code agents resolve 65-70% of SWE-bench Verified issues, but Pass@1 cannot tell us why the rest fail, and, as we show, capable-model failures are systematically misdiagnosed without trajectory data. We introduce TRAJEVAL, a training-free…

GUI agents are designed to automate repetitive tasks and enhance productivity. However, existing GUI agents struggle to recover once they follow an incorrect exploration path, often leading to task failure. In this work, we model GUI task…

Artificial Intelligence · Computer Science 2026-01-30 Ziyu Lu , Tengjin Weng , Yiying Yang , Yuhang Zhao , Xinxin Huang , Wenhao Jiang

Large language model (LLM)-based multi-agent systems are challenging to debug because failures often arise from long, branching interaction traces. The prevailing practice is to leverage LLMs for log-based failure localization, attributing…

Artificial Intelligence · Computer Science 2026-02-03 Ming Ma , Jue Zhang , Fangkai Yang , Yu Kang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

LLM-driven GUI agents are increasingly used in production systems to automate workflows and simulate users for evaluation and optimization. Yet most GUI-agent evaluations emphasize task success and provide limited evidence on whether agents…

Information Retrieval · Computer Science 2026-04-10 Maria Movin , Claudia Hauff , Aron Henriksson , Panagiotis Papapetrou

Auto-regressive LLM-based software engineering (SWE) agents, henceforth SWE agents, have made tremendous progress (>60% on SWE-Bench Verified) on real-world coding challenges including GitHub issue resolution. SWE agents use a combination…

Software Engineering · Computer Science 2025-04-15 Timothy Bula , Saurabh Pujar , Luca Buratti , Mihaela Bornea , Avirup Sil

Despite remarkable advances in Large Language Model capabilities, tool retrieval for agent-based systems remains fundamentally limited by reliance on semantic similarity, which fails to capture functional viability. Current methods often…

Machine Learning · Computer Science 2025-10-22 Zongze Wu , Yani Guo , Churong Liang , Runnan Li

As multimodal LLM-driven agents advance in autonomy and generalization, traditional static datasets face inherent scalability limitations and are insufficient for fully assessing their capabilities in increasingly complex and diverse tasks.…

Computation and Language · Computer Science 2026-03-06 Yurun Chen , Xavier Hu , Yuhan Liu , Ziqi Wang , Zeyi Liao , Lin Chen , Feng Wei , Yuxi Qian , Bo Zheng , Keting Yin , Shengyu Zhang

Graphical User Interface (GUI) agents are increasingly deployed to interact with online web services, yet their exposure to open-world content renders them vulnerable to Environmental Injection Attacks (EIAs). In these attacks, an attacker…

Cryptography and Security · Computer Science 2026-02-03 Yitong Zhang , Ximo Li , Liyi Cai , Jia Li

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu