English
Related papers

Related papers: Recovering Policy-Induced Errors: Benchmarking and…

200 papers

Deep research systems are widely used for multi-step web research, analysis, and cross-source synthesis, yet their evaluation remains challenging. Existing benchmarks often require annotation-intensive task construction, rely on static…

Computation and Language · Computer Science 2026-01-15 Yibo Wang , Lei Wang , Yue Deng , Keming Wu , Yao Xiao , Huanjin Yao , Liwei Kang , Hai Ye , Yongcheng Jing , Lidong Bing

Computer use agents (CUAs) can operate real-world digital interfaces but remain difficult to train due to the high cost of graphical user interface (GUI) interaction and the scarcity of high-quality trajectory data. Existing datasets rely…

Machine Learning · Computer Science 2026-02-06 Yifei He , Pranit Chawla , Yaser Souri , Subhojit Som , Xia Song

While Retrieval Augmented Generation (RAG) is now widely adopted to enhance LLMs, evaluating its true performance benefits in a reproducible and interpretable way remains a major hurdle. Existing methods often fall short: they lack domain…

Information Retrieval · Computer Science 2025-08-11 Jiaxuan Liang , Shide Zhou , Kailong Wang

As autonomous agents become adept at understanding and interacting with graphical user interface (GUI) environments, a new era of automated task execution is emerging. Recent studies have demonstrated that Reinforcement Learning (RL) can…

Artificial Intelligence · Computer Science 2026-03-16 Songqin Nong , Xiaoxuan Tang , Jingxuan Xu , Sheng Zhou , Jianfeng Chen , Tao Jiang , Wenhao Xu

Large language models (LLMs) struggle with maintaining accurate knowledge due to conflicting/outdated parametric memories. While locate-and-edit methods address this, their reliance on models' internal representations leads to robustness…

Computation and Language · Computer Science 2025-05-23 Jianhao Yan , Futing Wang , Yun Luo , Yafu Li , Yue Zhang

Go4 developed at GSI is an analysis framework with a general purpose non blocking GUI. Go4 is based on ROOT. The GUI is implemented in Qt using GSI's QtROOT interface. Analysis and GUI run in separate tasks communicating through…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. Adamczewski , M. Al-Turany , D. Bertini , H. G. Essel , S. Linev

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Computation and Language · Computer Science 2025-10-09 Shuang Sun , Huatong Song , Yuhao Wang , Ruiyang Ren , Jinhao Jiang , Junjie Zhang , Fei Bai , Jia Deng , Wayne Xin Zhao , Zheng Liu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

GUI agents have emerged as a powerful paradigm for automating interactions in digital environments, yet achieving both broad generality and consistently strong task performance remains challenging. In this report, we present UI-Venus-1.5, a…

Recent progress in Multimodal Large Language Models (MLLMs) has enabled mobile GUI agents capable of visual perception, cross-modal reasoning, and interactive control. However, existing benchmarks are largely English-centric and fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yang Li , Yuchen Liu , Haoyu Lu , Zhiqiang Xia , Hongzhen Wang , Kaiyang Han , Changpeng Yang , Jinyang Wu , Jiaming Xu , Runyu Shi , Ying Huang

Developing multi-turn interactive tool-use agents is challenging because real-world user needs are often complex and ambiguous, yet agents must execute deterministic actions to satisfy them. To address this gap, we introduce \textbf{CoVe}…

Artificial Intelligence · Computer Science 2026-03-03 Jinpeng Chen , Cheng Gong , Hanbo Li , Ziru Liu , Zichen Tian , Xinyu Fu , Shi Wu , Chenyang Zhang , Wu Zhang , Suiyun Zhang , Dandan Tu , Rui Liu

Equipping Large Language Model (LLM) agents with domain-specific skills is critical for tackling complex tasks. Yet, manual authoring creates a severe scalability bottleneck. Conversely, automated skill generation often yields fragile or…

Artificial Intelligence · Computer Science 2026-04-28 Jingwei Ni , Yihao Liu , Xinpeng Liu , Yutao Sun , Mengyu Zhou , Pengyu Cheng , Dexin Wang , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Despite remarkable advances in Large Language Model capabilities, tool retrieval for agent-based systems remains fundamentally limited by reliance on semantic similarity, which fails to capture functional viability. Current methods often…

Machine Learning · Computer Science 2025-10-22 Zongze Wu , Yani Guo , Churong Liang , Runnan Li

GUI grounding models report over 85% accuracy on standard benchmarks, yet drop 27-56 percentage points when instructions require spatial reasoning rather than direct element naming. Current benchmarks miss this because they evaluate each…

Machine Learning · Computer Science 2026-04-17 Yangyue Wang , Harshvardhan Sikka , Yash Mathur , Tony Zhou , Jinu Nyachhyon , Pranav Guruprasad

Many deployed systems expose black-box objectives whose minimizing configuration shifts with an externally observed context. When contexts revisit a small set of latent regimes, an optimizer that discards history pays repeated adaptation…

Machine Learning · Computer Science 2026-04-21 Enze Pan

Multimodal Large Language Models (MLLMs) have shown great potential in revolutionizing Graphical User Interface (GUI) automation. However, existing GUI models mostly rely on learning from nearly error-free offline trajectories, thus lacking…

Artificial Intelligence · Computer Science 2025-06-10 Penghao Wu , Shengnan Ma , Bo Wang , Jiaheng Yu , Lewei Lu , Ziwei Liu

While generative video models have achieved remarkable visual fidelity, their capacity to internalize and reason over implicit world rules remains a critical yet under-explored frontier. To bridge this gap, we present RISE-Video, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mingxin Liu , Shuran Ma , Shibei Meng , Xiangyu Zhao , Zicheng Zhang , Shaofeng Zhang , Zhihang Zhong , Peixian Chen , Haoyu Cao , Xing Sun , Haodong Duan , Xue Yang

Recent advancements in software engineering agents have demonstrated promising capabilities in automating program improvements. However, their reliance on closed-source or resource-intensive models introduces significant deployment…

Software Engineering · Computer Science 2025-04-09 Yingwei Ma , Yongbin Li , Yihong Dong , Xue Jiang , Rongyu Cao , Jue Chen , Fei Huang , Binhua Li

Nowadays, research on GUI agents is a hot topic in the AI community. However, current research focuses on GUI task automation, limiting the scope of applications in various GUI scenarios. In this paper, we propose a formalized and…

Artificial Intelligence · Computer Science 2024-12-25 Kangjia Zhao , Jiahui Song , Leigang Sha , Haozhan Shen , Zhi Chen , Tiancheng Zhao , Xiubo Liang , Jianwei Yin

RL post-training for LLMs has been widely scaled to enhance reasoning and tool-using capabilities. However, RL post-training interleaves training and inference workloads, exposing the system to faults from both sides. Existing fault…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Zhenqian Chen , Baoquan Zhong , Xiang Li , Qing Dai , Xinkui Zhao , Miao Ye , Ren Cheng , Lufei Zhang , Jianwei Yin

GUI task automation streamlines repetitive tasks, but existing LLM or VLM-based planner-executor agents suffer from brittle generalization, high latency, and limited long-horizon coherence. Their reliance on single-shot reasoning or static…

Artificial Intelligence · Computer Science 2025-09-29 Seoyoung Lee , Seonbin Yoon , Seongbeen Lee , Hyesoo Kim , Joo Yong Sim