English
Related papers

Related papers: Recovering Policy-Induced Errors: Benchmarking and…

200 papers

Graphical User Interface (GUI) agents have demonstrated remarkable progress in automating complex user interface interactions through reinforcement learning. However, current approaches face a fundamental dilemma: offline RL enables stable…

Machine Learning · Computer Science 2025-09-25 Zhengxi Lu , Jiabo Ye , Fei Tang , Yongliang Shen , Haiyang Xu , Ziwei Zheng , Weiming Lu , Ming Yan , Fei Huang , Jun Xiao , Yueting Zhuang

Tool-use language agents are evaluated on benchmarks that assume clean inputs, unambiguous tool registries, and reliable APIs. Real deployments violate all these assumptions: user typos propagate into hallucinated tool names, a…

Large Language Models (LLMs) are increasingly used to generate natural-language explanations in recommender systems, acting as explanation agents that reason over user behavior histories. While prior work has focused on explanation fluency…

Information Retrieval · Computer Science 2026-02-04 Guilin Zhang , Kai Zhao , Jeffrey Friedman , Xu Chu

We present a simple and efficient method to leverage emerging text-to-image generative models in creating large-scale synthetic supervision for the task of damage assessment from aerial images. While significant recent advances have…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Tarun Kalluri , Jihyeon Lee , Kihyuk Sohn , Sahil Singla , Manmohan Chandraker , Joseph Xu , Jeremiah Liu

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…

A widely adopted strategy for model enhancement is to use synthetic data generated by a stronger model for supervised fine-tuning (SFT). However, for emerging reasoning models like Qwen3-8B, this approach often fails to improve reasoning…

Computation and Language · Computer Science 2026-04-22 Zixian Huang , Kaichen Yang , Xu Huang , Feiyang Hao , Qiming Ge , Bowen Li , He Du , Kai Chen , Qipeng Guo

High-quality structured data with rich annotations are critical components in intelligent vehicle systems dealing with road scenes. However, data curation and annotation require intensive investments and yield low-diversity scenarios. The…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Shubham Dokania , Anbumani Subramanian , Manmohan Chandraker , C. V. Jawahar

Training deep research agents requires long-horizon trajectories that interleave search, evidence aggregation, and multi-step reasoning. However, existing data collection pipelines typically rely on proprietary web APIs, making large-scale…

Information Retrieval · Computer Science 2026-03-24 Zhuofeng Li , Dongfu Jiang , Xueguang Ma , Haoxiang Zhang , Ping Nie , Yuyu Zhang , Kai Zou , Jianwen Xie , Yu Zhang , Wenhu Chen

Context. Multiple automated techniques have been proposed and developed for mobile application GUI testing aiming to improve effectiveness, efficiency, and practicality. The effectiveness, efficiency, and practicality are 3 fundamental…

Software Engineering · Computer Science 2019-01-01 Yauhen Leanidavich Arnatovich , Lipo Wang

In this paper, we aim to enhance the robustness of Universal Information Extraction (UIE) by introducing a new benchmark dataset, a comprehensive evaluation, and a feasible solution. Existing robust benchmark datasets have two key…

Computation and Language · Computer Science 2025-03-06 Jizhao Zhu , Akang Shi , Zixuan Li , Long Bai , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved from a knowledge base. However, its effectiveness is fundamentally constrained by the reliability of both the retriever…

Computation and Language · Computer Science 2025-01-31 Yiteng Tu , Weihang Su , Yujia Zhou , Yiqun Liu , Qingyao Ai

Generative AI systems achieve impressive performance on standard benchmarks yet fail to deliver real-world utility, a disconnect we identify across 28 deployment cases spanning education, healthcare, software engineering, and law. We argue…

Machine Learning · Computer Science 2026-05-12 Ishani Mondal , Shweta Bhardwaj

Despite significant progress having been made in question answering on tabular data (Table QA), it's unclear whether, and to what extent existing Table QA models are robust to task-specific perturbations, e.g., replacing key question…

Computation and Language · Computer Science 2023-06-27 Yilun Zhao , Chen Zhao , Linyong Nan , Zhenting Qi , Wenlin Zhang , Xiangru Tang , Boyu Mi , Dragomir Radev

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

Agentic Test-Time Scaling (TTS) has delivered state-of-the-art (SOTA) performance on complex software engineering tasks such as code generation and bug fixing. However, its practical adoption remains limited due to significant computational…

Software Engineering · Computer Science 2026-05-14 Chenhui Mao , Yuanting Lei , Zhixiang Wei , Ming Liang , Zhixiang Wang , Jingxuan Xu , Dajun Chen , Wei Jiang , Yong Li

We present SynthTextEval, a toolkit for conducting comprehensive evaluations of synthetic text. The fluency of large language model (LLM) outputs has made synthetic text potentially viable for numerous applications, such as reducing the…

Computation and Language · Computer Science 2025-11-04 Krithika Ramesh , Daniel Smolyak , Zihao Zhao , Nupoor Gandhi , Ritu Agarwal , Margrét Bjarnadóttir , Anjalie Field

Modern AI agents execute real-world side effects through tool calls such as file operations, shell commands, HTTP requests, and database queries. A single unsafe action, including accidental deletion, credential exposure, or data…

Artificial Intelligence · Computer Science 2026-05-07 Chenglin Yang

AI agents that interact with graphical user interfaces (GUIs) require effective observation representations for reliable grounding. The accessibility tree is a commonly used text-based format that encodes UI element attributes, but it…

Computation and Language · Computer Science 2026-05-04 Michito Takeshita , Takuro Kawada , Takumi Ohashi , Shunsuke Kitada , Hitoshi Iyatomi

While Multimodal Large Language Models (MLLMs) have advanced GUI navigation agents, current approaches face limitations in cross-domain generalization and effective history utilization. We present a reasoning-enhanced framework that…

Artificial Intelligence · Computer Science 2025-11-03 Tao Liu , Chongyu Wang , Rongjie Li , Yingchen Yu , Xuming He , Bai Song

Research on self-evolving language agents has accelerated, drawing increasing attention to their ability to create, adapt, and maintain tools from task requirements. However, existing benchmarks predominantly rely on predefined…

Software Engineering · Computer Science 2026-03-09 Bowei Xia , Mengkang Hu , Shijian Wang , Jiarui Jin , Wenxiang Jiao , Yuan Lu , Kexin Li , Ping Luo