中文
相关论文

相关论文: RubricRefine: Improving Tool-Use Agent Reliability…

200 篇论文

Pointwise reward modeling offers critical signals for LLM post-training, yet struggles with absolute scoring in subjective, non-verifiable settings. Rubric-based methods address this by decomposing evaluation into explicit criteria, but…

机器学习 · 计算机科学 2026-05-29 Haoxiang Jiang , Zihan Dong , Tianci Liu , Wanying Wang , Ran Xu , Tony Yu , Linjun Zhang , Haoyu Wang

Manufacturing processes are often perturbed by drifts in the environment and wear in the system, requiring control re-tuning even in the presence of repetitive operations. This paper presents an iterative learning framework for automatic…

机器人学 · 计算机科学 2026-01-05 Deepak Ingole , Valentin Bhend , Shiva Ganesh Murali , Oliver Dobrich , Alisa Rupenyan

In an unfamiliar setting, a model-based reinforcement learning agent can be limited by the accuracy of its world model. In this work, we present a novel, training-free approach to improving the performance of such agents separately from…

机器学习 · 计算机科学 2024-02-26 Martin Benfeghoul , Umais Zahid , Qinghai Guo , Zafeirios Fountas

Designing aligned and robust rewards for open-ended generation remains a key barrier to RL post-training. Rubrics provide structured, interpretable supervision, but scaling rubric construction is difficult: expert rubrics are costly,…

The foundational capabilities of large language models (LLMs) are deeply influenced by the quality of their pre-training corpora. However, enhancing data quality at scale remains a significant challenge, primarily due to the trade-off…

Reinforcement learning with verifiable rewards has become a common way to improve explicit reasoning in large language models, but final-answer correctness alone does not reveal whether the reasoning trace is faithful, reliable, or useful…

人工智能 · 计算机科学 2026-05-08 Tianyang Han , Hengyu Shi , Junjie Hu , Xu Yang , Zhiling Wang , Junhao Su

Code repair is a fundamental task in software development, facilitating efficient bug resolution and software maintenance. Although large language models (LLMs) have demonstrated considerable potential in automated code repair, their…

软件工程 · 计算机科学 2026-02-27 Dekun Dai , MingWei Liu , Anji Li , Jialun Cao , Yanlin Wang , Chong Wang , Xin Peng , Zibin Zheng

Automated radiology report generation (R2Gen) has advanced significantly, introducing challenges in accurate evaluation due to its complexity. Traditional metrics often fall short by relying on rigid word-matching or focusing only on…

计算与语言 · 计算机科学 2025-02-14 Yunyi Liu , Yingshu Li , Zhanyu Wang , Xinyu Liang , Lingqiao Liu , Lei Wang , Luping Zhou

Large language model (LLM) agents have emerged as a promising solution to automate the workflow of machine learning, but most existing methods share a common limitation: they attempt to optimize entire pipelines in a single step before…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Eric Xue , Ke Chen , Zeyi Huang , Yuyang Ji , Haohan Wang

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

机器学习 · 计算机科学 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Clinical trials constitute a critical yet exceptionally challenging and costly stage of drug development (\$2.6B per drug), where protocols are encoded as complex natural language documents, motivating the use of AI systems beyond manual…

人工智能 · 计算机科学 2026-04-06 Sixue Xing , Kerui Wu , Xuanye Xia , Meng Jiang , Jintai Chen , Tianfan Fu

Large Language Models' (LLM) reasoning can be improved using test-time aggregation strategies, i.e., generating multiple samples and voting among generated samples. While these improve performance, they often reach a saturation point.…

计算与语言 · 计算机科学 2025-09-18 Justin Chih-Yao Chen , Archiki Prasad , Swarnadeep Saha , Elias Stengel-Eskin , Mohit Bansal

The rapid expansion of scholarly literature presents significant challenges in synthesizing comprehensive, high-quality academic surveys. Recent advancements in agentic systems offer considerable promise for automating tasks that…

数字图书馆 · 计算机科学 2025-11-25 Zi Wang , Xingqiao Wang , Sangah Lee , Xiaowei Xu

Self-generated skills for web agents are often unstable and can even hurt performance relative to direct acting. We argue that the key bottleneck is not only skill generation quality, but the fact that web skills remain implicit and…

软件工程 · 计算机科学 2026-04-16 Zijian Lu , Yiping Zuo , Yupeng Nie , Xin He , Weibei Fan , Lianyong Qi , Shi Jin

Reinforcement fine-tuning (RFT) has become a core paradigm for post-training large language models, yet its training process remains highly fragile. Existing efforts mainly improve reliability at the system level or address specific issues…

软件工程 · 计算机科学 2026-05-07 Lingzhe Zhang , Tong Jia , Yunpeng Zhai , Liancheng Fang , Kening Zheng , Hongyi Liu , Xiaosong Huang , Philip S. Yu , Ying Li

Large language model agents that use external tools are often implemented through reactive execution, in which reasoning is repeatedly recomputed after each observation, increasing latency and sensitivity to error propagation. This work…

人工智能 · 计算机科学 2026-04-07 Paulo Akira F. Enabe

Machine learning components are now central to AI-infused software systems, from recommendations and code assistants to clinical decision support. As regulations and governance frameworks increasingly require deleting sensitive data from…

机器学习 · 计算机科学 2026-04-21 Anna Mazhar , Sainyam Galhotra

Code review is a crucial process before deploying code to production, as it validates the code, provides suggestions for improvements, and identifies errors such as missed edge cases. In projects with regular production releases, the effort…

软件工程 · 计算机科学 2024-12-23 Jahnavi Kumar , Sridhar Chimalakonda

Reasoning language models can solve increasingly complex tasks, but struggle to produce the calibrated confidence estimates necessary for reliable deployment. Existing calibration methods usually depend on labels or repeated sampling at…

机器学习 · 计算机科学 2026-04-22 Thomas Zollo , Jimmy Wang , Richard Zemel

Code review is a fundamental process in software development that plays a pivotal role in ensuring code quality and reducing the likelihood of errors and bugs. However, code review can be complex, subjective, and time-consuming. Quality…

软件工程 · 计算机科学 2024-02-06 Oussama Ben Sghaier , Houari Sahraoui