中文
相关论文

相关论文: Leveraging Reward Models for Guiding Code Review C…

200 篇论文

Code-generating Large Language Models (LLMs) have become essential tools in modern software development, enhancing productivity and accelerating development. This paper aims to investigate the fine-tuning of code-generating LLMs using…

软件工程 · 计算机科学 2025-05-06 Marina Sakharova , Abhinav Anand , Mira Mezini

Reinforcement learning (RL) to improve code review comment generation requires handling unstructured outputs, making reinforcement learning (RL) feedback challenging. The two main RL approaches, namely RL with Verifiable Feedback (RLVR) and…

软件工程 · 计算机科学 2025-06-03 Manav Nitin Kapadnis , Atharva Naik , Carolyn Rose

Modern code review is a critical quality assurance process that is widely adopted in both industry and open source software environments. This process can help newcomers learn from the feedback of experienced reviewers; however, it often…

软件工程 · 计算机科学 2024-02-07 Hong Yi Lin , Patanamon Thongtanunam , Christoph Treude , Wachiraphan Charoenwet

Although Deep Reinforcement Learning (DRL) has achieved notable success in numerous robotic applications, designing a high-performing reward function remains a challenging task that often requires substantial manual input. Recently, Large…

机器人学 · 计算机科学 2023-10-03 Jiayang Song , Zhehua Zhou , Jiawei Liu , Chunrong Fang , Zhan Shu , Lei Ma

Pre-trained Vision-Language Models (VLMs) are able to understand visual concepts, describe and decompose complex tasks into sub-tasks, and provide feedback on task completion. In this paper, we aim to leverage these capabilities to support…

机器学习 · 计算机科学 2024-02-08 David Venuto , Sami Nur Islam , Martin Klissarov , Doina Precup , Sherry Yang , Ankit Anand

Sampling diverse programs from a code language model and reranking with model likelihood is a popular method for code generation but it is prone to preferring degenerate solutions. Inspired by collaborative programming, we propose…

机器学习 · 计算机科学 2022-11-30 Tianyi Zhang , Tao Yu , Tatsunori B. Hashimoto , Mike Lewis , Wen-tau Yih , Daniel Fried , Sida I. Wang

In practice, rigorous reasoning is often a key driver of correct code, while Reinforcement Learning (RL) for code generation often neglects optimizing reasoning quality. Bringing process-level supervision into RL is appealing, but it faces…

软件工程 · 计算机科学 2026-05-06 Lishui Fan , Yu Zhang , Mouxiang Chen , Zhongxin Liu

Generating keyphrases that summarize the main points of a document is a fundamental task in natural language processing. Although existing generative models are capable of predicting multiple keyphrases for an input document as well as…

计算与语言 · 计算机科学 2019-06-11 Hou Pong Chan , Wang Chen , Lu Wang , Irwin King

Descriptive code comments are essential for supporting code comprehension and maintenance. We propose the task of automatically generating comments for overriding methods. We formulate a novel framework which accommodates the unique…

计算与语言 · 计算机科学 2021-04-20 Jiyang Zhang , Sheena Panthaplackel , Pengyu Nie , Raymond J. Mooney , Junyi Jessy Li , Milos Gligoric

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

机器学习 · 计算机科学 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Code comment generation aims to generate high-quality comments from source code automatically and has been studied for years. Recent studies proposed to integrate information retrieval techniques with neural generation models to tackle this…

软件工程 · 计算机科学 2024-08-08 Hanzhen Lu , Zhongxin Liu

Peer review is essential for scientific progress but faces growing challenges due to increasing submission volumes and reviewer fatigue. Existing automated review approaches struggle with factual accuracy, rating consistency, and analytical…

计算与语言 · 计算机科学 2025-08-15 Sihang Zeng , Kai Tian , Kaiyan Zhang , Yuru wang , Junqi Gao , Runze Liu , Sa Yang , Jingxuan Li , Xinwei Long , Jiaheng Ma , Biqing Qi , Bowen Zhou

Code review is a well-established and valued practice in the software engineering community contributing to both code quality and interpersonal benefits. However, there are challenges in both tools and processes that give rise to…

软件工程 · 计算机科学 2025-07-15 Lo Gullstrand Heander , Emma Söderberg , Christofer Rydenfält

This paper explores a novel method for enhancing binary classification models that assess code comment quality, leveraging Generative Artificial Intelligence to elevate model performance. By integrating 1,437 newly generated code-comment…

软件工程 · 计算机科学 2024-10-30 Seetharam Killivalavan , Durairaj Thenmozhi

Software maintenance constitutes a substantial portion of the total lifetime costs of software, with a significant portion attributed to code comprehension. Software comprehension is eased by documentation such as comments that summarize…

软件工程 · 计算机科学 2024-07-19 Skyler Grandel , Scott Thomas Andersen , Yu Huang , Kevin Leach

Code refinement aims to enhance existing code by addressing issues, refactoring, and optimizing to improve quality and meet specific requirements. As software projects scale in size and complexity, the traditional iterative exchange between…

软件工程 · 计算机科学 2025-02-13 Qi Guo , Xiaofei Xie , Shangqing Liu , Ming Hu , Xiaohong Li , Lei Bu

Code review is a practice widely adopted in open source and industrial projects. Given the non-negligible cost of such a process, researchers started investigating the possibility of automating specific code review tasks. We recently…

Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing generalizable reward functions. In this paper, we propose a…

机器人学 · 计算机科学 2026-03-24 Yanru Wu , Weiduo Yuan , Ang Qi , Vitor Guizilini , Jiageng Mao , Yue Wang

Documenting the functionality of software units with code comments, e.g., Javadoc comments, is a common programmer best-practice in software engineering. This paper introduces a novel test generation technique that exploits the code-comment…

软件工程 · 计算机科学 2025-05-01 Giovanni Denaro , Luca Guglielmo

Iterative refinement has emerged as an effective paradigm for enhancing the capabilities of large language models (LLMs) on complex tasks. However, existing approaches typically implement iterative refinement at the application or prompting…

计算与语言 · 计算机科学 2024-10-15 Yuxi Xie , Anirudh Goyal , Xiaobao Wu , Xunjian Yin , Xiao Xu , Min-Yen Kan , Liangming Pan , William Yang Wang