English
Related papers

Related papers: Co-Evolving LLM Coder and Unit Tester via Reinforc…

200 papers

Large language models (LLMs) show strong capabilities in general reasoning but typically lack reliability in scientific domains like quantum mechanics, which demand strict adherence to physical constraints. This limitation arises from the…

Artificial Intelligence · Computer Science 2026-04-21 Songxin Qu , Tai-Ping Sun , Yun-Jie Wang , Huan-Yu Liu , Cheng Xue , Xiao-Fan Xu , Han Fang , Yang Yang , Yu-Chun Wu , Guo-Ping Guo , Zhao-Yun Chen

Large Reasoning Models (LRMs) face two fundamental limitations: excessive token consumption when overanalyzing simple information processing tasks, and inability to access up-to-date knowledge beyond their training data. We introduce MARS…

Artificial Intelligence · Computer Science 2026-02-03 Guoxin Chen , Zile Qiao , Wenqing Wang , Donglei Yu , Xuanzhong Chen , Hao Sun , Minpeng Liao , Kai Fan , Yong Jiang , Penguin Xie , Wayne Xin Zhao , Ruihua Song , Fei Huang

Unit testing is critical for ensuring software quality and software system stability. The current practice of manually maintaining unit tests suffers from low efficiency and the risk of delayed or overlooked fixes. Therefore, an automated…

Software Engineering · Computer Science 2025-09-30 Yuanhe Zhang , Zhiquan Yang , Shengyi Pan , Zhongxin Liu

Humans are good at learning on the job: We learn how to solve the tasks we face as we go along. Can a model do the same? We propose an agent that assembles a task-specific curriculum, called test-time curriculum (TTC-RL), and applies…

Machine Learning · Computer Science 2025-10-07 Jonas Hübotter , Leander Diaz-Bone , Ido Hakimi , Andreas Krause , Moritz Hardt

Reinforcement learning post-training has improved the reasoning ability of large language models, but often produces unnecessarily long, repetitive, or semantically opaque reasoning traces. Existing efficient reasoning methods mainly…

Artificial Intelligence · Computer Science 2026-05-22 Yuyang Wu , Qiyao Xue , Guanxing Lu , Weichen Liu , Zihan Wang , Manling Li , Olexandr Isayev

Retrieval-Augmented Generation (RAG) integrates external knowledge to enhance Large Language Models (LLMs), yet systems remain susceptible to two critical flaws: providing correct answers without explicit grounded evidence and producing…

Computation and Language · Computer Science 2026-01-09 Yibo Zhao , Jiapeng Zhu , Zichen Ding , Xiang Li

Large Language Models (LLMs) often fail to generate correct code on the first attempt, which requires using generated unit tests as verifiers to validate the solutions. Despite the success of recent verification methods, they remain…

Artificial Intelligence · Computer Science 2026-03-03 Sicheng Zhu , Jiajun Wang , Jiawei Ai , Xin Li

This paper offers a new perspective on the limits of machine learning: the ceiling on progress is set not by model size or algorithm choice but by the information structure of the task itself. Code generation has progressed more reliably…

Machine Learning · Computer Science 2026-04-14 Zhimin Zhao

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising approach for training reasoning language models (RLMs) by leveraging supervision from verifiers. Although verifier implementation is easier than solution…

Artificial Intelligence · Computer Science 2026-02-24 Andre He , Nathaniel Weir , Kaj Bostrom , Allen Nie , Darion Cassel , Sam Bayless , Huzefa Rangwala

Code-generating Large Language Models (LLMs) have become essential tools in modern software development, enhancing productivity and accelerating development. This paper aims to investigate the fine-tuning of code-generating LLMs using…

Software Engineering · Computer Science 2025-05-06 Marina Sakharova , Abhinav Anand , Mira Mezini

Using Reinforcement Learning with Verifiable Rewards (RLVR) to optimize Large Language Models (LLMs) can be conceptualized as progressively editing a query's `Reasoning Tree'. This process involves exploring nodes (tokens) and dynamically…

Artificial Intelligence · Computer Science 2026-04-28 Hong Wang , Zhezheng Hao , Jian Luo , Chenxing Wei , Yao Shu , Lei Liu , Qiang Lin , Hande Dong , Jiawei Chen

In medical scenarios, effectively retrieving external knowledge and leveraging it for rigorous logical reasoning is of significant importance. Despite their potential, existing work has predominantly focused on enhancing either retrieval or…

Computation and Language · Computer Science 2026-01-21 Keer Lu , Zheng Liang , Youquan Li , Jiejun Tan , Xili Wang , Da Pan , Shusen Zhang , Guosheng Dong , Bin Cui , Yunhuai Liu , Wentao Zhang

Large language models (LLMs) have achieved substantial progress in repository-level code generation. However, solving the same repository-level task often requires multiple attempts, while existing methods still optimize each attempt in…

Software Engineering · Computer Science 2026-04-07 Ruwei Pan , Jiangshuai Wang , Qisheng Zhang , Yueheng Zhu , Linhao Wu , Zixiong Yang , Yakun Zhang , Lu Zhang , Hongyu Zhang

Agentic Reinforcement Learning (RL) has empowered Large Language Models (LLMs) to utilize tools like Python interpreters for complex problem-solving. However, for parameter-constrained models (e.g., 4B--7B), the exploration phase is often…

Machine Learning · Computer Science 2026-01-22 Tianshi Xu , Yuteng Chen , Meng Li

A reinforcement learning (RL) framework is introduced for the efficient synthesis of quantum circuits that generate specified target quantum states from a fixed initial state, addressing a central challenge in both the Noisy…

Quantum Physics · Physics 2026-02-18 Sara Giordano , Kornikar Sen , Miguel A. Martin-Delgado

Deep Learning (DL) models to analyze source code have shown immense promise during the past few years. More recently, self-supervised pre-training has gained traction for learning generic code representations valuable for many downstream SE…

Software Engineering · Computer Science 2023-06-07 Yangruibo Ding , Saikat Chakraborty , Luca Buratti , Saurabh Pujar , Alessandro Morari , Gail Kaiser , Baishakhi Ray

Large language models (LLMs) have shown promising results for software engineering applications, but still struggle with code reasoning tasks such as vulnerability detection (VD). We introduce ConceptCoder, a fine-tuning method that…

Software Engineering · Computer Science 2026-03-25 Md Mahbubur Rahman , Hengbo Tong , Wei Le

Reinforcement learning with verifiable rewards (RLVR) is a promising approach for training language models (LMs) on reasoning tasks that elicit emergent long chains of thought (CoTs). Unlike supervised learning, it updates the model using…

Computation and Language · Computer Science 2025-10-28 Xinyu Zhu , Mengzhou Xia , Zhepei Wei , Wei-Lin Chen , Danqi Chen , Yu Meng

Competitive programming, due to its high reasoning difficulty and precise correctness feedback, has become a key task for both training and evaluating the reasoning capabilities of large language models (LLMs). However, while a large amount…

Software Engineering · Computer Science 2025-06-09 Zihan Wang , Siyao Liu , Yang Sun , Hongyan Li , Kai Shen