English
Related papers

Related papers: EvolveCoder: Evolving Test Cases via Adversarial V…

200 papers

Large language models (LLMs) have demonstrated strong coding capabilities but still struggle to solve competitive programming problems correctly in a single attempt. Execution-based re-ranking offers a promising test-time scaling strategy,…

Computation and Language · Computer Science 2026-02-05 Zeyao Ma , Jing Zhang , Xiaokang Zhang , Jiaxi Yang , Zongmeng Zhang , Jiajun Zhang , Yuheng Jing , Lei Zhang , Hao Zheng , Wenting Zhao , Junyang Lin , Binyuan Hui

Synthetic verification techniques such as generating test cases and reward modelling are common ways to enhance the coding capabilities of large language models (LLM) beyond predefined tests. Additionally, code verification has recently…

Artificial Intelligence · Computer Science 2025-07-31 Aleksander Ficek , Somshubra Majumdar , Vahid Noroozi , Boris Ginsburg

Large language models have achieved remarkable success on final-answer mathematical problems, largely due to the ease of applying reinforcement learning with verifiable rewards. However, the reasoning underlying these solutions is often…

Recently, reinforcement learning with verifiable rewards (RLVR) has been widely used for enhancing the reasoning abilities of large language models (LLMs). A core challenge in RLVR involves managing the exchange between entropy and…

Computation and Language · Computer Science 2025-08-05 Jia Deng , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Ji-Rong Wen

Recent breakthroughs in large language models (LLMs) have fundamentally shifted recommender systems from discriminative to generative paradigms, where user behavior modeling is achieved by generating target items conditioned on historical…

Information Retrieval · Computer Science 2025-10-15 Junfei Tan , Yuxin Chen , An Zhang , Junguang Jiang , Bin Liu , Ziru Xu , Han Zhu , Jian Xu , Bo Zheng , Xiang Wang

One of the key challenges arising when compilers vectorize loops for today's SIMD-compatible architectures is to decide if vectorization or interleaving is beneficial. Then, the compiler has to determine how many instructions to pack…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-07 Ameer Haj-Ali , Nesreen K. Ahmed , Ted Willke , Sophia Shao , Krste Asanovic , Ion Stoica

Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning in large language models, but rewards only final-answer correctness with no supervision over intermediate steps. Rubric-based methods such as Rubrics…

Recent advances in large language models (LLMs) have demonstrated significant potential in hardware design automation, particularly in using natural language to synthesize Register-Transfer Level (RTL) code. Despite this progress, a gap…

Machine Learning · Computer Science 2026-02-26 Jiahe Shi , Zhengqi Gao , Ching-Yun Ko , Duane Boning

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for enhancing LLMs' reasoning abilities, yet its data inefficiency remains a major bottleneck. To address this critical yet challenging issue, we present a…

Machine Learning · Computer Science 2026-04-28 Shipeng Li , Zhiqin Yang , Shikun Li , Xiaobo Xia , Hengyu Liu , Xinghua Zhang , Gaode Chen , Dong Fang , Ying Tai , Zhe Peng

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a crucial paradigm for incentivizing reasoning capabilities in Large Language Models (LLMs). Due to vast state-action spaces and reward sparsity in reasoning tasks,…

Artificial Intelligence · Computer Science 2026-02-24 Zican Hu , Shilin Zhang , Yafu Li , Jianhao Yan , Xuyang Hu , Leyang Cui , Xiaoye Qu , Chunlin Chen , Yu Cheng , Zhi Wang

Reinforcement learning (RL) has emerged as an effective paradigm for improving the reasoning capability of vision-language models (VLMs). However, RL-based optimization typically depends on costly high-quality annotations that are difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Lin Qiu , Hanqing Zeng , Yao Liu , Bingjun Sun , Guangdeng Liao , Ji Liu

Reinforcement learning (RL) can refine the reasoning abilities of large language models (LLMs), but critically depends on a key prerequisite: the LLM can already generate high-utility reasoning paths with non-negligible probability. For…

Artificial Intelligence · Computer Science 2025-10-30 Tianqianjin Lin , Xi Zhao , Xingyao Zhang , Rujiao Long , Yi Xu , Zhuoren Jiang , Wenbo Su , Bo Zheng

With the rapid evolution of large language models (LLM), reinforcement learning (RL) has emerged as a pivotal technique for code generation and optimization in various domains. This paper presents a systematic survey of the application of…

In this work, we evolve Assembly code for the CodeGuru competition. The goal is to create a survivor -- an Assembly program that runs the longest in shared memory, by resisting attacks from adversary survivors and finding their weaknesses.…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Irina Maliukov , Gera Weiss , Oded Margalit , Achiya Elyasaf

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training language models, but in practice, verifiers are rarely perfect. Recent theoretical work predicts that verifier noise affects the rate of…

Machine Learning · Computer Science 2026-05-28 Ryo Mitsuhashi , Patrick Chen , Isabelle Tseng , Jasin Cekinmez , Addison J. Wu

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

Machine Learning · Computer Science 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

LLMs for code generation are commonly evaluated in repeated-sampling settings using Pass@k, where multiple candidate programs are executed against unit tests under a finite sampling budget. While recent verifier-based reinforcement learning…

Computation and Language · Computer Science 2026-05-28 Le Bronnec Florian , Alexandre Verine , Rio Yokota , Benjamin Negrevergne

Reinforcement Learning with Verifiable Rewards (RLVR) plays a key role in stimulating the explicit reasoning capability of Large Language Models (LLMs). We can achieve expert-level performance in some specific domains via RLVR, such as…

Artificial Intelligence · Computer Science 2026-03-12 Haoqing Wang , Xiang Long , Ziheng Li , Yilong Xu , Tingguang Li , Yehui Tang

In this paper, we investigate code-integrated reasoning, where models generate code when necessary and integrate feedback by executing it through a code interpreter. To acquire this capability, models must learn when and how to use external…

Computation and Language · Computer Science 2025-06-02 Fei Bai , Yingqian Min , Beichen Zhang , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Zheng Liu , Zhongyuan Wang , Ji-Rong Wen

Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency, or fine-tune smaller…

Artificial Intelligence · Computer Science 2026-04-02 Runda Guan , Xiangqing Shen , Jiajun Zhang , Yifan Zhang , Jian Cheng , Rui Xia