中文
相关论文

相关论文: HarmRLVR: Weaponizing Verifiable Rewards for Harmf…

200 篇论文

This paper presents a comprehensive empirical study on the safety alignment capabilities. We evaluate what matters for safety alignment in LLMs and LRMs to provide essential insights for developing more secure and reliable AI systems. We…

计算与语言 · 计算机科学 2026-02-25 Xing Li , Hui-Ling Zhen , Lihao Yin , Xianzhi Yu , Zhenhua Dong , Mingxuan Yuan

Through reinforcement learning with verifiable rewards (RLVR), large language models have achieved substantial progress in domains with easily verifiable outcomes, such as mathematics and coding. However, when applied to more complex tasks…

计算与语言 · 计算机科学 2025-10-01 Qiyao Ma , Yunsheng Shi , Hongtao Tian , Chao Wang , Weiming Chang , Ting Yao

Large Reasoning Models (LRMs) have achieved tremendous success with their chain-of-thought (CoT) reasoning, yet also face safety issues similar to those of basic language models. In particular, while algorithms are designed to guide them to…

机器学习 · 计算机科学 2026-02-05 Zeming Wei , Qiaosheng Zhang , Xia Hu , Xingcheng Xu

While Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a promising post-training paradigm for Large Language Models (LLMs), its dependency on the gold label or domain-specific verifiers limits its scalability to…

机器学习 · 计算机科学 2026-05-12 Xuexiang Wen , Hang Yu , Linchao Zhu , Gaoang Wang

Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated promising gains in enhancing the reasoning capabilities of large language models. However, its dependence on domain-specific verifiers significantly restricts its…

计算与语言 · 计算机科学 2026-01-22 Chongxuan Huang , Lei Lin , Xiaodong Shi , Wenping Hu , Ruiming Tang

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in logical reasoning tasks, yet whether large language model (LLM) alignment requires fundamentally different approaches remains unclear. Given the…

人工智能 · 计算机科学 2026-03-12 Zhaowei Zhang , Xiaohan Liu , Xuekai Zhu , Junchao Huang , Ceyao Zhang , Zhiyuan Feng , Yaodong Yang , Xiaoyuan Yi , Xing Xie

Reinforcement Learning with Verifiable Rewards (RLVR) has become the leading paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard RLVR algorithms suffer from a well-documented pathology: while they improve…

机器学习 · 计算机科学 2026-02-26 Yuanda Xu , Hejian Sang , Zhengze Zhou , Ran He , Zhipeng Wang

Large Language Models (LLMs) often produce hallucinated or unverifiable content, undermining their reliability in factual domains. This work investigates Reinforcement Learning with Verifiable Rewards (RLVR) as a training paradigm that…

Large language models (LLMs), despite possessing latent safety understanding from their vast pretraining data, remain vulnerable to generating harmful content and exhibit issues such as over-refusal and utility degradation after safety…

人工智能 · 计算机科学 2025-07-22 Yi Zhang , An Zhang , XiuYu Zhang , Leheng Sheng , Yuxin Chen , Zhenkai Liang , Xiang Wang

Prolonged reinforcement learning with verifiable rewards (RLVR) has been shown to drive continuous improvements in the reasoning capabilities of large language models, but the training is often prone to instabilities, especially in…

人工智能 · 计算机科学 2026-05-13 Yiming Dong , Kun Fu , Haoyu Li , Xinyuan Zhu , Yurou Liu , Lijing Shao , Jieping Ye , Zheng Wang

Recent advances in large reasoning models have leveraged reinforcement learning with verifiable rewards (RLVR) to improve reasoning capabilities. However, scaling these methods typically requires extensive rollout computation and large…

机器学习 · 计算机科学 2025-09-03 Xinyu Tang , Zhenduo Zhang , Yurou Liu , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Reinforcement Learning with Verifiable Rewards (RLVR) has recently demonstrated notable success in enhancing the reasoning performance of large language models (LLMs), particularly on mathematics and programming tasks. Similar to how…

人工智能 · 计算机科学 2025-11-25 Yang Yue , Zhiqi Chen , Rui Lu , Andrew Zhao , Zhaokai Wang , Yang Yue , Shiji Song , Gao Huang

Reinforcement Learning from Verifiable Rewards (RLVR) on chain-of-thought reasoning has become a standard part of language model post-training recipes. A common assumption is that the reasoning chains trained through RLVR reliably represent…

计算与语言 · 计算机科学 2026-04-27 Qinan Yu , Alexa Tartaglini , Peter Hase , Carlos Guestrin , Christopher Potts

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

计算与语言 · 计算机科学 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria

In the era of Large Language Models (LLMs), alignment has emerged as a fundamental yet challenging problem in the pursuit of more reliable, controllable, and capable machine intelligence. The recent success of reasoning models and…

机器学习 · 计算机科学 2025-07-18 Hao Sun , Mihaela van der Schaar

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a promising framework for improving reasoning abilities in Large Language Models (LLMs). However, policy optimized with binary verification prone to overlook…

机器学习 · 计算机科学 2025-10-14 Jinghao Zhang , Naishan Zheng , Ruilin Li , Dongzhou Cheng , Zheming Liang , Feng Zhao , Jiaqi Wang

The integration of large language models (LLMs) into electronic design automation (EDA) workflows has introduced powerful capabilities for RTL generation, verification, and design optimization, but also raises critical security concerns.…

While Large Language Models (LLMs) have demonstrated strong math reasoning abilities through Reinforcement Learning with *Verifiable Rewards* (RLVR), many advanced mathematical problems are proof-based, with no guaranteed way to determine…

计算与语言 · 计算机科学 2026-02-20 Haotong Yang , Zitong Wang , Shijia Kang , Siqi Yang , Wenkai Yu , Xu Niu , Yike Sun , Yi Hu , Zhouchen Lin , Muhan Zhang

Large Language Models have shown impressive generative capabilities across diverse tasks, but their safety remains a critical concern. Existing post-training alignment methods, such as SFT and RLHF, reduce harmful outputs yet leave LLMs…

密码学与安全 · 计算机科学 2025-10-21 Zhengyue Zhao , Yingzi Ma , Somesh Jha , Marco Pavone , Patrick McDaniel , Chaowei Xiao

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

计算与语言 · 计算机科学 2025-05-09 Madhur Jindal , Saurabh Deshpande