中文
相关论文

相关论文: WirelessMathLM: Teaching Mathematical Reasoning fo…

200 篇论文

Recent advancements in Multimodal Large Language Models (MLLMs), particularly through Reinforcement Learning with Verifiable Rewards (RLVR), have significantly enhanced their reasoning abilities. However, a critical gap persists: these…

Reinforcement learning (RL) has emerged as a key paradigm for aligning and optimizing large language models (LLMs). Standard approaches treat the LLM as the policy and apply RL directly over the full vocabulary space. However, this…

机器学习 · 计算机科学 2026-02-17 Jing-Cheng Pang , Liang Lu , Xian Tang , Kun Jiang , Sijie Wu , Kai Zhang , Xubin Li

Achieving the effective design and improvement of reward functions in reinforcement learning (RL) tasks with complex custom environments and multiple requirements presents considerable challenges. In this paper, we propose ERFSL, an…

机器学习 · 计算机科学 2026-05-19 Guanwen Xie , Jingzehua Xu , Yiyuan Yang , Yimian Ding , Shuai Zhang

Large Language Models (LLMs) have shown remarkable capabilities across various fields. However, their performance in technical domains such as telecommunications remains underexplored. This paper evaluates two open-source LLMs, Gemma 3 27B…

网络与互联网体系结构 · 计算机科学 2025-09-29 Arina Caraus , Alessio Buscemi , Sumit Kumar , Ion Turcanu

Test-time scaling methods have seen a rapid increase in popularity for its computational efficiency and parameter-independent training to improve reasoning performance on Large Language Models. One such method is called budget forcing, a…

人工智能 · 计算机科学 2025-10-27 Ravindra Aribowo Tarunokusumo , Rafael Fernandes Cunha

Reinforcement learning with verifiable rewards (RLVR) has driven significant performance gains in reasoning-oriented large language models (LLMs), yet its internal training dynamics remain largely a black box. In this work, we perform a…

机器学习 · 计算机科学 2026-05-22 Tianle Wang , Jiayu Liu , Zhongyuan Wu , Shenghao Jin , Wei Chen , Hao Xu , Ning Miao

Recent advancements in reasoning-focused language models such as OpenAI's O1 and DeepSeek-R1 have shown that scaling test-time computation-through chain-of-thought reasoning and iterative exploration-can yield substantial improvements on…

Reinforcement Learning from Human Feedback (RLHF) is key to aligning Large Language Models (LLMs), typically paired with the Proximal Policy Optimization (PPO) algorithm. While PPO is a powerful method designed for general reinforcement…

机器学习 · 计算机科学 2024-05-17 Ziniu Li , Tian Xu , Yushun Zhang , Zhihang Lin , Yang Yu , Ruoyu Sun , Zhi-Quan Luo

Fine-tuning Large Language Models (LLMs) typically relies on large quantities of high-quality annotated data, or questions with well-defined ground truth answers in the case of Reinforcement Learning with Verifiable Rewards (RLVR). While…

人工智能 · 计算机科学 2026-04-21 Justin Bauer , Thomas Walshe , Derek Pham , Harit Vishwakarma , Armin Parchami , Frederic Sala , Paroma Varma

Enhancing the complex reasoning capabilities of Large Language Models (LLMs) attracts widespread attention. While reinforcement learning (RL) has shown superior performance for improving complex reasoning, its impact on cross-lingual…

计算与语言 · 计算机科学 2025-09-30 Shulin Huang , Yiran Ding , Junshu Pan , Yue Zhang

Cellular networks, e.g., 4G/5G, rely on complex technical specifications to ensure correct functionality; however, these specifications often contain flaws or ambiguities. In this paper, we investigate the application of Large Language…

密码学与安全 · 计算机科学 2026-01-06 Jianshuo Dong , Yuanjie Li , Jun Liu , Hewu Li , Han Qiu

Leveraging mathematical Large Language Models (LLMs) for proof generation is a fundamental topic in LLMs research. We argue that the ability of current LLMs to prove statements largely depends on whether they have encountered the relevant…

Large Language Models (LLMs) have achieved remarkable success through imitation learning on vast text corpora, but this paradigm creates a training-generation gap and limits robust reasoning. Reinforcement learning (RL) offers a more…

计算与语言 · 计算机科学 2026-04-13 Zhepeng Cen , Haolin Chen , Shiyu Wang , Zuxin Liu , Zhiwei Liu , Jielin Qiu , Ding Zhao , Silvio Savarese , Caiming Xiong , Huan Wang , Weiran Yao

Although Large Language Models (LLMs) have demonstrated remarkable progress, their proficiency in graph-related tasks remains notably limited, hindering the development of truly general-purpose models. Previous attempts, including…

机器学习 · 计算机科学 2025-08-20 Xiaojun Guo , Ang Li , Yifei Wang , Stefanie Jegelka , Yisen Wang

Large language models (LLMs) have recently shown strong performance on mathematical benchmarks. At the same time, they are prone to hallucination and sycophancy, often providing convincing but flawed proofs for incorrect mathematical…

人工智能 · 计算机科学 2025-10-07 Ivo Petrov , Jasper Dekoninck , Martin Vechev

Large language models (LLMs) are increasingly deployed for tasks requiring complex reasoning, prompting significant interest in improving their reasoning abilities through post-training. Especially RL based methods using verifiable reward,…

机器学习 · 计算机科学 2025-10-02 Prasanna Parthasarathi , Mathieu Reymond , Boxing Chen , Yufei Cui , Sarath Chandar

Recent works on large language models (LLMs) have successfully demonstrated the emergence of reasoning capabilities via reinforcement learning (RL). Although recent efforts leverage group relative policy optimization (GRPO) for MLLMs…

计算与语言 · 计算机科学 2025-06-18 Shilin Xu , Yanwei Li , Rui Yang , Tao Zhang , Yueyi Sun , Wei Chow , Linfeng Li , Hang Song , Qi Xu , Yunhai Tong , Xiangtai Li , Hao Fei

Multimodal Large Language Models (MLLMs) promise advanced vision language capabilities, yet their effectiveness in visually presented mathematics remains underexplored. This paper analyzes the development and evaluation of MLLMs for…

With the advent of DeepSeek-R1, a new wave of reinforcement learning (RL) methods has emerged that seem to unlock stronger mathematical reasoning. However, a closer look at the open-source ecosystem reveals a critical limitation: with…

机器学习 · 计算机科学 2025-10-14 Prasanna Mayilvahanan , Ricardo Dominguez-Olmedo , Thaddäus Wiedemer , Wieland Brendel

Reinforcement learning in large language models (LLMs) often relies on scalar rewards, a practice that discards valuable textual rationale buried in the rollouts, forcing the model to explore \textit{de novo} with each attempt and hindering…

机器学习 · 计算机科学 2025-10-21 Ang Li , Yifei Wang , Zhihang Yuan , Stefanie Jegelka , Yisen Wang