中文
相关论文

相关论文: TempSamp-R1: Effective Temporal Sampling with Rein…

200 篇论文

Improving and understanding the training dynamics and reasoning of Large Language Models (LLMs) has become essential for their deployment in AI-based security tools, such as software vulnerability detection. In this work, we present an…

密码学与安全 · 计算机科学 2025-07-08 Marco Simoni , Aleksandar Fontana , Giulio Rossolini , Andrea Saracino

The success of Deepseek-R1 has drawn the LLM community's attention to reinforcement learning (RL) methods like GRPO. However, such rule-based 0/1 outcome reward methods lack the capability to regulate the intermediate reasoning processes…

人工智能 · 计算机科学 2025-05-26 Muzhi Dai , Shixuan Liu , Qingyi Si

Large Language Models (LLMs) have shown remarkable reasoning capabilities through Reinforcement Learning with Verifiable Rewards (RLVR) methods. However, a key limitation of existing approaches is that rewards defined at the full trajectory…

机器学习 · 计算机科学 2025-09-30 Zhicheng Yang , Zhijiang Guo , Yinya Huang , Xiaodan Liang , Yiwei Wang , Jing Tang

Large Language Models (LLMs) have demonstrated remarkable capabilities in knowledge acquisition, reasoning, and tool use, making them promising candidates for autonomous agent applications. However, training LLM agents for complex…

机器学习 · 计算机科学 2025-12-09 Hanjiang Hu , Changliu Liu , Na Li , Yebin Wang

Medical Image Grounding (MIG), which involves localizing specific regions in medical images based on textual descriptions, requires models to not only perceive regions but also deduce spatial relationships of these regions. Existing…

机器学习 · 计算机科学 2025-07-08 Huihui Xu , Yuanpeng Nie , Hualiang Wang , Ying Chen , Wei Li , Junzhi Ning , Lihao Liu , Hongqiu Wang , Lei Zhu , Jiyao Liu , Xiaomeng Li , Junjun He

Prompt optimization improves the reasoning abilities of large language models (LLMs) without requiring parameter updates to the target model. Following heuristic-based "Think step by step" approaches, the field has evolved in two main…

计算与语言 · 计算机科学 2025-07-25 Andreea Nica , Ivan Zakazov , Nicolas Mario Baldwin , Saibo Geng , Robert West

Recent advancements in reinforcement fine-tuning have significantly improved the reasoning ability of large language models (LLMs). In particular, methods such as group relative policy optimization (GRPO) have demonstrated strong…

人工智能 · 计算机科学 2026-03-04 Yang Zhan , Yunhao Li , Zhang Chao , Yuxu Lu , Yan Li

Hybrid Group Relative Policy Optimization (Hybrid GRPO) is a reinforcement learning framework that extends Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO) by incorporating empirical multi-sample action…

机器学习 · 计算机科学 2025-02-05 Soham Sane

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

机器学习 · 计算机科学 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

The growing disparity between the exponential scaling of computational resources and the finite growth of high-quality text data now constrains conventional scaling approaches for large language models (LLMs). To address this challenge, we…

Recent advances in reinforcement learning (RL) have delivered strong reasoning capabilities in natural image domains, yet their potential for Earth Observation (EO) remains largely unexplored. EO tasks introduce unique challenges, spanning…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Mustansar Fiaz , Hiyam Debary , Paolo Fraccaro , Danda Paudel , Luc Van Gool , Fahad Khan , Salman Khan

Within the domain of large language models, reinforcement fine-tuning algorithms necessitate the generation of a complete reasoning trajectory beginning from the input query, which incurs significant computational overhead during the…

The newly released OpenAI-o1 and DeepSeek-R1 have demonstrated that test-time scaling can significantly improve model performance, especially in complex tasks such as logical reasoning. Common test-time scaling methods involve generating…

计算与语言 · 计算机科学 2025-10-01 Zhendong Tan , Xingjun Zhang , Chaoyi Hu , Yancheng Pan , Shaoxun Wang

Intent detection, a critical component in task-oriented dialogue (TOD) systems, faces significant challenges in adapting to the rapid influx of integrable tools with complex interrelationships. Existing approaches, such as zero-shot…

计算与语言 · 计算机科学 2025-04-22 Zihao Feng , Xiaoxue Wang , Ziwei Bai , Donghang Su , Bowen Wu , Qun Yu , Baoxun Wang

In recent years, large language models (LLMs) have played an important role in automatic speech recognition (ASR) and text-to-speech (TTS) systems. While reinforcement learning (RL) has significantly enhanced LLM performance in text-based…

声音 · 计算机科学 2025-09-24 Changfeng Gao , Yabin Li , Keyu An , Zhifu Gao , Zhihao Du , Han Zhao , Xiangang Li

Recent advances in large language models (LLMs) have popularized test-time scaling, where models generate additional reasoning tokens before producing final answers. These approaches have demonstrated significant performance improvements on…

人工智能 · 计算机科学 2026-01-13 Wenxun Wu , Yuanyang Li , Guhan Chen , Linyue Wang , Hongyang Chen

Large language models (LLMs) can face factual limitations when responding to time-sensitive queries about recent events that arise after their knowledge thresholds in the training corpus. Existing search-augmented approaches fall into two…

信息检索 · 计算机科学 2025-06-11 Wentao Shi , Yiqing Shen

Reinforcement learning in large language models (LLMs) often relies on scalar rewards, a practice that discards valuable textual rationale buried in the rollouts, forcing the model to explore \textit{de novo} with each attempt and hindering…

机器学习 · 计算机科学 2025-10-21 Ang Li , Yifei Wang , Zhihang Yuan , Stefanie Jegelka , Yisen Wang

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao