中文
相关论文

相关论文: RLFactory: A Plug-and-Play Reinforcement Learning …

200 篇论文

Enabling large language models with external tools has become a pivotal strategy for extending their functionality beyond text space. To enhance LLMs' tool-calling abilities, previous approaches primarily rely on supervised fine-tuning…

计算与语言 · 计算机科学 2025-05-13 Shaokun Zhang , Yi Dong , Jieyu Zhang , Jan Kautz , Bryan Catanzaro , Andrew Tao , Qingyun Wu , Zhiding Yu , Guilin Liu

Since the introduction of the GRPO algorithm, reinforcement learning (RL) has attracted increasing attention for LLM post-training, yet training efficiency remains a critical challenge. In mainstream RL frameworks, inference and training…

机器学习 · 计算机科学 2026-05-05 Jian Lu

Despite recent progress, reinforcement learning (RL)-based fine-tuning of diffusion models often struggles with generalization, composability, and robustness against reward hacking. Recent studies have explored prompt refinement as a…

机器学习 · 计算机科学 2026-03-26 Suhyeon Lee , Jong Chul Ye

The integration of experimental technologies with large language models (LLMs) is transforming scientific research. It positions AI as a versatile research assistant rather than a mere problem-solving tool. In the field of power systems,…

计算与语言 · 计算机科学 2025-05-20 Mengshuo Jia , Zeyu Cui , Gabriela Hug

Reinforcement learning (RL) has emerged as a promising strategy for finetuning small language models (SLMs) to solve targeted tasks such as math and coding. However, RL algorithms tend to be resource-intensive, taking a significant amount…

机器学习 · 计算机科学 2025-10-07 Lianghuan Huang , Sagnik Anupam , Insup Lee , Shuo Li , Osbert Bastani

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Large language models (LLMs) acquire extensive prior knowledge through large-scale pretraining and can be further enhanced via supervised fine-tuning (SFT) or reinforcement learning (RL)-based post-training. A growing body of evidence has…

机器学习 · 计算机科学 2026-01-28 Honglin Zhang , Qianyue Hao , Fengli Xu , Yong Li

Robust deployment of large multimodal models (LMMs) in real-world scenarios requires access to external knowledge sources, given the complexity and dynamic nature of real-world information. Existing approaches such as retrieval-augmented…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Jinming Wu , Zihao Deng , Wei Li , Yiding Liu , Bo You , Bo Li , Zejun Ma , Ziwei Liu

While reinforcement learning (RL) demonstrated remarkable success in enhancing the reasoning capabilities of language models, the training dynamics of RL in LLMs remain unclear. In this work, we provide an explanation of the RL training…

机器学习 · 计算机科学 2025-09-30 Xingwu Chen , Tianle Li , Difan Zou

Recent advancements in the reasoning capabilities of large language models (LLMs) show that employing group relative policy optimization (GRPO) algorithm for reinforcement learning (RL) training allows the models to use more…

计算与语言 · 计算机科学 2025-07-04 Purbesh Mitra , Sennur Ulukus

The development of Large Language Models (LLMs) often confronts challenges stemming from the heavy reliance on human annotators in the reinforcement learning with human feedback (RLHF) framework, or the frequent and costly external queries…

计算与语言 · 计算机科学 2025-03-04 Shangding Gu , Alois Knoll , Ming Jin

Recently, tool-augmented LLMs have gained increasing attention. Given an instruction, tool-augmented LLMs can interact with various external tools in multiple rounds and provide a final answer. However, previous LLMs were trained on overly…

计算与语言 · 计算机科学 2024-11-05 Qinzhuo Wu , Wei Liu , Jian Luan , Bin Wang

Fine-tuning foundation models has emerged as a powerful approach for generating objects with specific desired properties. Reinforcement learning (RL) provides an effective framework for this purpose, enabling models to generate outputs that…

机器学习 · 计算机科学 2025-11-04 Pouya M. Ghari , Simone Sciabola , Ye Wang

Reinforcement learning with verifiable rewards (RLVR) has demonstrated significant success in enhancing mathematical reasoning and coding performance of large language models (LLMs), especially when structured reference answers are…

计算与语言 · 计算机科学 2025-04-02 Yi Su , Dian Yu , Linfeng Song , Juntao Li , Haitao Mi , Zhaopeng Tu , Min Zhang , Dong Yu

The application of rule-based reinforcement learning (RL) to multimodal large language models (MLLMs) introduces unique challenges and potential deviations from findings in text-only domains, particularly for perception-heavy tasks. This…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Zifu Wang , Junyi Zhu , Bo Tang , Zhiyu Li , Feiyu Xiong , Jiaqian Yu , Matthew B. Blaschko

Reinforcement learning (RL) has emerged as a popular method for post-training large language models (LLMs). While improving the model's performance on downstream tasks, it often reduces the model's output diversity, leading to narrow,…

计算与语言 · 计算机科学 2026-03-03 Yilei Chen , Souradip Chakraborty , Lorenz Wolf , Yannis Paschalidis , Aldo Pacchiano

Explainable Reinforcement Learning (XRL) has emerged as a promising approach in improving the transparency of Reinforcement Learning (RL) agents. However, there remains a gap between complex RL policies and domain experts, due to the…

人工智能 · 计算机科学 2025-09-09 Haechang Kim , Hao Chen , Can Li , Jong Min Lee

Reinforcement learning (RL) has recently shown impressive performance in complex game AI and robotics tasks. To a large extent, this is thanks to the availability of simulated environments such as OpenAI Gym, Atari Learning Environment, or…

计算与语言 · 计算机科学 2020-11-18 Rajkumar Ramamurthy , Rafet Sifa , Christian Bauckhage

Large Language Model (LLM) agents can leverage multiple turns and tools to solve complex tasks, with prompt-based approaches achieving strong performance. This work demonstrates that Reinforcement Learning (RL) can push capabilities…

计算与语言 · 计算机科学 2025-10-29 Vivek Kalyan , Martin Andrews

Large Language Models (LLMs) have shown impressive capabilities in multi-step reasoning and problem-solving.Recent works introduce multi-agent reflection frameworks where multiple LLM agents critique and refine each other's outputs using…

人工智能 · 计算机科学 2025-11-26 Yuanhao Li , Mingshan Liu , Hongbo Wang , Yiding Zhang , Yifei Ma , Wei Tan