中文
相关论文

相关论文: ChatR1: Reinforcement Learning for Conversational …

200 篇论文

Query optimization is a crucial component for the efficacy of Retrieval-Augmented Generation (RAG) systems. While reinforcement learning (RL)-based agentic and reasoning methods have recently emerged as a promising direction on query…

人工智能 · 计算机科学 2026-01-30 Wei Wen , Sihang Deng , Tianjun Wei , Keyu Chen , Ruizhi Qiao , Xing Sun

Recent advancements in large audio language models have extended Chain-of-Thought (CoT) reasoning into the auditory domain, enabling models to tackle increasingly complex acoustic and spoken tasks. To elicit and sustain these extended…

Augmenting Large Language Models (LLMs) with information retrieval capabilities (i.e., Retrieval-Augmented Generation (RAG)) has proven beneficial for knowledge-intensive tasks. However, understanding users' contextual search intent when…

计算与语言 · 计算机科学 2024-09-25 Nirmal Roy , Leonardo F. R. Ribeiro , Rexhina Blloshmi , Kevin Small

Reinforcement learning (RL) is a framework for solving sequential decision-making problems. In this work, we demonstrate that, surprisingly, RL emerges during the inference time of large language models (LLMs), a phenomenon we term…

机器学习 · 计算机科学 2026-04-28 Kefan Song , Amir Moeini , Peng Wang , Lei Gong , Rohan Chandra , Shangtong Zhang , Yanjun Qi

Reinforcement learning (RL) post-training has enabled newer capabilities in models, such as agentic tool-use for search. However, these models struggle primarily due to limitations with sparse outcome-based rewards and a lack of training…

机器学习 · 计算机科学 2026-05-08 Harsh Goel , Akhil Udathu , Susmija Jabireddy , Pradnesh Kalkar , Atharva Parulekar

Interpreting the reasoning process from questions to answers poses a challenge in approaching explainable QA. A recently proposed structured reasoning format, entailment tree, manages to offer explicit logical deductions with entailment…

计算与语言 · 计算机科学 2022-11-01 Tengxiao Liu , Qipeng Guo , Xiangkun Hu , Yue Zhang , Xipeng Qiu , Zheng Zhang

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

计算与语言 · 计算机科学 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

Conventional online surveys provide limited personalization, often resulting in low engagement and superficial responses. Although AI survey chatbots improve convenience, most are still reactive: they rely on fixed dialogue trees or static…

人机交互 · 计算机科学 2025-11-10 Jinwen Tang , Yi Shang

Elucidating the reasoning process with structured explanations from question to answer is crucial, as it significantly enhances the interpretability, traceability, and trustworthiness of question-answering (QA) systems. However, structured…

计算与语言 · 计算机科学 2024-09-30 Guoxin Chen , Kexin Tang , Chao Yang , Fuying Ye , Yu Qiao , Yiming Qian

The success of DeepSeek-R1 demonstrates the immense potential of using reinforcement learning (RL) to enhance LLMs' reasoning capabilities. This paper introduces Retrv-R1, the first R1-style MLLM specifically designed for multimodal…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Lanyun Zhu , Deyi Ji , Tianrun Chen , Haiyang Wu , Shiqi Wang

Inspired by the success of reinforcement learning (RL) in Large Language Model (LLM) training for domains like math and code, recent works have begun exploring how to train LLMs to use search engines more effectively as tools for…

Large language models (LLMs) have recently shown strong reasoning abilities in domains like mathematics, coding, and scientific problem-solving, yet their potential for ranking tasks, where prime examples include retrieval, recommender…

信息检索 · 计算机科学 2025-10-17 Tao Feng , Zhigang Hua , Zijie Lei , Yan Xie , Shuang Yang , Bo Long , Jiaxuan You

OpenAI o1 has shown that applying reinforcement learning to integrate reasoning steps directly during inference can significantly improve a model's reasoning capabilities. This result is exciting as the field transitions from the…

人工智能 · 计算机科学 2025-02-18 Jun Wang

Deep Research (DR) agents extend Large Language Models (LLMs) beyond parametric knowledge by autonomously retrieving and synthesizing evidence from large web corpora into long-form reports, enabling a long-horizon agentic paradigm. However,…

人工智能 · 计算机科学 2026-02-04 Haohao Luo , Zexi Li , Yuexiang Xie , Wenhao Zhang , Yaliang Li , Ying Shen

Reinforcement learning (RL) has emerged as a critical technique for enhancing LLM-based deep search agents. However, existing approaches primarily rely on binary outcome rewards, which fail to capture the comprehensiveness and factuality of…

计算与语言 · 计算机科学 2026-01-12 Jiajie Zhang , Xin Lv , Ling Feng , Lei Hou , Juanzi Li

Large Multimodal Models (LMMs) excel at comprehending human instructions and demonstrate remarkable results across a broad spectrum of tasks. Reinforcement Learning from Human Feedback (RLHF) and AI Feedback (RLAIF) further refine LLMs by…

人工智能 · 计算机科学 2024-10-07 Ju-Seung Byun , Jiyun Chun , Jihyung Kil , Andrew Perrault

Recent advancements in long chain-of-thought (CoT) reasoning, particularly through the Group Relative Policy Optimization algorithm used by DeepSeek-R1, have led to significant interest in the potential of Reinforcement Learning with…

人工智能 · 计算机科学 2025-10-03 Xumeng Wen , Zihan Liu , Shun Zheng , Shengyu Ye , Zhirong Wu , Yang Wang , Zhijian Xu , Xiao Liang , Junjie Li , Ziming Miao , Jiang Bian , Mao Yang

Conventionally, generation of natural language for dialogue agents may be viewed as a statistical learning problem: determine the patterns in human-provided data and generate appropriate responses with similar statistical properties.…

计算与语言 · 计算机科学 2022-04-19 Siddharth Verma , Justin Fu , Mengjiao Yang , Sergey Levine

Associative thinking--the ability to connect seemingly unrelated ideas--is a foundational element of human creativity and problem-solving. This paper explores whether reinforcement learning (RL) guided by associative thinking principles can…

人工智能 · 计算机科学 2025-11-25 Mukul Singh , Ananya Singha , Aishni Parab , Pronita Mehrotra , Sumit Gulwani

Recent advances of Reinforcement Learning (RL) have highlighted its potential in complex reasoning tasks, yet effective training often relies on external supervision, which limits the broader applicability. In this work, we propose a novel…

人工智能 · 计算机科学 2025-06-11 Kongcheng Zhang , Qi Yao , Shunyu Liu , Yingjie Wang , Baisheng Lai , Jieping Ye , Mingli Song , Dacheng Tao