English
Related papers

Related papers: ChatR1: Reinforcement Learning for Conversational …

200 papers

In this work, we introduce ChatQA, a suite of models that outperform GPT-4 on retrieval-augmented generation (RAG) and conversational question answering (QA). To enhance generation, we propose a two-stage instruction tuning method that…

Computation and Language · Computer Science 2024-10-31 Zihan Liu , Wei Ping , Rajarshi Roy , Peng Xu , Chankyu Lee , Mohammad Shoeybi , Bryan Catanzaro

Role-playing conversational agents (RPCAs) face persistent challenges in maintaining role consistency. To address this, we propose RAIDEN-R1, a novel reinforcement learning framework that integrates Verifiable Role-Awareness Reward (VRAR).…

Computation and Language · Computer Science 2025-05-16 Zongsheng Wang , Kaili Sun , Bowen Wu , Qun Yu , Ying Li , Baoxun Wang

Reinforcement Learning has emerged as a key driver for LLM reasoning. This capability is equally pivotal in long-context scenarios--such as long-dialogue understanding and structured data analysis, where the challenge extends beyond…

Computation and Language · Computer Science 2026-02-06 Bowen Ping , Zijun Chen , Yiyao Yu , Tingfeng Hui , Junchi Yan , Baobao Chang

Proactive intent prediction is a critical capability in modern e-commerce chatbots, enabling "zero-query" recommendations by anticipating user needs from behavioral and contextual signals. However, existing industrial systems face two…

Information Retrieval · Computer Science 2026-02-16 Junhua Liu , Yang Jihao , Cheng Chang , Kunrong LI , Bin Fu , Kwan Hui Lim

Deep Research agents tackle knowledge-intensive tasks through multi-round retrieval and decision-oriented generation. While reinforcement learning (RL) has been shown to improve performance in this paradigm, its contributions remain…

Computation and Language · Computer Science 2026-02-24 Yinuo Xu , Shuo Lu , Jianjie Cheng , Meng Wang , Qianlong Xie , Xingxing Wang , Ran He , Jian Liang

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

Machine Learning · Computer Science 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Reinforcement learning (RL) in long horizon and sparse reward tasks is notoriously difficult and requires a lot of training steps. A standard solution to speed up the process is to leverage additional reward signals, shaping it to better…

Computation and Language · Computer Science 2022-10-14 Thomas Carta , Pierre-Yves Oudeyer , Olivier Sigaud , Sylvain Lamprier

Recent advances in fine-tuning large language models (LLMs) with reinforcement learning (RL) have shown promising improvements in complex reasoning tasks, particularly when paired with chain-of-thought (CoT) prompting. However, these…

Machine Learning · Computer Science 2025-04-04 Hung Le , Dai Do , Dung Nguyen , Svetha Venkatesh

Developing 3D vision-language models with robust clinical reasoning remains a challenge due to the inherent complexity of volumetric medical imaging, the tendency of models to overfit superficial report patterns, and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Haoran Lai , Zihang Jiang , Kun Zhang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Shaohua Kevin Zhou

This paper investigates a new task named Conversational Question Generation (CQG) which is to generate a question based on a passage and a conversation history (i.e., previous turns of question-answer pairs). CQG is a crucial task for…

Computation and Language · Computer Science 2019-07-31 Boyuan Pan , Hao Li , Ziyu Yao , Deng Cai , Huan Sun

We show that reinforcement learning with verifiable reward using one training example (1-shot RLVR) is effective in incentivizing the math reasoning capabilities of large language models (LLMs). Applying RLVR to the base model…

Reinforcement Learning with Verifiable Rewards (RLVR) has recently strengthened LLM reasoning, but its focus on final answer correctness leaves a critical gap: it does not ensure the robustness of the reasoning process itself. We adopt a…

Machine Learning · Computer Science 2026-02-10 Hyunseok Lee , Soheil Abbasloo , Jihoon Tack , Jinwoo Shin

Chain-of-thought (CoT) reasoning has emerged as a powerful tool for multimodal large language models on video understanding tasks. However, its necessity and advantages over direct answering remain underexplored. In this paper, we first…

DeepSeek-R1 has demonstrated powerful reasoning capabilities in the text domain through stable reinforcement learning (RL). Recently, in the multimodal domain, works have begun to directly apply RL to generate R1-like free-form reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Chuming Shen , Wei Wei , Xiaoye Qu , Yu Cheng

Building a search relevance model that achieves both low latency and high performance is a long-standing challenge in the search industry. To satisfy the millisecond-level response requirements of online systems while retaining the…

Machine Learning · Computer Science 2026-02-11 Shijie Zhang , Xiang Guo , Rujun Guo , Shaoyu Liu , Xiaozhao Wang , Guanjun Jiang , Kevin Zhang

Broad Explainable Artificial Intelligence moves away from interpreting individual decisions based on a single datum and aims to provide integrated explanations from multiple machine learning algorithms into a coherent explanation of an…

Artificial Intelligence · Computer Science 2021-08-23 Richard Dazeley , Peter Vamplew , Francisco Cruz

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Computation and Language · Computer Science 2025-03-12 Zonghao Ying , Deyue Zhang , Zonglei Jing , Yisong Xiao , Quanchen Zou , Aishan Liu , Siyuan Liang , Xiangzheng Zhang , Xianglong Liu , Dacheng Tao

Large language model (LLM) based multi-turn dialogue systems often struggle to track dependencies across non-adjacent turns, undermining both consistency and scalability. As conversations lengthen, essential information becomes sparse and…

Computation and Language · Computer Science 2026-05-15 Renning Pang , Tian Lan , Leyuan Liu , Xiaoming Huang , Piao Tong , Xiaosong Zhang

While Reinforcement Learning with Verifiable Reward (RLVR) significantly advances image reasoning in Large Vision-Language Models (LVLMs), its application to complex video reasoning remains underdeveloped. This gap stems primarily from a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Congzhi Zhang , Zhibin Wang , Yinchao Ma , Jiawei Peng , Yihan Wang , Qiang Zhou , Jun Song , Bo Zheng

Retrieval-augmented large language models, when optimized with outcome-level rewards, can achieve strong answer accuracy on multi-hop questions. However, under noisy retrieval, models frequently suffer from "right-answer-wrong-reason…

Computation and Language · Computer Science 2026-03-17 Yu Liu , Wenxiao Zhang , Diandian Guo , Cong Cao , Fangfang Yuan , Qiang Sun , Yanbing Liu , Jin B. Hong , Zhiyuan Ma
‹ Prev 1 3 4 5 6 7 10 Next ›