中文
相关论文

相关论文: SeqPO-SiMT: Sequential Policy Optimization for Sim…

200 篇论文

This paper introduces TempSamp-R1, a new reinforcement fine-tuning framework designed to improve the effectiveness of adapting multimodal large language models (MLLMs) to video temporal grounding tasks. We reveal that existing reinforcement…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Yunheng Li , Jing Cheng , Shaoyong Jia , Hangyi Kuang , Shaohui Jiao , Qibin Hou , Ming-Ming Cheng

Direct Preference Optimization (DPO) is a method for enhancing model performance by directly optimizing for the preferences or rankings of outcomes, instead of traditional loss functions. This approach has proven effective in aligning Large…

机器学习 · 计算机科学 2024-09-18 Ruoyu Wang , Jiachen Sun , Shaowei Hua , Quan Fang

Multi-turn human-AI collaboration is fundamental to deploying interactive services such as adaptive tutoring, conversational recommendation, and professional consultation. However, optimizing these interactions via reinforcement learning is…

机器学习 · 计算机科学 2026-03-26 Haoyu Wang , Yuxin Chen , Liang Luo , Buyun Zhang , Ellie Dingqiao Wen , Pan Li

Large Language Models (LLMs) generate functionally correct solutions but often fall short in code efficiency, a critical bottleneck for real-world deployment. In this paper, we introduce a novel test-time iterative optimization framework to…

软件工程 · 计算机科学 2025-06-04 Mingzhe Du , Luu Anh Tuan , Yue Liu , Yuhao Qing , Dong Huang , Xinyi He , Qian Liu , Zejun Ma , See-kiong Ng

Aligning large language models (LLMs) on domain-specific data remains a fundamental challenge. Supervised fine-tuning (SFT) offers a straightforward way to inject domain knowledge but often degrades the model's generality. In contrast,…

机器学习 · 计算机科学 2026-02-12 Linxuan Xia , Xiaolong Yang , Yongyuan Chen , Enyue Zhao , Deng Cai , Yasheng Wang , Boxi Wu

Large language models (LLMs) have recently advanced in reasoning when optimized with reinforcement learning (RL) under verifiable rewards. Existing methods primarily rely on outcome-based supervision to strengthen internal LLM reasoning,…

人工智能 · 计算机科学 2026-05-29 Siyao Song , Cong Ma , Zhihao Cheng , Shiye Lei , Minghao Li , Ying Zeng , Huaixiao Tou , Kai Jia

Simultaneous machine translation (SiMT) outputs the target sequence while receiving the source sequence, and hence learning when to start translating each target token is the core challenge for SiMT task. However, it is non-trivial to learn…

计算与语言 · 计算机科学 2023-03-02 Shaolei Zhang , Yang Feng

Large Language Models (LLMs) often exhibit implicit biases and discriminatory tendencies that reflect underlying social stereotypes. While recent alignment techniques such as RLHF and DPO have mitigated some of these issues, they remain…

计算与语言 · 计算机科学 2025-11-11 Deng Yixuan , Ji Xiaoqiang

The configuration of physical parameterization schemes in Numerical Weather Prediction (NWP) models plays a critical role in determining the accuracy of the forecast. However, existing parameter calibration methods typically treat each…

计算工程、金融与科学 · 计算机科学 2026-04-15 Heping Fang , Bingdong Li , Peng Yang

Reinforcement learning (RL) plays an increasingly important role in enhancing the reasoning capabilities of large language models (LLMs), yet stable and performant policy optimization remains challenging. Token-level importance ratios often…

机器学习 · 计算机科学 2025-12-02 Chang Gao , Chujie Zheng , Xiong-Hui Chen , Kai Dang , Shixuan Liu , Bowen Yu , An Yang , Shuai Bai , Jingren Zhou , Junyang Lin

Existing approaches to neural machine translation (NMT) generate the target language sequence token by token from left to right. However, this kind of unidirectional decoding framework cannot make full use of the target-side future contexts…

计算与语言 · 计算机科学 2019-05-14 Long Zhou , Jiajun Zhang , Chengqing Zong

Large language models (LLMs) have recently been used for sequential decision making in interactive environments. However, leveraging environment reward signals for continual LLM actor improvement is not straightforward. We propose Skill Set…

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

计算与语言 · 计算机科学 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Large Language Models (LLMs) perform well in language tasks but often lack collaborative awareness and struggle to optimize global performance in multi-agent settings. We present a reinforcement learning-augmented LLM agent framework that…

人工智能 · 计算机科学 2026-01-01 Dong Qiu , Duo Xu , Limengxi Yue

Query-product relevance prediction is vital for AI-driven e-commerce, yet current LLM-based approaches face a dilemma: SFT and DPO struggle with long-tail generalization due to coarse supervision, while traditional RLVR suffers from sparse…

人工智能 · 计算机科学 2026-04-14 Pengkun Jiao , Yiming Jin , Jianhui Yang , Chenhe Dong , Zerui Huang , Shaowei Yao , Xiaojiang Zhou , Dan Ou , Haihong Tang

In this paper, we introduce \emph{refined Direct Preference Optimization} (rDPO), a method for improving the behavioral alignment of Large Language Models (LLMs) without the need for human-annotated data. The method involves creating…

计算与语言 · 计算机科学 2024-02-14 Víctor Gallego

While Group Relative Policy Optimization (GRPO) offers a powerful framework for LLM post-training, its effectiveness in open-ended domains like Machine Translation hinges on accurate intra-group ranking. We identify that standard Scalar…

计算与语言 · 计算机科学 2026-02-17 Sen Yang , Shanbo Cheng , Lu Xu , Jianbing Zhang , Shujian Huang

Many valid translations exist for a given sentence, yet machine translation (MT) is trained with a single reference translation, exacerbating data sparsity in low-resource settings. We introduce Simulated Multiple Reference Training (SMRT),…

计算与语言 · 计算机科学 2021-04-23 Huda Khayrallah , Brian Thompson , Matt Post , Philipp Koehn

The growing emotional stress in modern society has increased the demand for Emotional Support Conversations (ESC). While Large Language Models (LLMs) show promise for ESC, they face two key challenges: (1) low strategy selection accuracy,…

计算与语言 · 计算机科学 2025-09-22 Weixiang Zhao , Xingyu Sui , Xinyang Han , Yang Deng , Yulin Hu , Jiahe Guo , Libo Qin , Qianyun Du , Shijin Wang , Yanyan Zhao , Bing Qin , Ting Liu

Existing reinforcement learning approaches for Large Language Models typically perform policy optimization at the granularity of individual tokens or entire response sequences. However, such formulations often misalign with the natural…

人工智能 · 计算机科学 2026-05-08 Lei Gao , Zhuoming Li , Mengxi Jia , Jiakang Yuan , Hongbo Sun , Hao Sun , Xuelong Li