中文
相关论文

相关论文: PoLi-RL: A Point-to-List Reinforcement Learning Fr…

200 篇论文

Reinforcement learning (RL) has emerged as a key paradigm for aligning and optimizing large language models (LLMs). Standard approaches treat the LLM as the policy and apply RL directly over the full vocabulary space. However, this…

机器学习 · 计算机科学 2026-02-17 Jing-Cheng Pang , Liang Lu , Xian Tang , Kun Jiang , Sijie Wu , Kai Zhang , Xubin Li

Interest in reinforcement learning (RL) has recently surged due to the application of deep learning techniques, but these connectionist approaches are opaque compared with symbolic systems. Learning Classifier Systems (LCSs) are…

机器学习 · 计算机科学 2023-05-18 Jordan T. Bishop , Marcus Gallagher , Will N. Browne

Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Despite their prevalence, both approaches suffer from…

机器学习 · 计算机科学 2026-04-21 Yuming Yan , Kai Tang , Sihong Chen , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu

Inspired by the impressive reasoning capabilities demonstrated by reinforcement learning approaches like DeepSeek-R1, recent emerging research has begun exploring the use of reinforcement learning (RL) to enhance vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Yizhen Zhang , Yang Ding , Shuoshuo Zhang , Xinchen Zhang , Haoling Li , Zhong-zhi Li , Peijie Wang , Jie Wu , Lei Ji , Yelong Shen , Yujiu Yang , Yeyun Gong

Reinforcement Learning with Verifiable Rewards (RLVR) elicits long chain-of-thought reasoning in large language models (LLMs), but outcome-based rewards lead to coarse-grained advantage estimation. While existing approaches improve RLVR via…

计算与语言 · 计算机科学 2026-01-08 Fei Wu , Zhenrong Zhang , Qikai Chang , Jianshu Zhang , Quan Liu , Jun Du

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Zongzhao Li , Zongyang Ma , Mingze Li , Songyou Li , Yu Rong , Tingyang Xu , Ziqi Zhang , Deli Zhao , Wenbing Huang

Semantic role labeling (SRL) is a central natural language processing task for understanding predicate-argument structures within texts and enabling downstream applications. Despite extensive research, comprehensive surveys that critically…

计算与语言 · 计算机科学 2026-04-08 Huiyao Chen , Meishan Zhang , Jing Li , Lilja Øvrelid , Jan Hajič , Hao Fei , Min Zhang

Recent advances have demonstrated the effectiveness of Reinforcement Learning (RL) in improving the reasoning capabilities of Large Language Models (LLMs). However, existing works inevitably rely on high-quality instructions and verifiable…

计算与语言 · 计算机科学 2026-01-27 Wenkai Fang , Shunyu Liu , Yang Zhou , Kongcheng Zhang , Tongya Zheng , Kaixuan Chen , Mingli Song , Dacheng Tao

Proximal Policy Optimization (PPO) is commonly used in Reinforcement Learning from Human Feedback to align large language models (LLMs) with downstream tasks. This paper investigates the feasibility of using PPO for direct reinforcement…

计算与语言 · 计算机科学 2024-10-23 Alexander G. Padula , Dennis J. N. J. Soemers

This paper studies satisfaction of temporal properties on unknown stochastic processes that have continuous state spaces. We show how reinforcement learning (RL) can be applied for computing policies that are finite-memory and deterministic…

系统与控制 · 电气工程与系统科学 2020-09-29 Milad Kazemi , Sadegh Soudjani

Reinforcement learning from verifiable rewards (RLVR) has recently been extended from text-only LLMs to vision-language models (VLMs) to elicit long-chain multimodal reasoning. However, RLVR-trained VLMs still exhibit two persistent failure…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Hoang Anh Just , Yifei Fan , Handong Zhao , Jiuxiang Gu , Ruiyi Zhang , Simon Jenni , Kushal Kafle , Ruoxi Jia , Jing Shi

Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive pairs: they either rely on random perturbations that corrupt…

信息检索 · 计算机科学 2025-12-23 Ziqiang Cui , Yunpeng Weng , Xing Tang , Xiaokun Zhang , Shiwei Li , Peiyang Liu , Bowei He , Dugang Liu , Weihong Luo , Xiuqiang He , Chen Ma

In this work, we introduce Reinforcement Pre-Training (RPT) as a new scaling paradigm for large language models and reinforcement learning (RL). Specifically, we reframe next-token prediction as a reasoning task trained using RL, where it…

计算与语言 · 计算机科学 2025-06-10 Qingxiu Dong , Li Dong , Yao Tang , Tianzhu Ye , Yutao Sun , Zhifang Sui , Furu Wei

Semi-supervised learning is a promising way to reduce the annotation cost for text-classification. Combining with pre-trained language models (PLMs), e.g., BERT, recent semi-supervised learning methods achieved impressive performance. In…

计算与语言 · 计算机科学 2022-05-23 Hai-Ming Xu , Lingqiao Liu , Ehsan Abbasnejad

Current Reinforcement Learning (RL) methodologies for Large Language Models (LLMs) often rely on simplistic, outcome-based reward signals (e.g., final answer correctness), which limits the depth of learning from each interaction. This paper…

人工智能 · 计算机科学 2025-06-17 Xiangfan Wu

Click-Through Rate (CTR) prediction holds a paramount position in recommender systems. The prevailing ID-based paradigm underperforms in cold-start scenarios due to the skewed distribution of feature frequency. Additionally, the utilization…

Traditional vision-language models struggle with contrastive fine-grained taxonomic reasoning, particularly when distinguishing between visually similar species within the same genus or family. We introduce TaxonRL, a reinforcement learning…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Maximilian von Klinski , Maximilian Schall

Alignment methodologies have emerged as a critical pathway for enhancing language model alignment capabilities. While SFT (supervised fine-tuning) accelerates convergence through direct token-level loss intervention, its efficacy is…

Reinforcement Learning (RL) has emerged as a transformative approach for aligning and enhancing Large Language Models (LLMs), addressing critical challenges in instruction following, ethical alignment, and reasoning capabilities. This…

人工智能 · 计算机科学 2025-07-08 Saksham Sahai Srivastava , Vaneet Aggarwal

Recent advances in Large Language Models(LLMs) have enabled strong performance in long-form writing, but current training paradigms remain limited: Supervised Fine-Tuning (SFT) remains constrained by data saturation and performance…

计算与语言 · 计算机科学 2026-04-21 Xuanyu Lei , Chenliang Li , Yuning Wu , Kaiming Liu , Weizhou Shen , Peng Li , Ming Yan , Fei Huang , Ya-Qin Zhang , Yang Liu