中文
相关论文

相关论文: ESRL: Efficient Sampling-based Reinforcement Learn…

200 篇论文

In recent times, sequence-to-sequence (seq2seq) models have gained a lot of popularity and provide state-of-the-art performance in a wide variety of tasks such as machine translation, headline generation, text summarization, speech to text…

机器学习 · 计算机科学 2019-04-17 Yaser Keneshloo , Tian Shi , Naren Ramakrishnan , Chandan K. Reddy

Reinforcement Learning (RL) has been shown to improve the capabilities of large language models (LLMs). However, applying RL to open-domain tasks faces two key challenges: (1) the inherent subjectivity of these tasks prevents the verifiable…

机器学习 · 计算机科学 2026-02-26 Weixuan Ou , Yanzhao Zheng , Shuoshuo Sun , Wei Zhang , Baohua Dong , Hangcheng Zhu , Ruohui Huang , Gang Yu , Pengwei Yan , Yifan Qiao

Sample inefficiency is a long-lasting challenge in deep reinforcement learning (DRL). Despite dramatic improvements have been made, the problem is far from being solved and is especially challenging in environments with sparse or delayed…

机器学习 · 计算机科学 2025-06-17 Federico Malato , Ville Hautamaki

Deep reinforcement learning (DRL) is a promising approach for adaptive robot control, but its current application to robotics is currently hindered by high sample requirements. We propose two novel data augmentation techniques for DRL in…

人工智能 · 计算机科学 2019-11-18 Yijiong Lin , Jiancong Huang , Matthieu Zimmer , Juan Rojas , Paul Weng

We introduce MotionRL, the first approach to utilize Multi-Reward Reinforcement Learning (RL) for optimizing text-to-motion generation tasks and aligning them with human preferences. Previous works focused on improving numerical performance…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Xiaoyang Liu , Yunyao Mao , Wengang Zhou , Houqiang Li

Many continuous control tasks have easily formulated objectives, yet using them directly as a reward in reinforcement learning (RL) leads to suboptimal policies. Therefore, many classical control tasks guide RL training using complex…

机器学习 · 计算机科学 2019-05-21 Aleksandra Faust , Anthony Francis , Dar Mehta

One of the main goals of reinforcement learning (RL) is to provide a~way for physical machines to learn optimal behavior instead of being programmed. However, effective control of the machines usually requires fine time discretization. The…

机器学习 · 计算机科学 2022-07-12 Jakub Łyskawa , Paweł Wawrzyński

Preference-based reinforcement learning (PbRL) has shown impressive capabilities in training agents without reward engineering. However, a notable limitation of PbRL is its dependency on substantial human feedback. This dependency stems…

机器学习 · 计算机科学 2024-05-30 Fengshuo Bai , Rui Zhao , Hongming Zhang , Sijia Cui , Ying Wen , Yaodong Yang , Bo Xu , Lei Han

While reinforcement learning (RL) is increasingly used for LLM-based tool learning, its efficiency is often hampered by an overabundance of simple samples that provide diminishing learning value as training progresses. Existing dynamic…

机器学习 · 计算机科学 2025-09-19 Zihao Feng , Xiaoxue Wang , Bowen Wu , Hailong Cao , Tiejun Zhao , Qun Yu , Baoxun Wang

Reinforcement learning is the method of choice to train models in sampling-based setups with binary outcome feedback, such as navigation, code generation, and mathematical problem solving. In such settings, models implicitly induce a…

Interpreting the reasoning process from questions to answers poses a challenge in approaching explainable QA. A recently proposed structured reasoning format, entailment tree, manages to offer explicit logical deductions with entailment…

计算与语言 · 计算机科学 2022-11-01 Tengxiao Liu , Qipeng Guo , Xiangkun Hu , Yue Zhang , Xipeng Qiu , Zheng Zhang

Reinforcement learning has been shown to improve the performance of large language models. However, traditional approaches like RLHF or RLAIF treat the problem as single-step. As focus shifts toward more complex reasoning and agentic tasks,…

人工智能 · 计算机科学 2025-04-29 Anna Goldie , Azalia Mirhoseini , Hao Zhou , Irene Cai , Christopher D. Manning

Reinforcement Learning (RL) has proven highly effective for autoregressive language models, but adapting these methods to diffusion large language models (dLLMs) presents fundamental challenges. The core difficulty lies in likelihood…

计算与语言 · 计算机科学 2025-12-04 Jingyang Ou , Jiaqi Han , Minkai Xu , Shaoxuan Xu , Jianwen Xie , Stefano Ermon , Yi Wu , Chongxuan Li

Poor sample efficiency continues to be the primary challenge for deployment of deep Reinforcement Learning (RL) algorithms for real-world applications, and in particular for visuo-motor control. Model-based RL has the potential to be highly…

机器学习 · 计算机科学 2022-12-13 Nicklas Hansen , Yixin Lin , Hao Su , Xiaolong Wang , Vikash Kumar , Aravind Rajeswaran

Aligning the behavior of Large language models (LLMs) with human intentions and values remains a critical challenge. Reinforcement learning from human feedback (RLHF) aligns LLMs by training a reward model (RM) on human preferences and…

计算与语言 · 计算机科学 2025-12-25 Jiayi Zhou , Jiaming Ji , Juntao Dai , Dong Li , Yaodong Yang

Evolutionary Reinforcement Learning (ERL), which integrates Evolutionary Algorithms (EAs) and Reinforcement Learning (RL) for optimization, has demonstrated remarkable performance advancements. By fusing both approaches, ERL has emerged as…

神经与进化计算 · 计算机科学 2026-05-26 Pengyi Li , Jianye Hao , Hongyao Tang , Xian Fu , Yan Zheng , Ke Tang

Decoding-based regression, which reformulates regression as a sequence generation task, has emerged as a promising paradigm of applying large language models for numerical prediction. However, its progress is hindered by the misalignment…

机器学习 · 计算机科学 2025-12-09 Ming Chen , Sheng Tang , Rong-Xi Tan , Ziniu Li , Jiacheng Chen , Ke Xue , Chao Qian

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

机器人学 · 计算机科学 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

机器学习 · 计算机科学 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

Despite the prevalence of retrieval-augmented language models (RALMs), the seamless integration of these models with retrieval mechanisms to enhance performance in document-based tasks remains challenging. While some post-retrieval…

计算与语言 · 计算机科学 2024-06-05 Chuankai Xu , Dongming Zhao , Bo Wang , Hanwen Xing