中文
相关论文

相关论文: Breaking the Impasse: Dual-Scale Evolutionary Poli…

200 篇论文

Inverse reinforcement learning (IRL) is typically formulated as maximizing entropy subject to matching the distribution of expert trajectories. Classical (dual-ascent) IRL guarantees monotonic performance improvement but requires fully…

机器学习 · 计算机科学 2026-05-13 Anish Diwan , Davide Tateo , Christopher E. Mower , Haitham Bou-Ammar , Jan Peters , Oleg Arenz

The growing disparity between the exponential scaling of computational resources and the finite growth of high-quality text data now constrains conventional scaling approaches for large language models (LLMs). To address this challenge, we…

Although deep reinforcement learning methods can learn effective policies for challenging problems such as Atari games and robotics tasks, algorithms are complex, and training times are often long. This study investigates how Evolution…

机器学习 · 计算机科学 2024-07-25 Annie Wong , Jacob de Nobel , Thomas Bäck , Aske Plaat , Anna V. Kononova

Open-ended dialogue agents aim to deliver engaging, personalized interactions by adapting to users' traits, but existing methods face critical limitations: over-reliance on pre-collected user data, and short-horizon biases in reinforcement…

人工智能 · 计算机科学 2026-02-11 Kun Peng , Conghui Tan , Yu Liu , Guohua Tang , Zhongqian Sun , Wei Yang , Zining Zhu , Lei Jiang , Yanbing Liu , Hao Peng

Developing robotic agents that can perform well in diverse environments while showing a variety of behaviors is a key challenge in AI and robotics. Traditional reinforcement learning (RL) methods often create agents that specialize in…

机器人学 · 计算机科学 2025-03-25 Octi Zhang , Quanquan Peng , Rosario Scalise , Bryon Boots

Reinforcement Learning with Verifiable Rewards (RLVR) has established itself as the dominant paradigm for instilling rigorous reasoning capabilities in Large Language Models. While effective at amplifying dominant behaviors, we identify a…

机器学习 · 计算机科学 2026-02-16 Zesheng Hong , Jiadong Yu , Hui Pan

Reinforcement Learning with Verifiable Rewards (RLVR) is a powerful paradigm for enhancing the reasoning ability of Large Language Models (LLMs). Yet current RLVR methods often explore poorly, leading to premature convergence and entropy…

计算与语言 · 计算机科学 2025-09-12 Runpeng Dai , Linfeng Song , Haolin Liu , Zhenwen Liang , Dian Yu , Haitao Mi , Zhaopeng Tu , Rui Liu , Tong Zheng , Hongtu Zhu , Dong Yu

Deep reinforcement learning (DRL) is a promising approach for developing legged locomotion skills. However, the iterative design process that is inevitable in practice is poorly supported by the default methodology. It is difficult to…

机器人学 · 计算机科学 2019-03-25 Zhaoming Xie , Patrick Clary , Jeremy Dao , Pedro Morais , Jonathan Hurst , Michiel van de Panne

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Model (LLM) reasoning have been hindered by a persistent challenge: exploration collapse. The semantic homogeneity of random rollouts often traps…

机器学习 · 计算机科学 2026-01-12 Huilin Deng , Hongchen Luo , Yue Zhu , Long Li , Zhuoyue Chen , Xinghao Zhao , Ming Li , Jihai Zhang , Mengchang Wang , Yang Cao , Yu Kang

Unsupervised skill discovery aims to learn diverse and distinguishable behaviors in open-ended reinforcement learning. For existing methods, they focus on improving diversity through pure exploration, mutual information optimization, and…

机器学习 · 计算机科学 2025-06-27 He Zhang , Ming Zhou , Shaopeng Zhai , Ying Sun , Hui Xiong

Offline reinforcement learning aims to utilize datasets of previously gathered environment-action interaction records to learn a policy without access to the real environment. Recent work has shown that offline reinforcement learning can be…

机器学习 · 计算机科学 2023-08-30 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Model-free reinforcement learning has emerged as a powerful method for developing robust robot control policies capable of navigating through complex and unstructured environments. The effectiveness of these methods hinges on two essential…

机器人学 · 计算机科学 2025-06-06 Youwei Yu , Junhong Xu , Lantao Liu

Reinforcement learning with verifiers (RLVR) is a central paradigm for improving large language model (LLM) reasoning, yet existing methods often suffer from limited exploration. Policies tend to collapse onto a few reasoning patterns and…

Evolutionary algorithms have been used to evolve a population of actors to generate diverse experiences for training reinforcement learning agents, which helps to tackle the temporal credit assignment problem and improves the exploration…

神经与进化计算 · 计算机科学 2023-04-21 Chengpeng Hu , Jiyuan Pei , Jialin Liu , Xin Yao

We obtain global, non-asymptotic convergence guarantees for independent learning algorithms in competitive reinforcement learning settings with two agents (i.e., zero-sum stochastic games). We consider an episodic setting where in each…

机器学习 · 计算机科学 2021-01-13 Constantinos Daskalakis , Dylan J. Foster , Noah Golowich

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an important paradigm for unlocking reasoning capabilities in large language models, exemplified by the success of OpenAI o1 and DeepSeek-R1. Currently, Group Relative…

机器学习 · 计算机科学 2026-01-08 Shijie Zhang , Kevin Zhang , Zheyuan Gu , Xiang Guo , Rujun Guo , Shaoyu Liu , Guanjun Jiang , Xiaozhao Wang

A central challenge in building continually improving agents is that training environments are typically static or manually constructed. This restricts continual learning and generalization beyond the training distribution. We address this…

人工智能 · 计算机科学 2026-03-31 Alkis Sygkounas , Rishi Hazra , Andreas Persson , Pedro Zuidberg Dos Martires , Amy Loutfi

Continual learning is one of the key components of human learning and a necessary requirement of artificial intelligence. As dialogue can potentially span infinitely many topics and tasks, a task-oriented dialogue system must have the…

Reinforcement learning (RL), a common tool in decision making, learns control policies from various experiences based on the associated cumulative return/rewards without treating them differently. Humans, on the contrary, often learn to…

机器学习 · 计算机科学 2025-11-25 Mingkang Wu , Devin White , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

Recent advances in Deep Reinforcement Learning (DRL) have largely focused on improving the performance of agents with the aim of replacing humans in known and well-defined environments. The use of these techniques as a game design tool for…

机器学习 · 计算机科学 2020-12-08 Alessandro Sestini , Alexander Kuhnle , Andrew D. Bagdanov