中文
相关论文

相关论文: What and When to Distill: Selective Hindsight Dist…

200 篇论文

As Multimodal Large Language Models (MLLMs) mature, GUI agents are evolving from static interactions to complex navigation. While Reinforcement Learning (RL) has emerged as a promising paradigm for training MLLM agents on dynamic GUI tasks,…

Online recommendation requires handling rapidly changing user preferences. Deep reinforcement learning (DRL) is gaining interest as an effective means of capturing users' dynamic interest during interactions with recommender systems.…

信息检索 · 计算机科学 2021-10-22 Xiaocong Chen , Lina Yao , Xianzhi Wang , Julian McAuley

Growing efforts to improve knowledge distillation (KD) in large language models (LLMs) replace dense teacher supervision with selective distillation, which uses a subset of token positions, vocabulary classes, or training samples for…

计算与语言 · 计算机科学 2026-02-03 Almog Tavor , Itay Ebenspanger , Neil Cnaan , Mor Geva

Reinforcement learning (RL) allows an agent interacting sequentially with an environment to maximize its long-term expected return. In the distributional RL (DistrRL) paradigm, the agent goes beyond the limit of the expected value, to…

机器学习 · 计算机科学 2023-05-01 Mastane Achab , Reda Alami , Yasser Abdelaziz Dahou Djilali , Kirill Fedyanin , Eric Moulines

In recent years, significant progress has been made in the field of robotic reinforcement learning (RL), enabling methods that handle complex image observations, train in the real world, and incorporate auxiliary data, such as…

We introduce Synthetic Environments (SEs) and Reward Networks (RNs), represented by neural networks, as proxy environment models for training Reinforcement Learning (RL) agents. We show that an agent, after being trained exclusively on the…

机器学习 · 计算机科学 2022-02-08 Fabio Ferreira , Thomas Nierhoff , Andreas Saelinger , Frank Hutter

Reinforcement learning (RL) research focuses on general solutions that can be applied across different domains. This results in methods that RL practitioners can use in almost any domain. However, recent studies often lack the engineering…

机器学习 · 计算机科学 2021-07-05 Anssi Kanervisto , Christian Scheller , Yanick Schraner , Ville Hautamäki

Reinforcement learning (RL) agents are costly to train and fragile to environmental changes. They often perform poorly when there are many changing tasks, prohibiting their widespread deployment in the real world. Many Lifelong RL agent…

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

多智能体系统 · 计算机科学 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Distilling the tool-using capabilities of large language models (LLMs) into smaller, more efficient small language models (SLMs) is a key challenge for their practical application. The predominant approach, supervised fine-tuning (SFT),…

计算与语言 · 计算机科学 2025-10-29 ChangSu Choi , Hoyun Song , Dongyeon Kim , WooHyeon Jung , Minkyung Cho , Sunjin Park , NohHyeob Bae , Seona Yu , KyungTae Lim

Multi-agent reinforcement learning (MARL) faces two critical bottlenecks distinct from single-agent RL: credit assignment in cooperative tasks and partial observability of environmental states. We propose LERO, a framework integrating Large…

机器学习 · 计算机科学 2025-03-31 Yuan Wei , Xiaohan Shan , Jianmin Li

Reinforcement Learning (RL) based methods have been increasingly explored for robot learning. However, RL based methods often suffer from low sampling efficiency in the exploration phase, especially for long-horizon manipulation tasks, and…

机器人学 · 计算机科学 2024-12-31 Hao Zhang , Hao Wang , Xiucai Huang , Wenrui Chen , Zhen Kan

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

计算与语言 · 计算机科学 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

Deep reinforcement learning (RL) is a powerful approach to complex decision making. However, one issue that limits its practical application is its brittleness, sometimes failing to train in the presence of small changes in the environment.…

机器学习 · 计算机科学 2025-01-27 Jung-Hoon Cho , Vindula Jayawardana , Sirui Li , Cathy Wu

Multi-agent reinforcement learning has shown promise in learning cooperative behaviors in team-based environments. However, such methods often demand extensive training time. For instance, the state-of-the-art method TiZero takes 40 days to…

机器学习 · 计算机科学 2025-03-18 Amir Baghi , Jens Sjölund , Joakim Bergdahl , Linus Gisslén , Alessandro Sestini

The alignment of Large Language Models (LLMs) for complex reasoning heavily relies on Reinforcement Learning with Verifiable Rewards (RLVR). However, standard algorithms like GRPO apply sequence-level rewards uniformly to all tokens,…

人工智能 · 计算机科学 2026-05-19 Zhenlin Wei , Pu Jian , Yingzhuo Deng , Xiaohan Wang , Jiajun Chai , Zhexin Hu , Wei Lin , Shanbin Zhang , Guojun Yin

We present a novel multi-agent RL approach, Selective Multi-Agent Prioritized Experience Relay, in which agents share with other agents a limited number of transitions they observe during training. The intuition behind this is that even a…

机器学习 · 计算机科学 2024-04-25 Matthias Gerstgrasser , Tom Danino , Sarah Keren

There is a growing interest in Multi-Agent Reinforcement Learning (MARL) as the first steps towards building general intelligent agents that learn to make low and high-level decisions in non-stationary complex environments in the presence…

人工智能 · 计算机科学 2020-01-01 Marco Jerome Gasparrini , Ricard Solé , Martí Sánchez-Fibla

Transfer learning is an important new subfield of multiagent reinforcement learning that aims to help an agent learn about a problem by using knowledge that it has gained solving another problem, or by using knowledge that is communicated…

人工智能 · 计算机科学 2020-02-10 Cameron Reid