中文
相关论文

相关论文: KnowRU: Knowledge Reusing via Knowledge Distillati…

200 篇论文

Reinforcement learning (RL) has achieved tremendous success as a general framework for learning how to make decisions. However, this success relies on the interactive hand-tuning of a reward function by RL experts. On the other hand,…

机器学习 · 计算机科学 2020-11-24 Letian Chen , Rohan Paleja , Muyleng Ghuy , Matthew Gombolay

Deep Reinforcement Learning (DRL) is a powerful framework for solving complex sequential decision-making problems, particularly in robotic control. However, its practical deployment is often hindered by the substantial amount of experience…

机器人学 · 计算机科学 2026-01-26 Lucía Güitta-López , Vincenzo Suriani , Jaime Boal , Álvaro J. López-López , Daniele Nardi

Knowledge distillation is an effective technique that transfers knowledge from a large teacher model to a shallow student. However, just like massive classification, large scale knowledge distillation also imposes heavy computational costs…

机器学习 · 计算机科学 2018-12-04 Minghan Li , Tanli Zuo , Ruicheng Li , Martha White , Weishi Zheng

Collaborative learning has emerged as a key paradigm in large-scale intelligent systems, enabling distributed agents to cooperatively train their models while addressing their privacy concerns. Central to this paradigm is knowledge…

分布式、并行与集群计算 · 计算机科学 2025-12-24 Pengchao Han , Xi Huang , Yi Fang , Guojun Han

The field of cooperative multi-agent reinforcement learning (MARL) has seen widespread use in addressing complex coordination tasks. While value decomposition methods in MARL have been popular, they have limitations in solving tasks with…

多智能体系统 · 计算机科学 2023-07-06 Shanqi Liu , Weiwei Liu , Wenzhou Chen , Guanzhong Tian , Yong Liu

We present Reinforcement Learning via Auxiliary Task Distillation (AuxDistill), a new method that enables reinforcement learning (RL) to perform long-horizon robot control problems by distilling behaviors from auxiliary RL tasks. AuxDistill…

机器学习 · 计算机科学 2024-06-26 Abhinav Narayan Harish , Larry Heck , Josiah P. Hanna , Zsolt Kira , Andrew Szot

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly…

机器学习 · 计算机科学 2021-11-02 Chenghao Li , Tonghan Wang , Chengjie Wu , Qianchuan Zhao , Jun Yang , Chongjie Zhang

Large Reasoning Models (LRMs) face two fundamental limitations: excessive token consumption when overanalyzing simple information processing tasks, and inability to access up-to-date knowledge beyond their training data. We introduce MARS…

Reinforcement learning (RL) has shown great success in solving many challenging tasks via use of deep neural networks. Although using deep learning for RL brings immense representational power, it also causes a well-known…

机器学习 · 计算机科学 2022-04-18 Sahir , Ercüment İlhan , Srijita Das , Matthew E. Taylor

Knowledge distillation deploys complex machine learning models in resource-constrained environments by training a smaller student model to emulate internal representations of a complex teacher model. However, the teacher's representations…

Intelligent agents rely heavily on prior experience when learning a new task, yet most modern reinforcement learning (RL) approaches learn every task from scratch. One approach for leveraging prior knowledge is to transfer skills learned on…

机器学习 · 计算机科学 2020-10-23 Karl Pertsch , Youngwoon Lee , Joseph J. Lim

Large Language Models (LLMs) have shown promising performance in knowledge-intensive reasoning tasks that require a compound understanding of knowledge. However, deployment of the LLMs in real-world applications can be challenging due to…

计算与语言 · 计算机科学 2023-10-31 Minki Kang , Seanie Lee , Jinheon Baek , Kenji Kawaguchi , Sung Ju Hwang

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Cooperative multi-agent reinforcement learning often requires decentralised policies, which severely limit the agents' ability to coordinate their behaviour. In this paper, we show that common knowledge between agents allows for complex…

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

A common challenge in reinforcement learning is how to convert the agent's interactions with an environment into fast and robust learning. For instance, earlier work makes use of domain knowledge to improve existing reinforcement learning…

机器学习 · 计算机科学 2020-04-01 Yannis Flet-Berliac , Philippe Preux

Multi-agent systems have evolved into practical LLM-driven collaborators for many applications, gaining robustness from diversity and cross-checking. However, multi-agent RL (MARL) training is resource-intensive and unstable: co-adapting…

While large language model (LLM) multi-agent systems achieve superior reasoning performance through iterative debate, practical deployment is limited by their high computational cost and error propagation. This paper proposes AgentArk, a…

人工智能 · 计算机科学 2026-05-26 Yinyi Luo , Yiqiao Jin , Weichen Yu , Mengqi Zhang , Srijan Kumar , Xiaoxiao Li , Weijie Xu , Xin Chen , Jindong Wang

Target localization is a critical task in sensitive applications, where multiple sensing agents communicate and collaborate to identify the target location based on sensor readings. Existing approaches investigated the use of Multi-Agent…

机器学习 · 计算机科学 2025-01-22 Ahmed Alagha , Rabeb Mizouni , Shakti Singh , Jamal Bentahar , Hadi Otrok

We study multi-agent reinforcement learning (MARL) with centralized training and decentralized execution. During the training, new agents may join, and existing agents may unexpectedly leave the training. In such situations, a standard deep…

机器学习 · 计算机科学 2022-08-05 Xuting Tang , Jia Xu , Shusen Wang