English
Related papers

Related papers: Proxy Experience Replay: Federated Distillation fo…

200 papers

Reinforcement learning (RL) post-training has recently driven major gains in long chain-of-thought reasoning large language models (LLMs), but the high inference cost of such models motivates distillation into smaller students. Most…

Machine Learning · Computer Science 2026-04-13 Zhaoyang Zhang , Shuli Jiang , Yantao Shen , Yuting Zhang , Dhananjay Ram , Shuo Yang , Zhuowen Tu , Wei Xia , Stefano Soatto

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang

Federated learning (FL) offers an innovative paradigm for collaborative model training across decentralized devices, such as smartphones, balancing enhanced predictive performance with the protection of user privacy in sensitive areas like…

Machine Learning · Computer Science 2025-09-15 Mohammad Hasan Narimani , Mostafa Tavassolipour

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

We propose Algorithm Distillation (AD), a method for distilling reinforcement learning (RL) algorithms into neural networks by modeling their training histories with a causal sequence model. Algorithm Distillation treats learning to…

Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges a promising strategy for protecting data privacy and valuable FMs. Existing methods fine-tune FM by allocating sub-FM to clients in FL, however,…

Machine Learning · Computer Science 2024-04-30 Zhaopeng Peng , Xiaoliang Fan , Yufan Chen , Zheng Wang , Shirui Pan , Chenglu Wen , Ruisheng Zhang , Cheng Wang

In a modern power system with an increasing proportion of renewable energy, wind power prediction is crucial to the arrangement of power grid dispatching plans due to the volatility of wind power. However, traditional centralized…

Machine Learning · Computer Science 2022-11-18 Yang Li , Ruinong Wang , Yuanzheng Li , Meng Zhang , Chao Long

Federated Reinforcement Learning (FRL) has been deemed as a promising solution for intelligent decision-making in the era of Artificial Internet of Things. However, existing FRL approaches often entail repeated interactions with the…

Machine Learning · Computer Science 2024-05-30 Sheng Yue , Zerui Qin , Xingyuan Hua , Yongheng Deng , Ju Ren

In response to the trade-off between control performance and computational burden hindering the deployment of Deep Reinforcement Learning (DRL) in power inverters, this paper presents a novel model-free control framework leveraging policy…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Yang Yang , Chenggang Cui , Xitong Niu , Jiaming Liu , Chuanlin Zhang

Deep reinforcement learning (DRL) is a very active research area. However, several technical and scientific issues require to be addressed, amongst which we can mention data inefficiency, exploration-exploitation trade-off, and multi-task…

Machine Learning · Computer Science 2020-11-24 Mohammad Reza Samsami , Hossein Alimadad

Federated Learning (FL) is a distributed framework for collaborative model training over large-scale distributed data, enabling higher performance while maintaining client data privacy. However, the nature of model aggregation at the…

Machine Learning · Computer Science 2025-06-10 Ali Murad , Bo Hui , Wei-Shinn Ku

Although the diffusion model has achieved remarkable performance in the field of image generation, its high inference delay hinders its wide application in edge devices with scarce computing resources. Therefore, many training-free sampling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Weilun Feng , Chuanguang Yang , Zhulin An , Libo Huang , Boyu Diao , Fei Wang , Yongjun Xu

Given the inherent non-stationarity prevalent in real-world applications, continual Reinforcement Learning (RL) aims to equip the agent with the capability to address a series of sequentially presented decision-making tasks. Within this…

Machine Learning · Computer Science 2024-11-19 Feng Chen , Fuguang Han , Cong Guan , Lei Yuan , Zhilong Zhang , Yang Yu , Zongzhang Zhang

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. A key challenge in LfD research is that users tend to provide…

Machine Learning · Computer Science 2022-02-16 Sravan Jayanthi , Letian Chen , Matthew Gombolay

Reinforcement learning has emerged as a powerful tool for improving diffusion-based text-to-image models, but existing methods are largely limited to single-task optimization. Extending RL to multiple tasks is challenging: joint…

Machine Learning · Computer Science 2026-05-15 Quanhao Li , Junqiu Yu , Kaixun Jiang , Yujie Wei , Zhen Xing , Pandeng Li , Ruihang Chu , Shiwei Zhang , Yu Liu , Zuxuan Wu

Federated reinforcement learning (FedRL) enables collaborative learning while preserving data privacy by preventing direct data exchange between agents. However, many existing FedRL algorithms assume that all agents operate in identical…

Machine Learning · Computer Science 2025-06-17 Ali Beikmohammadi , Sarit Khirirat , Peter Richtárik , Sindri Magnússon

Federated fine-tuning of Large Language Models faces severe statistical heterogeneity. However, existing model-level defenses often overlook the root cause: intrinsic data distribution mismatches. In this work, we first establish Federated…

Machine Learning · Computer Science 2026-05-19 Ziheng Ren , Zhanming Shen , Hao Wang , Ning Liu , You Song

Reinforcement learning has recently gained unprecedented popularity, yet it still grapples with sample inefficiency. Addressing this challenge, federated reinforcement learning (FedRL) has emerged, wherein agents collaboratively learn a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-15 Ali Beikmohammadi , Sarit Khirirat , Sindri Magnússon

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

Machine Learning · Computer Science 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen