中文
相关论文

相关论文: FOVA: Offline Federated Reinforcement Learning wit…

200 篇论文

Offline reinforcement learning (RL) allows for the training of competent agents from offline datasets without any interaction with the environment. Online finetuning of such offline models can further improve performance. But how should we…

机器学习 · 计算机科学 2023-03-31 Yicheng Luo , Jackie Kay , Edward Grefenstette , Marc Peter Deisenroth

We investigate a Federated Reinforcement Learning with Environment Heterogeneity (FRL-EH) framework, where local environments exhibit statistical heterogeneity. Within this framework, agents collaboratively learn a global policy by…

机器学习 · 计算机科学 2025-07-22 Ukjo Hwang , Songnam Hong

Federated Learning (FL) has emerged as a promising Machine Learning paradigm, enabling multiple users to collaboratively train a shared model while preserving their local data. To minimize computing and communication costs associated with…

机器学习 · 计算机科学 2023-11-14 Sofiane Bouaziz , Hadjer Benmeziane , Youcef Imine , Leila Hamdad , Smail Niar , Hamza Ouarnoughi

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

机器学习 · 计算机科学 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Online reinforcement learning (RL) enhances policies through direct interactions with the environment, but faces challenges related to sample efficiency. In contrast, offline RL leverages extensive pre-collected data to learn policies, but…

机器学习 · 计算机科学 2026-03-10 Xuefeng Liu , Hung T. C. Le , Siyu Chen , Rick Stevens , Zhuoran Yang , Matthew R. Walter , Yuxin Chen

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the…

机器学习 · 计算机科学 2023-04-04 Jin Wang , Jia Hu , Jed Mills , Geyong Min , Ming Xia

Resource allocation significantly impacts the performance of vehicle-to-everything (V2X) networks. Most existing algorithms for resource allocation are based on optimization or machine learning (e.g., reinforcement learning). In this paper,…

机器学习 · 计算机科学 2023-10-17 Kaidi Xu , Shenglong Zhou , Geoffrey Ye Li

Low-rank adaptation (LoRA) is one of the most popular task-specific parameter-efficient fine-tuning (PEFT) methods on pre-trained language models for its good performance and computational efficiency. LoRA injects a product of two trainable…

机器学习 · 计算机科学 2024-03-20 Youbang Sun , Zitao Li , Yaliang Li , Bolin Ding

Federated learning (FL) is a paradigm where many clients collaboratively train a model under the coordination of a central server, while keeping the training data locally stored. However, heterogeneous data distributions over different…

机器学习 · 计算机科学 2022-05-27 Yaqi Sun , Shijing Si , Jianzong Wang , Yuhan Dong , Zhitao Zhu , Jing Xiao

Offline reinforcement learning (RL) aims to infer sequential decision policies using only offline datasets. This is a particularly difficult setup, especially when learning to achieve multiple different goals or outcomes under a given…

机器学习 · 计算机科学 2024-05-17 Mianchu Wang , Yue Jin , Giovanni Montana

Offline reinforcement learning (RL) enables the agent to effectively learn from logged data, which significantly extends the applicability of RL algorithms in real-world scenarios where exploration can be expensive or unsafe. Previous works…

机器学习 · 计算机科学 2022-12-05 Yiqin Yang , Hao Hu , Wenzhe Li , Siyuan Li , Jun Yang , Qianchuan Zhao , Chongjie Zhang

Offline meta-reinforcement learning (OMRL) combines the strengths of learning from diverse datasets in offline RL with the adaptability to new tasks of meta-RL, promising safe and efficient knowledge acquisition by RL agents. However, OMRL…

机器学习 · 计算机科学 2026-01-13 Min Wang , Xin Li , Mingzhong Wang , Hasnaa Bennis

Offline Reinforcement Learning (RL) focuses on learning policies solely from a batch of previously collected data. offering the potential to leverage such datasets effectively without the need for costly or risky active exploration. While…

机器学习 · 计算机科学 2025-06-06 Riccardo Zamboni , Enrico Brunetti , Marcello Restelli

Reinforcement learning (RL) is a powerful paradigm for learning to make sequences of decisions. However, RL has yet to be fully leveraged in robotics, principally due to its lack of scalability. Offline RL offers a promising avenue by…

机器学习 · 计算机科学 2025-10-10 Nicolas Espinosa-Dice , Kiante Brantley , Wen Sun

In 6G wireless networks, Artificial Intelligence (AI)-driven applications demand the adoption of Federated Learning (FL) to enable efficient and privacy-preserving model training across distributed devices. Over-The-Air Federated Learning…

机器学习 · 计算机科学 2025-06-23 Zubair Shaban , Nazreen Shah , Ranjitha Prasad

Offline Reinforcement Learning (RL) aims to turn large datasets into powerful decision-making engines without any online interactions with the environment. This great promise has motivated a large amount of research that hopes to replicate…

Federated Learning (FL) is a way for machines to learn from data that is kept locally, in order to protect the privacy of clients. This is typically done using local SGD, which helps to improve communication efficiency. However, such a…

机器学习 · 计算机科学 2023-06-01 Yongxin Guo , Xiaoying Tang , Tao Lin

Federated Learning (FL) enables decentralized model training across clients without sharing raw data, but its performance degrades under real-world data heterogeneity. Existing methods often fail to address distribution shift across clients…

机器学习 · 计算机科学 2026-02-10 Mohan Li , Dario Fenoglio , Martin Gjoreski , Marc Langheinrich

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

机器学习 · 计算机科学 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

Sample efficiency and exploration remain major challenges in online reinforcement learning (RL). A powerful approach that can be applied to address these issues is the inclusion of offline data, such as prior trajectories from a human…

机器学习 · 计算机科学 2023-06-01 Philip J. Ball , Laura Smith , Ilya Kostrikov , Sergey Levine