中文
相关论文

相关论文: Off-Policy Meta-Reinforcement Learning Based on Fe…

200 篇论文

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the…

机器学习 · 计算机科学 2023-04-04 Jin Wang , Jia Hu , Jed Mills , Geyong Min , Ming Xia

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

机器学习 · 计算机科学 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Meta reinforcement learning (meta-RL) aims to learn a policy solving a set of training tasks simultaneously and quickly adapting to new tasks. It requires massive amounts of data drawn from training tasks to infer the common structure…

机器学习 · 计算机科学 2022-07-21 Yijie Guo , Qiucheng Wu , Honglak Lee

Nowadays, Deep Learning (DL) methods often overcome the limitations of traditional signal processing approaches. Nevertheless, DL methods are barely applied in real-life applications. This is mainly due to limited robustness and…

机器学习 · 计算机科学 2022-10-27 Julius Ott , Lorenzo Servadei , Gianfranco Mauro , Thomas Stadelmayer , Avik Santra , Robert Wille

Model-based deep reinforcement learning has achieved success in various domains that require high sample efficiencies, such as Go and robotics. However, there are some remaining issues, such as planning efficient explorations to learn more…

机器学习 · 计算机科学 2021-07-06 Yao Yao , Li Xiao , Zhicheng An , Wanpeng Zhang , Dijun Luo

This paper discusses an Enhanced Model-Agnostic Meta-Learning (E-MAML) algorithm that generates fast convergence of the policy function from a small number of training examples when applied to new learning tasks. Built on top of…

机器学习 · 计算机科学 2020-12-14 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

机器学习 · 计算机科学 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this…

人工智能 · 计算机科学 2015-10-12 John-Alexander M. Assael , Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Meta-learning is a branch of machine learning which trains neural network models to synthesize a wide variety of data in order to rapidly solve new problems. In process control, many systems have similar and well-understood dynamics, which…

系统与控制 · 电气工程与系统科学 2022-09-20 Daniel G. McClement , Nathan P. Lawrence , Johan U. Backstrom , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni

Reinforcement learning has become the central approach for language models (LMs) to learn from environmental reward or feedback. In practice, the environmental feedback is usually sparse and delayed. Learning from such signals is…

机器学习 · 计算机科学 2026-02-17 Taiwei Shi , Sihao Chen , Bowen Jiang , Linxin Song , Longqi Yang , Jieyu Zhao

Recent years, the database committee has attempted to develop automatic database management systems. Although some researches show that the applying AI to data management is a significant and promising direction, there still exists many…

数据库 · 计算机科学 2021-11-23 Yu Yan , Hongzhi Wang , Jian Ma , Jian Geng , Yuzhuo Wang

Ad hoc teamwork problem describes situations where an agent has to cooperate with previously unseen agents to achieve a common goal. For an agent to be successful in these scenarios, it has to have a suitable cooperative skill. One could…

人工智能 · 计算机科学 2022-10-21 Rujikorn Charakorn , Poramate Manoonpong , Nat Dilokthanakul

Modern deep architectures often rely on large-scale datasets, but training on these datasets incurs high computational and storage overhead. Real-world datasets often contain substantial redundancies, prompting the need for more…

机器学习 · 计算机科学 2025-06-27 Suorong Yang , Peijia Li , Furao Shen , Jian Zhao

Reinforcement learning (RL) algorithms are often categorized as either on-policy or off-policy depending on whether they use data from a target policy of interest or from a different behavior policy. In this paper, we study a subtle…

机器学习 · 计算机科学 2022-10-12 Rujie Zhong , Duohan Zhang , Lukas Schäfer , Stefano V. Albrecht , Josiah P. Hanna

Meta-reinforcement learning (Meta-RL) has attracted attention due to its capability to enhance reinforcement learning (RL) algorithms, in terms of data efficiency and generalizability. In this paper, we develop a bilevel optimization…

机器学习 · 计算机科学 2024-10-15 Siyuan Xu , Minghui Zhu

Improving the sample efficiency of reinforcement learning algorithms requires effective exploration. Following the principle of $\textit{optimism in the face of uncertainty}$ (OFU), we train a separate exploration policy to maximize the…

机器学习 · 计算机科学 2022-11-23 Jiachen Li , Shuo Cheng , Zhenyu Liao , Huayan Wang , William Yang Wang , Qinxun Bai

While deep reinforcement learning (RL) has fueled multiple high-profile successes in machine learning, it is held back from more widespread adoption by its often poor data efficiency and the limited generality of the policies it produces. A…

机器学习 · 计算机科学 2025-05-30 Jacob Beck , Risto Vuorio , Evan Zheran Liu , Zheng Xiong , Luisa Zintgraf , Chelsea Finn , Shimon Whiteson

In real-world tasks, reinforcement learning (RL) agents frequently encounter situations that are not present during training time. To ensure reliable performance, the RL agents need to exhibit robustness against worst-case situations. The…

机器学习 · 计算机科学 2021-03-19 Sebastian Curi , Ilija Bogunovic , Andreas Krause

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

机器学习 · 计算机科学 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

This paper introduces Meta-Q-Learning (MQL), a new off-policy algorithm for meta-Reinforcement Learning (meta-RL). MQL builds upon three simple ideas. First, we show that Q-learning is competitive with state-of-the-art meta-RL algorithms if…

机器学习 · 计算机科学 2020-04-07 Rasool Fakoor , Pratik Chaudhari , Stefano Soatto , Alexander J. Smola