中文
相关论文

相关论文: Equivariant Ensembles and Regularization for Reinf…

200 篇论文

Reinforcement learning (RL) agents typically optimize their policies by performing expensive backward passes to update their network parameters. However, some agents can solve new tasks without updating any parameters by simply conditioning…

机器学习 · 计算机科学 2025-02-13 Amir Moeini , Jiuqi Wang , Jacob Beck , Ethan Blaser , Shimon Whiteson , Rohan Chandra , Shangtong Zhang

Equivariant deep learning architectures exploit symmetries in learning problems to improve the sample efficiency of neural-network-based models and their ability to generalise. However, when modelling real-world data, learning problems are…

机器学习 · 统计学 2024-11-12 Matthew Ashman , Cristiana Diaconu , Adrian Weller , Wessel Bruinsma , Richard E. Turner

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Datasets often have their intrinsic symmetries, and particular deep-learning models called equivariant or invariant models have been developed to exploit these symmetries. However, if some or all of these symmetries are only approximate,…

机器学习 · 计算机科学 2023-06-02 Hyunsu Kim , Hyungi Lee , Hongseok Yang , Juho Lee

Normalization layers have recently experienced a renaissance in the deep reinforcement learning and continual learning literature, with several works highlighting diverse benefits such as improving loss landscape conditioning and combatting…

机器学习 · 计算机科学 2024-07-03 Clare Lyle , Zeyu Zheng , Khimya Khetarpal , James Martens , Hado van Hasselt , Razvan Pascanu , Will Dabney

In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect…

机器人学 · 计算机科学 2024-03-01 Adam Sigal , Hsiu-Chin Lin , AJung Moon

Recently, incorporating natural language instructions into reinforcement learning (RL) to learn semantically meaningful representations and foster generalization has caught many concerns. However, the semantical information in language…

计算与语言 · 计算机科学 2022-02-02 Yihan Li , Jinsheng Ren , Tianrun Xu , Tianren Zhang , Haichuan Gao , Feng Chen

Model-free reinforcement learning is a promising approach for autonomously solving challenging robotics control problems, but faces exploration difficulty without information of the robot's kinematics and dynamics morphology. The…

We present a novel approach to address the challenge of generalization in offline reinforcement learning (RL), where the agent learns from a fixed dataset without any additional interaction with the environment. Specifically, we aim to…

In this paper, we develop a theory about the relationship between invariant and equivariant maps with regard to a group $G$. We then leverage this theory in the context of deep neural networks with group symmetries in order to obtain novel…

机器学习 · 计算机科学 2024-09-27 Akiyoshi Sannai , Yuuki Takai , Matthieu Cordonnier

In many real-world reinforcement learning (RL) problems, the environment exhibits inherent symmetries that can be exploited to improve learning efficiency. This paper develops a theoretical and algorithmic framework for incorporating known…

机器学习 · 计算机科学 2026-04-29 Alexandru Cioba , Aya Kayal , Laura Toni , Sattar Vakili , Alberto Bernacchia

Sequence prediction models can be learned from example sequences with a variety of training algorithms. Maximum likelihood learning is simple and efficient, yet can suffer from compounding error at test time. Reinforcement learning such as…

机器学习 · 计算机科学 2019-07-02 Bowen Tan , Zhiting Hu , Zichao Yang , Ruslan Salakhutdinov , Eric Xing

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

机器学习 · 统计学 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Deep reinforcement learning (DRL) has had success across various domains, but applying it to environments with constraints remains challenging due to poor sample efficiency and slow convergence. Recent literature explored incorporating…

Scaling reinforcement learning to tens of thousands of parallel environments requires overcoming the limited exploration capacity of a single policy. Ensemble-based policy gradient methods, which employ multiple policies to collect diverse…

机器学习 · 计算机科学 2026-03-04 Naoki Shitanda , Motoki Omura , Tatsuya Harada , Takayuki Osa

Ensemble methods have been widely applied in Reinforcement Learning (RL) in order to enhance stability, increase convergence speed, and improve exploration. These methods typically work by employing an aggregation mechanism over actions of…

人工智能 · 计算机科学 2019-10-09 Rishav Chourasia , Adish Singla

Designing machine learning architectures for processing neural networks in their raw weight matrix form is a newly introduced research direction. Unfortunately, the unique symmetry structure of deep weight spaces makes this design very…

机器学习 · 计算机科学 2023-06-02 Aviv Navon , Aviv Shamsian , Idan Achituve , Ethan Fetaya , Gal Chechik , Haggai Maron

Model-based reinforcement learning could enable sample-efficient learning by quickly acquiring rich knowledge about the world and using it to improve behaviour without additional data. Learned dynamics models can be directly used for…

机器学习 · 计算机科学 2019-10-15 Rinu Boney , Juho Kannala , Alexander Ilin

Multi-task learning is a very challenging problem in reinforcement learning. While training multiple tasks jointly allow the policies to share parameters across different tasks, the optimization problem becomes non-trivial: It remains…

机器学习 · 计算机科学 2020-12-08 Ruihan Yang , Huazhe Xu , Yi Wu , Xiaolong Wang

Equivariant networks are specifically designed to ensure consistent behavior with respect to a set of input transformations, leading to higher sample efficiency and more accurate and robust predictions. However, redesigning each component…