中文
相关论文

相关论文: MIMEx: Intrinsic Rewards from Masked Input Modelin…

200 篇论文

In this work we consider partially observable environments with sparse rewards. We present a self-supervised representation learning method for image-based observations, which arranges embeddings respecting temporal distance of…

机器学习 · 计算机科学 2020-10-07 Aleksandr Ermolov , Nicu Sebe

Episodic count has been widely used to design a simple yet effective intrinsic motivation for reinforcement learning with a sparse reward. However, the use of episodic count in a high-dimensional state space as well as over a long episode…

机器学习 · 计算机科学 2022-10-12 Daejin Jo , Sungwoong Kim , Daniel Wontae Nam , Taehwan Kwon , Seungeun Rho , Jongmin Kim , Donghoon Lee

Reinforcement learning (RL) agents are particularly hard to train when rewards are sparse. One common solution is to use intrinsic rewards to encourage agents to explore their environment. However, recent intrinsic exploration methods often…

机器学习 · 计算机科学 2022-11-23 Jesse Mu , Victor Zhong , Roberta Raileanu , Minqi Jiang , Noah Goodman , Tim Rocktäschel , Edward Grefenstette

Masked Image Modeling (MIM) is a self-supervised learning technique that involves masking portions of an image, such as pixels, patches, or latent representations, and training models to predict the missing information using the visible…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Shabnam Choudhury , Akhil Vasim , Michael Schmitt , Biplab Banerjee

Effective exploration is critical for reinforcement learning agents in environments with sparse rewards or high-dimensional state-action spaces. Recent works based on state-visitation counts, curiosity and entropy-maximization generate…

机器学习 · 计算机科学 2022-09-13 Bang You , Jingming Xie , Youping Chen , Jan Peters , Oleg Arenz

In humans, intrinsic motivation is an important mechanism for open-ended cognitive development; in robots, it has been shown to be valuable for exploration. An important aspect of human cognitive development is $\textit{episodic memory}$…

机器人学 · 计算机科学 2024-05-21 Jack Vice , Natalie Ruiz-Sanchez , Pamela K. Douglas , Gita Sukthankar

In multi-agent reinforcement learning (MARL), effective exploration is critical, especially in sparse reward environments. Although introducing global intrinsic rewards can foster exploration in such settings, it often complicates credit…

机器学习 · 计算机科学 2024-05-29 Xinran Li , Zifan Liu , Shibo Chen , Jun Zhang

The aim of this paper is to study the reward based policy exploration problem in a supervised learning approach and enable robots to form complex movement trajectories in challenging reward settings and search spaces. For this, the…

机器人学 · 计算机科学 2020-11-10 M. Tuluhan Akbulut , Utku Bozdogan , Ahmet Tekden , Emre Ugur

Self-supervised learning methods like masked autoencoders (MAE) have shown significant promise in learning robust feature representations, particularly in image reconstruction-based pretraining task. However, their performance is often…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Sua Lee , Joonhun Lee , Myungjoo Kang

Intrinsic reward shaping has emerged as a prevalent approach to solving hard-exploration and sparse-rewards environments in reinforcement learning (RL). While single intrinsic rewards, such as curiosity-driven or novelty-based methods, have…

机器学习 · 计算机科学 2025-01-23 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

This paper introduces a novel method of adding intrinsic bonuses to task-oriented reward function in order to efficiently facilitate reinforcement learning search. While various bonuses have been designed to date, they are analogous to the…

机器学习 · 计算机科学 2023-07-04 Taisuke Kobayashi

Designing a distribution of environments in which RL agents can learn interesting and useful skills is a challenging and poorly understood task, for multi-agent environments the difficulties are only exacerbated. One approach is to train a…

机器学习 · 计算机科学 2022-03-07 Ingmar Kanitscheider , Harri Edwards

To overcome the sparse reward challenge in reinforcement learning (RL) for agents based on large language models (LLMs), we propose Mutual Information Self-Evaluation (MISE), an RL paradigm that utilizes hindsight generative self-evaluation…

计算与语言 · 计算机科学 2026-04-14 Jiashu Yao , Heyan Huang , Zeming Liu , Yuhang Guo

As the deep learning revolution marches on, self-supervised learning has garnered increasing attention in recent years thanks to its remarkable representation learning ability and the low dependence on labeled data. Among these varied…

计算机视觉与模式识别 · 计算机科学 2024-01-10 Siyuan Li , Luyuan Zhang , Zedong Wang , Di Wu , Lirong Wu , Zicheng Liu , Jun Xia , Cheng Tan , Yang Liu , Baigui Sun , Stan Z. Li

Intrinsic motivation enables reinforcement learning (RL) agents to explore when rewards are very sparse, where traditional exploration heuristics such as Boltzmann or e-greedy would typically fail. However, intrinsic exploration is…

机器学习 · 计算机科学 2020-04-07 Philippe Morere , Fabio Ramos

Maximum entropy reinforcement learning motivates agents to explore states and actions to maximize the entropy of some distribution, typically by providing additional intrinsic rewards proportional to that entropy function. In this paper, we…

机器学习 · 计算机科学 2026-03-20 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

Efficient exploration is a challenging topic in reinforcement learning, especially for sparse reward tasks. To deal with the reward sparsity, people commonly apply intrinsic rewards to motivate agents to explore the state space efficiently.…

机器学习 · 计算机科学 2023-08-29 Yao Fu , Run Peng , Honglak Lee

Dealing with environments with sparse rewards has always been crucial for systems developed to operate in autonomous open-ended learning settings. Intrinsic Motivations could be an effective way to help Deep Reinforcement Learning…

机器学习 · 计算机科学 2025-04-07 Gianluca Maselli , Vieri Giuliano Santucci

Supervised masking approaches in the time-frequency domain aim to employ deep neural networks to estimate a multiplicative mask to extract clean speech. This leads to a single estimate for each input without any guarantees or measures of…

音频与语音处理 · 电气工程与系统科学 2023-05-16 Huajian Fang , Dennis Becker , Stefan Wermter , Timo Gerkmann

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado