English
Related papers

Related papers: Nuclear Norm Maximization Based Curiosity-Driven L…

200 papers

Curiosity is a general method for augmenting an environment reward with an intrinsic reward, which encourages exploration and is especially useful in sparse reward settings. As curiosity is calculated using next state prediction error, the…

Machine Learning · Computer Science 2021-05-19 Auguste Lehuger , Matthew Crosby

Recent advances in associative memory design through structured pattern sets and graph-based inference algorithms have allowed reliable learning and recall of an exponential number of patterns. Although these designs correct external errors…

Neural and Evolutionary Computing · Computer Science 2014-03-14 Amin Karbasi , Amir Hesam Salavati , Amin Shokrollahi , Lav R. Varshney

This paper delves into applying reinforcement learning (RL) in strategy games, particularly those characterized by parity challenges, as seen in specific positions of Go and Chess and a broader range of impartial games. We propose a…

Artificial Intelligence · Computer Science 2024-01-17 Bei Zhou , Soren Riis

Exploration under sparse reward is a long-standing challenge of model-free reinforcement learning. The state-of-the-art methods address this challenge by introducing intrinsic rewards to encourage exploration in novel states or uncertain…

Machine Learning · Computer Science 2021-02-05 Daochen Zha , Wenye Ma , Lei Yuan , Xia Hu , Ji Liu

Multi-agent deep reinforcement learning (MADRL) problems often encounter the challenge of sparse rewards. This challenge becomes even more pronounced when coordination among agents is necessary. As performance depends not only on one…

Multiagent Systems · Computer Science 2024-02-07 Maxime Toquebiau , Nicolas Bredeche , Faïz Benamar , Jae-Yun Jun

We study a class of reinforcement learning problems where the reward signals for policy learning are generated by an internal reward model that is dependent on and jointly optimized with the policy. This interdependence between the policy…

Machine Learning · Computer Science 2023-08-28 Mengdi Li , Xufeng Zhao , Jae Hee Lee , Cornelius Weber , Stefan Wermter

Successfully navigating a complex environment to obtain a desired outcome is a difficult task, that up to recently was believed to be capable only by humans. This perception has been broken down over time, especially with the introduction…

Machine Learning · Computer Science 2019-11-12 Joshua Hare

What are the functions of curiosity? What are the mechanisms of curiosity-driven learning? We approach these questions about the living using concepts and tools from machine learning and developmental robotics. We argue that…

Artificial Intelligence · Computer Science 2018-06-19 Pierre-Yves Oudeyer

Reinforcement learning has been shown to be highly successful at many challenging tasks. However, success heavily relies on well-shaped rewards. Intrinsically motivated RL attempts to remove this constraint by defining an intrinsic reward…

Machine Learning · Computer Science 2021-03-16 Rui Zhao , Yang Gao , Pieter Abbeel , Volker Tresp , Wei Xu

This paper investigates the use of intrinsic reward to guide exploration in multi-agent reinforcement learning. We discuss the challenges in applying intrinsic reward to multiple collaborative agents and demonstrate how unreliable reward…

Artificial Intelligence · Computer Science 2019-06-06 Wendelin Böhmer , Tabish Rashid , Shimon Whiteson

Animals exhibit an innate ability to learn regularities of the world through interaction. By performing experiments in their environment, they are able to discern the causal factors of variation and infer how they affect the world's…

Machine Learning · Computer Science 2021-08-10 Sumedh A. Sontakke , Arash Mehrjou , Laurent Itti , Bernhard Schölkopf

Recent curriculum reinforcement learning for large language models (LLMs) typically rely on difficulty-based annotations for data filtering and ordering. However, such methods suffer from local optimization, where continual training on…

Machine Learning · Computer Science 2025-10-01 Ming Yang , Xiaofan Li , Zhiyuan Ma , Dengliang Shi , Jintao Du , Yu Cheng , Weiguo Zheng

We propose a reinforcement learning agent to solve hard exploration games by learning a range of directed exploratory policies. We construct an episodic memory-based intrinsic reward using k-nearest neighbors over the agent's recent…

We propose a new method to probe the learning mechanism of Deep Neural Networks (DNN) by perturbing the system using Noise Injection Nodes (NINs). These nodes inject uncorrelated noise via additional optimizable weights to existing…

Machine Learning · Computer Science 2023-05-03 Noam Levi , Itay Bloch , Marat Freytsis , Tomer Volansky

Recent reinforcement learning algorithms, though achieving impressive results in various fields, suffer from brittle training effects such as regression in results and high sensitivity to initialization and parameters. We claim that some of…

Machine Learning · Computer Science 2019-05-27 Refael Vivanti , Talya D. Sohlberg-Baris , Shlomo Cohen , Orna Cohen

Recently there has been a proliferation of intrinsic motivation (IM) reward-shaping methods to learn in complex and sparse-reward environments. These methods can often inadvertently change the set of optimal policies in an environment,…

Machine Learning · Computer Science 2024-02-13 Grant C. Forbes , Nitish Gupta , Leonardo Villalobos-Arias , Colin M. Potts , Arnav Jhala , David L. Roberts

Reinforcement learners are agents that learn to pick actions that lead to high reward. Ideally, the value of a reinforcement learner's policy approaches optimality--where the optimal informed policy is the one which maximizes reward.…

Machine Learning · Computer Science 2021-05-27 Michael K. Cohen , Elliot Catt , Marcus Hutter

Maximum entropy (MaxEnt) RL maximizes a combination of the original task reward and an entropy reward. It is believed that the regularization imposed by entropy, on both policy improvement and policy evaluation, together contributes to good…

Machine Learning · Computer Science 2022-02-01 Haonan Yu , Haichao Zhang , Wei Xu

Curiosity-based reward schemes can present powerful exploration mechanisms which facilitate the discovery of solutions for complex, sparse or long-horizon tasks. However, as the agent learns to reach previously unexplored spaces and the…

Autonomous artificial agents must be able to learn behaviors in complex environments without humans to design tasks and rewards. Designing these functions for each environment is not feasible, thus, motivating the development of intrinsic…

Machine Learning · Computer Science 2025-02-20 Alana Santana , Paula P. Costa , Esther L. Colombini