English
Related papers

Related papers: Improving Computational Efficiency in Visual Reinf…

200 papers

Transformer has shown promising results in many sequence to sequence transformation tasks recently. It utilizes a number of feed-forward self-attention layers to replace the recurrent neural networks (RNN) in attention-based encoder decoder…

Computation and Language · Computer Science 2020-12-01 Pan Zhou , Ruchao Fan , Wei Chen , Jia Jia

In the field of reinforcement learning (RL), representation learning is a proven tool for complex image-based tasks, but is often overlooked for environments with low-level states, such as physical control problems. This paper introduces…

Machine Learning · Computer Science 2023-11-07 Scott Fujimoto , Wei-Di Chang , Edward J. Smith , Shixiang Shane Gu , Doina Precup , David Meger

Lack of performance when it comes to continual learning over non-stationary distributions of data remains a major challenge in scaling neural network learning to more human realistic settings. In this work we propose a new conceptualization…

Machine Learning · Computer Science 2019-05-06 Matthew Riemer , Ignacio Cases , Robert Ajemian , Miao Liu , Irina Rish , Yuhai Tu , Gerald Tesauro

Supervised deep convolutional neural networks (DCNNs) are currently one of the best computational models that can explain how the primate ventral visual stream solves object recognition. However, embodied cognition has not been considered…

Machine Learning · Computer Science 2021-06-21 Maytus Piriyajitakonkij , Sirawaj Itthipuripat , Theerawit Wilaiprasitporn , Nat Dilokthanakul

Reinforcement Learning (RL) is a semi-supervised learning paradigm which an agent learns by interacting with an environment. Deep learning in combination with RL provides an efficient method to learn how to interact with the environment is…

Sound · Computer Science 2022-03-30 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Björn W. Schuller , Jiajun Liu

Recently, reinforcement learning models have achieved great success, completing complex tasks such as mastering Go and other games with higher scores than human players. Many of these models collect considerable data on the tasks and…

Machine Learning · Computer Science 2019-07-19 Hanten Chang , Katsuya Futagami

Deep reinforcement learning, applied to vision-based problems like Atari games, maps pixels directly to actions; internally, the deep neural network bears the responsibility of both extracting useful information and making decisions based…

Machine Learning · Computer Science 2019-03-05 Giuseppe Cuccu , Julian Togelius , Philippe Cudre-Mauroux

Reservoir computing (RC), a particular form of recurrent neural network, is under explosive development due to its exceptional efficacy and high performance in reconstruction or/and prediction of complex physical systems. However, the…

Machine Learning · Computer Science 2023-05-10 Xing-Yue Duan , Xiong Ying , Si-Yang Leng , Jürgen Kurths , Wei Lin , Huan-Fei Ma

Although well-established in general reinforcement learning (RL), value-based methods are rarely explored in constrained RL (CRL) for their incapability of finding policies that can randomize among multiple actions. To apply value-based…

Machine Learning · Computer Science 2022-06-28 Tianchi Cai , Wenpeng Zhang , Lihong Gu , Xiaodong Zeng , Jinjie Gu

State of the art deep reinforcement learning algorithms are sample inefficient due to the large number of episodes they require to achieve asymptotic performance. Episodic Reinforcement Learning (ERL) algorithms, inspired by the mammalian…

Machine Learning · Computer Science 2024-06-07 Ismael T. Freire , Adrián F. Amil , Paul F. M. J. Verschure

Experience replay serves as a key component in the success of online reinforcement learning (RL). Prioritized experience replay (PER) reweights experiences by the temporal difference (TD) error empirically enhancing the performance.…

Machine Learning · Computer Science 2024-09-20 Changling Li , Zhang-Wei Hong , Pulkit Agrawal , Divyansh Garg , Joni Pajarinen

Dense retrievers encode queries and documents and map them in an embedding space using pre-trained language models. These embeddings need to be high-dimensional to fit training signals and guarantee the retrieval effectiveness of dense…

Information Retrieval · Computer Science 2022-10-25 Zhenghao Liu , Han Zhang , Chenyan Xiong , Zhiyuan Liu , Yu Gu , Xiaohua Li

Humans excel at lifelong learning, as the brain has evolved to be robust to distribution shifts and noise in our ever-changing environment. Deep neural networks (DNNs), however, exhibit catastrophic forgetting and the learned…

Machine Learning · Computer Science 2023-02-23 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

In recent years, significant progress has been made in the field of robotic reinforcement learning (RL), enabling methods that handle complex image observations, train in the real world, and incorporate auxiliary data, such as…

Multi-Agent Experience Replay (MER) is a key component of off-policy reinforcement learning~(RL) algorithms. By remembering and reusing experiences from the past, experience replay significantly improves the stability of RL algorithms and…

Multiagent Systems · Computer Science 2023-06-02 Kailash Gogineni , Yongsheng Mei , Peng Wei , Tian Lan , Guru Venkataramani

Implicit neural representations (INRs) such as NeRF and SIREN encode a signal in neural network parameters and show excellent results for signal reconstruction. Using INRs for downstream tasks, such as classification, is however not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Alexander Gielisse , Jan van Gemert

Recent advancements in Model-Based Reinforcement Learning (MBRL) have made it a powerful tool for visual control tasks. Despite improved data efficiency, it remains challenging to train MBRL agents with generalizable perception. Training in…

Machine Learning · Computer Science 2024-10-15 Kyungmin Kim , JB Lanier , Pierre Baldi , Charless Fowlkes , Roy Fox

While Experience Replay - the practice of storing rollouts and reusing them multiple times during training - is a foundational technique in general RL, it remains largely unexplored in LLM post-training due to the prevailing belief that…

Machine Learning · Computer Science 2026-04-13 Charles Arnal , Vivien Cabannes , Taco Cohen , Julia Kempe , Remi Munos

Reinforcement learning algorithms can acquire policies for complex tasks autonomously. However, the number of samples required to learn a diverse set of skills can be prohibitively large. While meta-reinforcement learning methods have…

Machine Learning · Computer Science 2020-06-17 Russell Mendonca , Xinyang Geng , Chelsea Finn , Sergey Levine

Task-free online continual learning aims to alleviate catastrophic forgetting of the learner on a non-iid data stream. Experience Replay (ER) is a SOTA continual learning method, which is broadly used as the backbone algorithm for other…

Machine Learning · Computer Science 2021-08-24 Zhiyi Chen , Tong Lin