English
Related papers

Related papers: Influence-aware Memory Architectures for Deep Rein…

200 papers

Inspired by recent developments in attention models for image classification and natural language processing, we present various Attention based architectures in reinforcement learning (RL) domain, capable of performing well on OpenAI Gym…

Machine Learning · Computer Science 2023-10-06 Victor Vadakechirayath George

Machine unlearning aims to remove the influence of specific training data from a model without requiring full retraining. This capability is crucial for ensuring privacy, safety, and regulatory compliance. Therefore, verifying whether a…

Computation and Language · Computer Science 2025-11-07 Liran Cohen , Yaniv Nemcovesky , Avi Mendelson

Stack-augmented recurrent neural networks (RNNs) have been of interest to the deep learning community for some time. However, the difficulty of training memory models remains a problem obstructing the widespread use of such models. In this…

Machine Learning · Computer Science 2019-11-05 Yikang Shen , Shawn Tan , Arian Hosseini , Zhouhan Lin , Alessandro Sordoni , Aaron Courville

Due to growing privacy concerns, machine unlearning, which aims at enabling machine learning models to ``forget" specific training data, has received increasing attention. Among existing methods, influence-based unlearning has emerged as a…

Machine Learning · Computer Science 2025-08-01 Jiawei Liu , Chenwang Wu , Defu Lian , Enhong Chen

Many real-world datasets are time series that are sequentially collected and contain rich temporal information. Thus, a common interest in practice is to capture dynamics of time series and predict their future evolutions. To this end, the…

Machine Learning · Computer Science 2025-05-12 Yifan Zhou , Yibo Wang , Chao Shang

Using environmental sensory data can enhance communications beam training and reduce its overhead compared to conventional methods. However, the availability of fresh sensory data during inference may be limited due to sensing constraints…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Abolfazl Zakeri , Nhan Thanh Nguyen , Ahmed Alkhateeb , Markku Juntti

Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to…

Machine Learning · Computer Science 2021-12-09 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Andrea Banino , Felix Hill

Building and maintaining state to learn policies and value functions is critical for deploying reinforcement learning (RL) agents in the real world. Recurrent neural networks (RNNs) have become a key point of interest for the state-building…

Machine Learning · Computer Science 2026-05-19 Matthew Schlegel , Volodymyr Tkachuk , Adam White , Martha White

Artificial neural networks are promising for general function approximation but challenging to train on non-independent or non-identically distributed data due to catastrophic forgetting. The experience replay buffer, a standard component…

Machine Learning · Computer Science 2023-04-12 Qingfeng Lan , Yangchen Pan , Jun Luo , A. Rupam Mahmood

The Hierarchical Reasoning Model (HRM) has impressive reasoning abilities given its small size, but has only been applied to supervised, static, fully-observable problems. One of HRM's strengths is its ability to adapt its computational…

Artificial Intelligence · Computer Science 2025-10-28 Long H Dang , David Rawlinson

Tasks in which rewards depend upon past information not available in the current observation set can only be solved by agents that are equipped with short-term memory. Usual choices for memory modules include trainable recurrent hidden…

Machine Learning · Computer Science 2024-12-18 Kevin McKee

Maximizing influences in complex networks is a practically important but computationally challenging task for social network analysis, due to its NP- hard nature. Most current approximation or heuristic methods either require tremendous…

Social and Information Networks · Computer Science 2023-09-15 Changan Liu , Changjun Fan , Zhongzhi Zhang

In this paper, we study novel neural network structures to better model long term dependency in sequential data. We propose to use more memory units to keep track of more preceding states in recurrent neural networks (RNNs), which are all…

Neural and Evolutionary Computing · Computer Science 2016-05-03 Rohollah Soltani , Hui Jiang

Many important tasks are defined in terms of object. To generalize across these tasks, a reinforcement learning (RL) agent needs to exploit the structure that the objects induce. Prior work has either hard-coded object-centric features,…

Machine Learning · Computer Science 2023-11-06 Wilka Carvalho , Andrew Lampinen , Kyriacos Nikiforou , Felix Hill , Murray Shanahan

Deep neural networks (DNNs) have become powerful tools for modeling complex data structures through sequentially integrating simple functions in each hidden layer. In survival analysis, recent advances of DNNs primarily focus on enhancing…

Machine Learning · Statistics 2025-03-26 Changhui Yuan , Shishun Zhao , Shuwei Li , Xinyuan Song , Zhao Chen

Objective: To allow efficient learning using the Recurrent Inference Machine (RIM) for image reconstruction whereas not being strictly dependent on the training data distribution so that unseen modalities and pathologies are still…

Image and Video Processing · Electrical Eng. & Systems 2020-12-15 Dimitrios Karkalousos , Kai Lønning , Hanneke E. Hulst , Serge O. Dumoulin , Jan-Jakob Sonke , Frans M. Vos , Matthan W. A. Caan

How to obtain hierarchical representations with an increasing level of abstraction becomes one of the key issues of learning with deep neural networks. A variety of RNN models have recently been proposed to incorporate both explicit and…

Computation and Language · Computer Science 2022-01-25 Zhaoxin Luo , Michael Zhu

An effective way to achieve intelligence is to simulate various intelligent behaviors in the human brain. In recent years, bio-inspired learning methods have emerged, and they are different from the classical mathematical programming…

Artificial Intelligence · Computer Science 2019-04-01 Jieneng Chen , Jingye Chen , Ruiming Zhang , Xiaobin Hu

Artificial neural networks (ANNs) continue to face challenges in continual learning, particularly due to catastrophic forgetting, the loss of previously learned knowledge when acquiring new tasks. Inspired by memory consolidation in the…

Machine Learning · Computer Science 2025-09-03 Jina Kim

Deep reinforcement learning techniques have demonstrated superior performance in a wide variety of environments. As improvements in training algorithms continue at a brisk pace, theoretical or empirical studies on understanding what these…

Machine Learning · Computer Science 2018-11-16 Raghuram Mandyam Annasamy , Katia Sycara