中文
相关论文

相关论文: Memory-Efficient Episodic Control Reinforcement Le…

200 篇论文

We present a novel deep neural network architecture for representing robot experiences in an episodic-like memory which facilitates encoding, recalling, and predicting action experiences. Our proposed unsupervised deep episodic memory model…

人工智能 · 计算机科学 2018-07-17 Jonas Rothfuss , Fabio Ferreira , Eren Erdal Aksoy , You Zhou , Tamim Asfour

A fundamental challenge in continual learning is to balance the trade-off between learning new tasks and remembering the previously acquired knowledge. Gradient Episodic Memory (GEM) achieves this balance by utilizing a subset of past…

机器学习 · 计算机科学 2024-10-02 Bo Liu , Mao Ye , Peter Stone , Qiang Liu

We propose a novel Stochastic Model Predictive Control (MPC) for uncertain linear systems subject to probabilistic constraints. The proposed approach leverages offline learning to extract key features of affine disturbance feedback…

系统与控制 · 电气工程与系统科学 2024-11-22 Hotae Lee , Francesco Borrelli

Inspired by the cognitive science theory of the explicit human memory systems, we have modeled an agent with short-term, episodic, and semantic memory systems, each of which is modeled with a knowledge graph. To evaluate this system and…

人工智能 · 计算机科学 2026-05-19 Taewoon Kim , Michael Cochez , Vincent François-Lavet , Mark Neerincx , Piek Vossen

This paper considers e-coaching at times of pandemic. It utilizes the Emergency Management Cycle (EMC), a core doctrine for managing disasters. The EMC dimensions provide a useful taxonomical view for the development and application of…

信号处理 · 电气工程与系统科学 2021-05-25 Kenneth Lai , Svetlana Yanushkevich , Vlad Shmerko

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

机器学习 · 计算机科学 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Reinforcement learning in partially observed Markov decision processes (POMDPs) faces two challenges. (i) It often takes the full history to predict the future, which induces a sample complexity that scales exponentially with the horizon.…

机器学习 · 计算机科学 2024-04-02 Lingxiao Wang , Qi Cai , Zhuoran Yang , Zhaoran Wang

Deep reinforcement learning (RL) methods have significant potential for dialogue policy optimisation. However, they suffer from a poor performance in the early stages of learning. This is especially problematic for on-line learning with…

计算与语言 · 计算机科学 2017-07-06 Pei-Hao Su , Pawel Budzianowski , Stefan Ultes , Milica Gasic , Steve Young

Transformers face a quadratic bottleneck in attention when scaling to long contexts. Recent approaches introduce recurrent memory to extend context beyond the current window, yet these often face a fundamental trade-off between theoretical…

机器学习 · 计算机科学 2026-02-13 Yunchong Song , Jushi Kai , Liming Lu , Kaixi Qiu , Zhouhan Lin

Model-based next state prediction and state value prediction are slow to converge. To address these challenges, we do the following: i) Instead of a neural network, we do model-based planning using a parallel memory retrieval system (which…

人工智能 · 计算机科学 2023-02-02 John Chong Min Tan , Mehul Motani

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

计算与语言 · 计算机科学 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

Existing literature in Continual Learning (CL) has focused on overcoming catastrophic forgetting, the inability of the learner to recall how to perform tasks observed in the past. There are however other desirable properties of a CL system,…

机器学习 · 计算机科学 2021-02-15 Tom Veniat , Ludovic Denoyer , Marc'Aurelio Ranzato

We study online control for continuous-time linear systems with finite sampling rates, where the objective is to design an online procedure that learns under non-stochastic noise and performs comparably to a fixed optimal linear controller.…

最优化与控制 · 数学 2025-06-10 Jingwei Li , Jing Dong , Can Chang , Baoxiang Wang , Jingzhao Zhang

Clinical diagnosis guidelines aim at specifying the steps that may lead to a diagnosis. Inspired by guidelines, we aim to learn the optimal sequence of actions to perform in order to obtain a correct diagnosis from electronic health…

机器学习 · 计算机科学 2023-11-16 Lillian Muyama , Antoine Neuraz , Adrien Coulet

Research on large language models (LLMs) has shown remarkable performance in domains such as mathematics, programming, and literary creation. However, most studies have focused on semantic memory-based question answering, neglecting LLMs'…

计算与语言 · 计算机科学 2025-02-25 WenTao Liu , Ruohua Zhang , Aimin Zhou , Feng Gao , JiaLi Liu

Reinforcement learning for control over continuous spaces typically uses high-entropy stochastic policies, such as Gaussian distributions, for local exploration and estimating policy gradient to optimize performance. Many robotic control…

机器学习 · 计算机科学 2024-04-03 Ya-Chien Chang , Sicun Gao

In networked control systems, communication is a shared and therefore scarce resource. Event-triggered control (ETC) can achieve high performance control with a significantly reduced amount of samples compared to classical, periodic control…

系统与控制 · 计算机科学 2019-03-20 Dominik Baumann , Friedrich Solowjow , Karl Henrik Johansson , Sebastian Trimpe

Chemotherapy dose optimization can be formulated as a dynamic treatment regime, requiring sequential decisions under uncertainty that must balance tumor suppression against toxicity. However, most reinforcement learning approaches assume…

机器学习 · 计算机科学 2026-05-05 Firas Mohamed Elamine Kiram , Imane Youkana , Rachida Saouli , Gian Antonio Susto , Laid Kahloul

For the goal of strong artificial intelligence that can mimic human-level intelligence, AI systems would have the ability to adapt to ever-changing scenarios and learn new knowledge continuously without forgetting previously acquired…

量子物理 · 物理学 2025-11-18 Haozhen Situ , Tianxiang Lu , Minghua Pan , Lvzhou Li

Deep Reinforcement Learning (RL) involves the use of Deep Neural Networks (DNNs) to make sequential decisions in order to maximize reward. For many tasks the resulting sequence of actions produced by a Deep RL policy can be long and…

人工智能 · 计算机科学 2022-07-26 Sam Blakeman , Denis Mareschal