English
Related papers

Related papers: Short-Term-to-Long-Term Memory Transfer for Knowle…

200 papers

In lifelong learning, data are used to improve performance not only on the present task, but also on past and future (unencountered) tasks. While typical transfer learning algorithms can improve performance on future tasks, their…

One of the goals of neuro-symbolic artificial intelligence is to exploit background knowledge to improve the performance of learning tasks. However, most of the existing frameworks focus on the simplified scenario where knowledge does not…

Artificial Intelligence · Computer Science 2025-05-09 Luca Salvatore Lorello , Marco Lippi , Stefano Melacci

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

Machine Learning · Statistics 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

Transferring high-level knowledge from a source task to a target task is an effective way to expedite reinforcement learning (RL). For example, propositional logic and first-order logic have been used as representations of such knowledge.…

Artificial Intelligence · Computer Science 2019-09-11 Zhe Xu , Ufuk Topcu

Evolutionary multitasking (EMT) algorithms typically require tailored designs for knowledge transfer, in order to assure convergence and optimality in multitask optimization. In this paper, we explore designing a systematic and…

Neural and Evolutionary Computing · Computer Science 2025-11-20 Jiajun Zhan , Zeyuan Ma , Yue-Jiao Gong , Kay Chen Tan

The long-term memory of most connectionist systems lies entirely in the weights of the system. Since the number of weights is typically fixed, this bounds the total amount of knowledge that can be learned and stored. Though this is not…

Artificial Intelligence · Computer Science 2016-10-21 Marc Pickett , Rami Al-Rfou , Louis Shao , Chris Tar

We investigate how agents built on pretrained large language models (LLMs) can learn target classification functions from labeled examples without parameter updates. While conventional approaches like fine-tuning are often costly,…

Computation and Language · Computer Science 2026-05-06 Jackson Hassell , Dan Zhang , Hannah Kim , Tom Mitchell , Estevam Hruschka

Temporal knowledge graph (TKG) reasoning is a crucial task that has gained increasing research interest in recent years. Most existing methods focus on reasoning at past timestamps to complete the missing facts, and there are only a few…

Machine Learning · Computer Science 2021-09-10 Haohai Sun , Jialun Zhong , Yunpu Ma , Zhen Han , Kun He

Memory is an essential element in people's daily life based on experience. So far, many studies have analyzed electroencephalogram (EEG) signals at encoding to predict later remembered items, but few studies have predicted long-term memory…

Neural and Evolutionary Computing · Computer Science 2020-12-08 Gi-Hwan Shin , Young-Seok Kweon , Minji Lee

Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improving the reasoning capabilities of LLM agents is to better…

Computation and Language · Computer Science 2025-11-12 Siyu Xia , Zekun Xu , Jiajun Chai , Wentian Fan , Yan Song , Xiaohan Wang , Guojun Yin , Wei Lin , Haifeng Zhang , Jun Wang

Transfer learning across different reinforcement learning (RL) tasks is becoming an increasingly valuable area of research. We consider a goal-based multi-task RL framework and mechanisms by which previously solved tasks can reduce sample…

Machine Learning · Computer Science 2019-07-02 Nick Denis

Long-term memory (LTM) is essential for large language models (LLMs) to achieve autonomous intelligence in complex, evolving environments. Despite increasing efforts in memory-augmented and retrieval-based architectures, there remains a…

Computation and Language · Computer Science 2025-06-17 Luanbo Wan , Weizhi Ma

We study transfer learning for estimation in latent variable network models. In our setting, the conditional edge probability matrices given the latent variables are represented by $P$ for the source and $Q$ for the target. We wish to…

Machine Learning · Computer Science 2024-06-07 Akhil Jalan , Arya Mazumdar , Soumendu Sundar Mukherjee , Purnamrita Sarkar

How much does a trained RL policy actually use its past observations? We propose \emph{Temporal Range}, a model-agnostic metric that treats first-order sensitivities of multiple vector outputs across a temporal window to the input sequence…

Machine Learning · Computer Science 2025-12-09 Rodney Lafuente-Mercado , Daniela Rus , T. Konstantin Rusch

The objective of transfer learning is to enhance estimation and inference in a target data by leveraging knowledge gained from additional sources. Recent studies have explored transfer learning for independent observations in complex,…

Machine Learning · Statistics 2025-04-23 Mingliang Ma Abolfazl Safikhani

Memory-based self-evolution has emerged as a promising paradigm for coding agents. However, existing approaches typically restrict memory utilization to homogeneous task domains, failing to leverage the shared infrastructural foundations,…

Artificial Intelligence · Computer Science 2026-04-16 Kangsan Kim , Minki Kang , Taeil Kim , Yanlai Yang , Mengye Ren , Sung Ju Hwang

One of the main motivations of studying continual learning is that the problem setting allows a model to accrue knowledge from past tasks to learn new tasks more efficiently. However, recent studies suggest that the key metric that…

Machine Learning · Computer Science 2023-03-16 Jiefeng Chen , Timothy Nguyen , Dilan Gorur , Arslan Chaudhry

Memory enables Large Language Model (LLM) agents to perceive, store, and use information from past dialogues, which is essential for personalization. However, existing methods fail to properly model the temporal dimension of memory in two…

Artificial Intelligence · Computer Science 2026-01-13 Miao Su , Yucan Guo , Zhongni Hou , Long Bai , Zixuan Li , Yufei Zhang , Guojun Yin , Wei Lin , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Reinforcement learning (RL) agents performing complex tasks must be able to remember observations and actions across sizable time intervals. This is especially true during the initial learning stages, when exploratory behaviour can increase…

Machine Learning · Computer Science 2018-05-15 Thomas Stepleton , Razvan Pascanu , Will Dabney , Siddhant M. Jayakumar , Hubert Soyer , Remi Munos

Neural word representations are at the core of many state-of-the-art natural language processing models. A widely used approach is to pre-train, store and look up word or character embedding matrices. While useful, such representations…

Computation and Language · Computer Science 2019-06-05 Chinnadhurai Sankar , Sujith Ravi , Zornitsa Kozareva