English
Related papers

Related papers: Short-Term-to-Long-Term Memory Transfer for Knowle…

200 papers

Research on link prediction in knowledge graphs has mainly focused on static multi-relational data. In this work we consider temporal knowledge graphs where relations between entities may only hold for a time interval or a specific point in…

Artificial Intelligence · Computer Science 2018-09-11 Alberto García-Durán , Sebastijan Dumančić , Mathias Niepert

Tracing a student's knowledge growth given the past exercise answering is a vital objective in automatic tutoring systems to customize the learning experience. Yet, achieving this objective is a non-trivial task as it involves modeling the…

Computers and Society · Computer Science 2024-10-04 Seif Gad , Sherif Abdelfattah , Ghodai Abdelrahman

Knowledge graphs have garnered significant research attention and are widely used to enhance downstream applications. However, most current studies mainly focus on static knowledge graphs, whose facts do not change with time, and disregard…

Computation and Language · Computer Science 2024-03-11 Li Cai , Xin Mao , Yuhao Zhou , Zhaoguang Long , Changxu Wu , Man Lan

Memory-augmented neural networks consisting of a neural controller and an external memory have shown potentials in long-term sequential learning. Current RAM-like memory models maintain memory accessing every timesteps, thus they do not…

Machine Learning · Computer Science 2019-03-21 Hung Le , Truyen Tran , Svetha Venkatesh

An integral function of fully autonomous robots and humans is the ability to focus attention on a few relevant percepts to reach a certain goal while disregarding irrelevant percepts. Humans and animals rely on the interactions between the…

Artificial Intelligence · Computer Science 2020-04-24 Nibraas Khan , Joshua Phillips

An integral function of fully autonomous robots and humans is the ability to focus attention on a few relevant percepts to reach a certain goal while disregarding irrelevant percepts. Humans and animals rely on the interactions between the…

Artificial Intelligence · Computer Science 2020-04-21 Nibraas Khan , Joshua Phillips

Long short-term memory (LSTM) is a kind of recurrent neural networks (RNN) for sequence and temporal dependency data modeling and its effectiveness has been extensively established. In this work, we propose a hybrid quantum-classical model…

Quantum Physics · Physics 2020-09-04 Samuel Yen-Chi Chen , Shinjae Yoo , Yao-Lung L. Fang

In deep learning, transfer learning (TL) has become the de facto approach when dealing with image related tasks. Visual features learnt for one task have been shown to be reusable for other tasks, improving performance significantly. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Adrian Tormos , Dario Garcia-Gasulla , Victor Gimenez-Abalos , Sergio Alvarez-Napagao

In this paper, we introduce variational semantic memory into meta-learning to acquire long-term knowledge for few-shot learning. The variational semantic memory accrues and stores semantic information for the probabilistic inference of…

Machine Learning · Computer Science 2021-07-16 Xiantong Zhen , Yingjun Du , Huan Xiong , Qiang Qiu , Cees G. M. Snoek , Ling Shao

In this paper, we consider a transfer reinforcement learning problem involving agents with different action spaces. Specifically, for any new unseen task, the goal is to use a successful demonstration of this task by an expert agent in its…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yan Zhang , Zachary Bell , Scott Nivison , Michael M. Zavlanos

Temporal gates play a significant role in modern recurrent-based neural encoders, enabling fine-grained control over recursive compositional operations over time. In recurrent models such as the long short-term memory (LSTM), temporal gates…

Computation and Language · Computer Science 2017-11-22 Yi Tay , Luu Anh Tuan , Siu Cheung Hui

Effective decision-making in partially observable environments demands robust memory management. Despite their success in supervised learning, current deep-learning memory models struggle in reinforcement learning environments that are…

Machine Learning · Computer Science 2024-10-15 Hung Le , Kien Do , Dung Nguyen , Sunil Gupta , Svetha Venkatesh

Episodic memory plays a crucial role in various cognitive processes, such as the ability to mentally recall past events. While cognitive science emphasizes the significance of spatial context in the formation and retrieval of episodic…

Machine Learning · Computer Science 2024-03-04 Junmo Cho , Jaesik Yoon , Sungjin Ahn

Transfer learning has become the de facto standard in computer vision and natural language processing, especially where labeled data is scarce. Accuracy can be significantly improved by using pre-trained models and subsequent fine-tuning.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 T. S. Jayram , Vincent Marois , Tomasz Kornuta , Vincent Albouy , Emre Sevgen , Ahmet S. Ozcan

Existing knowledge graph (KG) embedding models have primarily focused on static KGs. However, real-world KGs do not remain static, but rather evolve and grow in tandem with the development of KG applications. Consequently, new facts and…

Computation and Language · Computer Science 2023-04-11 Yuanning Cui , Yuxin Wang , Zequn Sun , Wenqiang Liu , Yiqiao Jiang , Kexin Han , Wei Hu

Given the recent success of Deep Learning applied to a variety of single tasks, it is natural to consider more human-realistic settings. Perhaps the most difficult of these settings is that of continual lifelong learning, where the model…

Machine Learning · Computer Science 2018-12-21 Matthew Riemer , Tim Klinger , Djallel Bouneffouf , Michele Franceschini

Curriculum Learning emphasizes the order of training instances in a computational learning setup. The core hypothesis is that simpler instances should be learned early as building blocks to learn more complex ones. Despite its usefulness,…

Computation and Language · Computer Science 2016-11-21 Volkan Cirik , Eduard Hovy , Louis-Philippe Morency

Effective decision-making in the real world depends on memory that is both stable and adaptive: environments change over time, and agents must retain relevant information over long horizons while also updating or overwriting outdated…

Machine Learning · Computer Science 2026-01-22 Oleg Shchendrigin , Egor Cherepanov , Alexey K. Kovalev , Aleksandr I. Panov

In recent years, long short-term memory (LSTM) has been successfully used to model sequential data of variable length. However, LSTM can still experience difficulty in capturing long-term dependencies. In this work, we tried to alleviate…

Computation and Language · Computer Science 2018-11-12 Tao Gui , Qi Zhang , Lujun Zhao , Yaosong Lin , Minlong Peng , Jingjing Gong , Xuanjing Huang

The identification of sensory cues associated with potential opportunities and dangers is frequently complicated by unrelated events that separate useful cues by long delays. As a result, it remains a challenging task for state-of-the-art…

Neural and Evolutionary Computing · Computer Science 2023-07-17 Shimin Zhang , Qu Yang , Chenxiang Ma , Jibin Wu , Haizhou Li , Kay Chen Tan