English
Related papers

Related papers: History Repeats: Overcoming Catastrophic Forgettin…

200 papers

A temporal knowledge graph (TKG) stores the events derived from the data involving time. Predicting events is extremely challenging due to the time-sensitive property of events. Besides, the previous TKG completion (TKGC) approaches cannot…

Artificial Intelligence · Computer Science 2023-05-16 Guanglin Niu , Bo Li

How can we perform knowledge reasoning over temporal knowledge graphs (TKGs)? TKGs represent facts about entities and their relations, where each fact is associated with a timestamp. Reasoning over TKGs, i.e., inferring new facts from…

Machine Learning · Computer Science 2022-02-17 Namyong Park , Fuchen Liu , Purvanshi Mehta , Dana Cristofor , Christos Faloutsos , Yuxiao Dong

Temporal knowledge graphs (TKGs) inherently reflect the transient nature of real-world knowledge, as opposed to static knowledge graphs. Naturally, automatic TKG completion has drawn much research interests for a more realistic modeling of…

Machine Learning · Computer Science 2020-12-22 Jaehun Jung , Jinhong Jung , U Kang

Temporal Knowledge Graph Completion (TKGC) under the extrapolation setting aims to predict the missing entity from a fact in the future, posing a challenge that aligns more closely with real-world prediction problems. Existing research…

Computation and Language · Computer Science 2023-10-25 Kunze Wang , Soyeon Caren Han , Josiah Poon

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

Machine Learning · Computer Science 2022-12-29 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Temporal knowledge graph completion (TKGC) aims to fill in missing facts within a given temporal knowledge graph at a specific time. Existing methods, operating in real or complex spaces, have demonstrated promising performance in this…

Machine Learning · Computer Science 2024-03-06 Li Cai , Xin Mao , Zhihong Wang , Shangqing Zhao , Yuhao Zhou , Changxu Wu , Man Lan

Deep generative replay has emerged as a promising approach for continual learning in decision-making tasks. This approach addresses the problem of catastrophic forgetting by leveraging the generation of trajectories from previously…

Machine Learning · Computer Science 2024-06-18 William Yue , Bo Liu , Peter Stone

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

Catastrophic forgetting refers to the tendency that a neural network "forgets" the previous learned knowledge upon learning new tasks. Prior methods have been focused on overcoming this problem on convolutional neural networks (CNNs), where…

Machine Learning · Computer Science 2020-12-14 Huihui Liu , Yiding Yang , Xinchao Wang

Continual Graph Learning (CGL) enables models to incrementally learn from streaming graph-structured data without forgetting previously acquired knowledge. Experience replay is a common solution that reuses a subset of past samples during…

Machine Learning · Computer Science 2026-03-31 Qiao Yuan , Sheng-Uei Guan , Pin Ni , Tianlun Luo , Ka Lok Man , Prudence Wong , Victor Chang

Temporal Knowledge Graphs (TKGs) incorporate temporal information to reflect the dynamic structural knowledge and evolutionary patterns of real-world facts. Nevertheless, TKGs are still limited in downstream applications due to the problem…

Machine Learning · Computer Science 2024-08-29 Jinchuan Zhang , Tianqi Wan , Chong Mu , Guangxi Lu , Ling Tian

Catastrophic forgetting describes the fact that machine learning models will likely forget the knowledge of previously learned tasks after the learning process of a new one. It is a vital problem in the continual learning scenario and…

Machine Learning · Computer Science 2022-05-25 Wenjie Jiang , Zhide Lu , Dong-Ling Deng

Continual learning in computer vision faces the critical challenge of catastrophic forgetting, where models struggle to retain prior knowledge while adapting to new tasks. Although recent studies have attempted to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xusheng Cao , Haori Lu , Linlan Huang , Fei Yang , Xialei Liu , Ming-Ming Cheng

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

Machine Learning · Statistics 2021-08-06 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Temporal knowledge graphs (TKGs) model the temporal evolution of events and have recently attracted increasing attention. Since TKGs are intrinsically incomplete, it is necessary to reason out missing elements. Although existing TKG…

Artificial Intelligence · Computer Science 2023-04-11 Shangfei Zheng , Hongzhi Yin , Tong Chen , Quoc Viet Hung Nguyen , Wei Chen , Lei Zhao

Temporal Knowledge Graphs (TKGs) store temporal facts with quadruple formats (s, p, o, t). Existing Temporal Knowledge Graph Embedding (TKGE) models perform link prediction tasks in transductive or semi-inductive settings, which means the…

Artificial Intelligence · Computer Science 2025-06-10 Jiaxin Pan , Mojtaba Nayyeri , Osama Mohammed , Daniel Hernandez , Rongchuan Zhang , Cheng Cheng , Steffen Staab

Temporal Knowledge Graph (TKG) reasoning focuses on predicting events through historical information within snapshots distributed on a timeline. Existing studies mainly concentrate on two perspectives of leveraging the history of TKGs,…

Machine Learning · Computer Science 2025-05-28 Jinchuan Zhang , Ming Sun , Chong Mu , Jinhao Zhang , Quanjiang Guo , Ling Tian

Deep learning models generally display catastrophic forgetting when learning new data continuously. Many incremental learning approaches address this problem by reusing data from previous tasks while learning new tasks. However, the direct…

Machine Learning · Computer Science 2024-11-12 Young Jo Choi , Min Kyoon Yoo , Yu Rang Park

A Temporal Knowledge Graph (TKG) is a sequence of KGs with respective timestamps, which adopts quadruples in the form of (\emph{subject}, \emph{relation}, \emph{object}, \emph{timestamp}) to describe dynamic facts. TKG reasoning has…

Artificial Intelligence · Computer Science 2022-10-19 Zixuan Li , Zhongni Hou , Saiping Guan , Xiaolong Jin , Weihua Peng , Long Bai , Yajuan Lyu , Wei Li , Jiafeng Guo , Xueqi Cheng

Temporal characteristics are prominently evident in a substantial volume of knowledge, which underscores the pivotal role of Temporal Knowledge Graphs (TKGs) in both academia and industry. However, TKGs often suffer from incompleteness for…

Artificial Intelligence · Computer Science 2023-08-07 Jiapu Wang , Boyue Wang , Meikang Qiu , Shirui Pan , Bo Xiong , Heng Liu , Linhao Luo , Tengfei Liu , Yongli Hu , Baocai Yin , Wen Gao