English
Related papers

Related papers: Pre-trained Language Model with Prompts for Tempor…

200 papers

Pretrained language models (PLMs) have made remarkable progress in text generation tasks via fine-tuning. While, it is challenging to fine-tune PLMs in a data-scarce situation. Therefore, it is non-trivial to develop a general and…

Computation and Language · Computer Science 2022-05-17 Junyi Li , Tianyi Tang , Jian-Yun Nie , Ji-Rong Wen , Wayne Xin Zhao

Predicting missing facts for temporal knowledge graphs (TKGs) is a fundamental task, called temporal knowledge graph completion (TKGC). One key challenge in this task is the imbalance in data distribution, where facts are unevenly spread…

Machine Learning · Computer Science 2025-01-03 Jiasheng Zhang , Deqiang Ouyang , Shuang Liang , Jie Shao

Temporal Knowledge Graph (TKG) is an efficient method for describing the dynamic development of facts along a timeline. Most research on TKG reasoning (TKGR) focuses on modelling the repetition of global facts and designing patterns of…

Artificial Intelligence · Computer Science 2025-07-03 Yuehang Si , Zefan Zeng , Jincai Huang , Qing Cheng

Temporal Knowledge Graphs (TKGs) incorporate temporal information to reflect the dynamic structural knowledge and evolutionary patterns of real-world facts. Nevertheless, TKGs are still limited in downstream applications due to the problem…

Machine Learning · Computer Science 2024-08-29 Jinchuan Zhang , Tianqi Wan , Chong Mu , Guangxi Lu , Ling Tian

Temporal Interaction Graphs (TIGs) are widely utilized to represent real-world systems. To facilitate representation learning on TIGs, researchers have proposed a series of TIG models. However, these models are still facing two tough gaps…

Artificial Intelligence · Computer Science 2024-03-07 Xi Chen , Siwei Zhang , Yun Xiong , Xixi Wu , Jiawei Zhang , Xiangguo Sun , Yao Zhang , Feng Zhao , Yulin Kang

The core of the Knowledge Graph Completion (KGC) task is to predict and complete the missing relations or nodes in a KG. Common KGC tasks are mostly about inferring unknown elements with one or two elements being known in a triple. In…

Computation and Language · Computer Science 2024-12-25 Yuan Yuan , Yajing Xu , Wen Zhang

Research on link prediction in knowledge graphs has mainly focused on static multi-relational data. In this work we consider temporal knowledge graphs where relations between entities may only hold for a time interval or a specific point in…

Artificial Intelligence · Computer Science 2018-09-11 Alberto García-Durán , Sebastijan Dumančić , Mathias Niepert

Knowledge graph-based dialogue systems can narrow down knowledge candidates for generating informative and diverse responses with the use of prior information, e.g., triple attributes or graph paths. However, most current knowledge graph…

Computation and Language · Computer Science 2020-04-21 Hongcai Xu , Junpeng Bao , Junqing Wang

Continual Graph Learning (CGL), which aims to accommodate new tasks over evolving graph data without forgetting prior knowledge, is garnering significant research interest. Mainstream solutions adopt the memory replay-based idea, ie,…

Machine Learning · Computer Science 2025-02-11 Qi Wang , Tianfei Zhou , Ye Yuan , Rui Mao

Reasoning in a temporal knowledge graph (TKG) is a critical task for information retrieval and semantic search. It is particularly challenging when the TKG is updated frequently. The model has to adapt to changes in the TKG for efficient…

Artificial Intelligence · Computer Science 2021-05-11 Jiapeng Wu , Yishi Xu , Yingxue Zhang , Chen Ma , Mark Coates , Jackie Chi Kit Cheung

Knowledge Graphs (KGs) have been applied to many tasks including Web search, link prediction, recommendation, natural language processing, and entity linking. However, most KGs are far from complete and are growing at a rapid pace. To…

Artificial Intelligence · Computer Science 2017-11-10 Baoxu Shi , Tim Weninger

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Recent improvements in KG-to-text generation are due to additional auxiliary pre-training tasks designed to give the fine-tune task a boost in performance. These tasks require extensive computational resources while only suggesting marginal…

Computation and Language · Computer Science 2023-05-19 Anthony Colas , Mehrdad Alvandipour , Daisy Zhe Wang

While Knowledge Graph Completion (KGC) on static facts is a matured field, Temporal Knowledge Graph Completion (TKGC), that incorporates validity time into static facts is still in its nascent stage. The KGC methods fall into multiple…

Artificial Intelligence · Computer Science 2023-05-22 Ishaan Singh , Navdeep Kaur , Garima Gaur , Mausam

The `pre-train, prompt, predict' paradigm of large language models (LLMs) has achieved remarkable success in open-domain question answering (OD-QA). However, few works explore this paradigm in the scenario of multi-document question…

Computation and Language · Computer Science 2023-12-27 Yu Wang , Nedim Lipka , Ryan A. Rossi , Alexa Siu , Ruiyi Zhang , Tyler Derr

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on…

Computation and Language · Computer Science 2025-09-03 Yu Liu , Yanan Cao , Xixun Lin , Yanmin Shang , Shi Wang , Shirui Pan

The rapid advancements in large language models (LLMs) have ignited interest in the temporal knowledge graph (tKG) domain, where conventional embedding-based and rule-based methods dominate. The question remains open of whether pre-trained…

Computation and Language · Computer Science 2024-04-18 Ruotong Liao , Xu Jia , Yangzhe Li , Yunpu Ma , Volker Tresp

Temporal Knowledge Graph (TKG) is an extension of traditional Knowledge Graph (KG) that incorporates the dimension of time. Reasoning on TKGs is a crucial task that aims to predict future facts based on historical occurrences. The key…

Artificial Intelligence · Computer Science 2024-01-26 Hao Dong , Pengyang Wang , Meng Xiao , Zhiyuan Ning , Pengfei Wang , Yuanchun Zhou

Graph-to-text generation aims to generate fluent texts from graph-based data. In this paper, we investigate two recently proposed pretrained language models (PLMs) and analyze the impact of different task-adaptive pretraining strategies for…

Computation and Language · Computer Science 2021-09-28 Leonardo F. R. Ribeiro , Martin Schmitt , Hinrich Schütze , Iryna Gurevych