English
Related papers

Related papers: Leveraging Pre-trained Language Models for Time In…

200 papers

Existing pre-trained models for knowledge-graph-to-text (KG-to-text) generation simply fine-tune text-to-text pre-trained models such as BART or T5 on KG-to-text datasets, which largely ignore the graph structure during encoding and lack…

Computation and Language · Computer Science 2021-06-22 Pei Ke , Haozhe Ji , Yu Ran , Xin Cui , Liwei Wang , Linfeng Song , Xiaoyan Zhu , Minlie Huang

Graph-structured data plays a vital role in numerous domains, such as social networks, citation networks, commonsense reasoning graphs and knowledge graphs. While graph neural networks have been employed for graph processing, recent…

Computation and Language · Computer Science 2026-05-19 Wooyoung Kim , Byungyoon Park , Wooju Kim

Temporal Knowledge Graph Question Answering (TKGQA) aims to answer time-sensitive questions by leveraging factual information from Temporal Knowledge Graphs (TKGs). While previous studies have employed pre-trained TKG embeddings or graph…

Computation and Language · Computer Science 2025-11-07 Xinying Qian , Ying Zhang , Yu Zhao , Baohang Zhou , Xuhui Sui , Xiaojie Yuan

Temporal Graph Neural Networks (TGNNs) aim to capture the evolving structure and timing of interactions in dynamic graphs. Although many models incorporate time through encodings or architectural design, they often compute attention over…

Machine Learning · Computer Science 2026-02-03 Govind Waghmare , Srini Rohan Gujulla Leel , Nikhil Tumbde , Sumedh B G , Sonia Gupta , Srikanta Bedathur

Large Language Models (LLMs) have achieved impressive reasoning abilities, but struggle with temporal understanding, especially when questions involve multiple entities, compound operators, and evolving event sequences. Temporal Knowledge…

Computation and Language · Computer Science 2026-02-24 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Liming Zhu , Wenjie Zhang

Temporal Knowledge Graph (TKG) is an extension of traditional Knowledge Graph (KG) that incorporates the dimension of time. Reasoning on TKGs is a crucial task that aims to predict future facts based on historical occurrences. The key…

Artificial Intelligence · Computer Science 2024-01-26 Hao Dong , Pengyang Wang , Meng Xiao , Zhiyuan Ning , Pengfei Wang , Yuanchun Zhou

Multimodal knowledge graph completion (MMKGC) aims to predict missing links in multimodal knowledge graphs (MMKGs) by leveraging information from various modalities alongside structural data. Existing MMKGC approaches primarily extend…

Computation and Language · Computer Science 2025-09-16 Haodi Ma , Dzmitry Kasinets , Daisy Zhe Wang

Compared with static knowledge graphs, temporal knowledge graphs (tKG), which can capture the evolution and change of information over time, are more realistic and general. However, due to the complexity that the notion of time introduces…

Computation and Language · Computer Science 2025-04-07 Siheng Xiong , Yuan Yang , Faramarz Fekri , James Clayton Kerce

Injecting textual information into knowledge graph (KG) entity representations has been a worthwhile expedition in terms of improving performance in KG oriented tasks within the NLP community. External knowledge often adopted to enhance KG…

Computation and Language · Computer Science 2023-10-26 Micheal Abaho , Yousef H. Alfaifi

Reasoning in a temporal knowledge graph (TKG) is a critical task for information retrieval and semantic search. It is particularly challenging when the TKG is updated frequently. The model has to adapt to changes in the TKG for efficient…

Artificial Intelligence · Computer Science 2021-05-11 Jiapeng Wu , Yishi Xu , Yingxue Zhang , Chen Ma , Mark Coates , Jackie Chi Kit Cheung

Temporal knowledge graph question answering (TKGQA) aims to answer time-sensitive questions by leveraging temporal knowledge bases. While Large Language Models (LLMs) demonstrate significant potential in TKGQA, current prompting strategies…

Artificial Intelligence · Computer Science 2026-02-10 Zihao Jiang , Miao Peng , Zhenyan Shan , Wenjie Xu , Ben Liu , Gong Chen , Ziqi Gao , Min Peng

Multilingual knowledge graph (KG) embeddings provide latent semantic representations of entities and structured knowledge with cross-lingual inferences, which benefit various knowledge-driven cross-lingual NLP tasks. However, precisely…

Artificial Intelligence · Computer Science 2018-06-19 Muhao Chen , Yingtao Tian , Kai-Wei Chang , Steven Skiena , Carlo Zaniolo

Temporal Knowledge Graph Question Answering (TKGQA) aims to answer questions with temporal intent over Temporal Knowledge Graphs (TKGs). The core challenge of this task lies in understanding the complex semantic information regarding…

Computation and Language · Computer Science 2024-04-03 Zhuo Chen , Zhao Zhang , Zixuan Li , Fei Wang , Yutao Zeng , Xiaolong Jin , Yongjun Xu

Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a general method to…

Computation and Language · Computer Science 2019-11-01 Matthew E. Peters , Mark Neumann , Robert L. Logan , Roy Schwartz , Vidur Joshi , Sameer Singh , Noah A. Smith

Knowledge Graphs (KGs) structure real-world entities and their relationships into triples, enhancing machine reasoning for various tasks. While domain-specific KGs offer substantial benefits, their manual construction is often inefficient…

Computation and Language · Computer Science 2025-06-02 Jiaqi Sun , Shiyou Qian , Zhangchi Han , Wei Li , Zelin Qian , Dingyu Yang , Jian Cao , Guangtao Xue

Temporal knowledge graph completion (TKGC) has become a popular approach for reasoning over the event and temporal knowledge graphs, targeting the completion of knowledge with accurate but missing information. In this context, tensor…

Machine Learning · Computer Science 2022-04-12 Ioannis Dikeoulias , Saadullah Amin , Günter Neumann

Knowledge Graphs (KGs) are foundational structures in many AI applications, representing entities and their interrelations through triples. However, triple-based KGs lack the contextual information of relational knowledge, like temporal…

Artificial Intelligence · Computer Science 2024-07-01 Chengjin Xu , Muzhi Li , Cehao Yang , Xuhui Jiang , Lumingyuan Tang , Yiyan Qi , Jian Guo

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on…

Computation and Language · Computer Science 2025-09-03 Yu Liu , Yanan Cao , Xixun Lin , Yanmin Shang , Shi Wang , Shirui Pan

Autoregressive large language models (LLMs) pre-trained by next token prediction are inherently proficient in generative tasks. However, their performance on knowledge-driven tasks such as factual knowledge querying remains unsatisfactory.…

Computation and Language · Computer Science 2026-01-14 Peng Yu , Cheng Deng , Beiya Dai , Xinbing Wang , Ying Wen

Knowledge Graph (KG) embedding has attracted more attention in recent years. Most KG embedding models learn from time-unaware triples. However, the inclusion of temporal information beside triples would further improve the performance of a…

Machine Learning · Computer Science 2020-10-29 Chengjin Xu , Mojtaba Nayyeri , Fouad Alkhoury , Hamed Shariat Yazdi , Jens Lehmann