English
Related papers

Related papers: Leveraging Pre-trained Language Models for Time In…

200 papers

Temporal Knowledge Graphs (TKGs) incorporate temporal information to reflect the dynamic structural knowledge and evolutionary patterns of real-world facts. Nevertheless, TKGs are still limited in downstream applications due to the problem…

Machine Learning · Computer Science 2024-08-29 Jinchuan Zhang , Tianqi Wan , Chong Mu , Guangxi Lu , Ling Tian

Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus…

Computation and Language · Computer Science 2024-10-29 Pengcheng Jiang , Lang Cao , Cao Xiao , Parminder Bhatia , Jimeng Sun , Jiawei Han

Knowledge graph completion (KGC) can predict missing links and is crucial for real-world knowledge graphs, which widely suffer from incompleteness. KGC methods assume a knowledge graph is static, but that may lead to inaccurate prediction…

Artificial Intelligence · Computer Science 2023-11-14 Borui Cai , Yong Xiang , Longxiang Gao , He Zhang , Yunfeng Li , Jianxin Li

Pre-trained language representation models (PLMs) cannot well capture factual knowledge from text. In contrast, knowledge embedding (KE) methods can effectively represent the relational facts in knowledge graphs (KGs) with informative…

Computation and Language · Computer Science 2020-11-24 Xiaozhi Wang , Tianyu Gao , Zhaocheng Zhu , Zhengyan Zhang , Zhiyuan Liu , Juanzi Li , Jian Tang

Pretrained Language Models (PLMs) such as BERT have revolutionized the landscape of Natural Language Processing (NLP). Inspired by their proliferation, tremendous efforts have been devoted to Pretrained Graph Models (PGMs). Owing to the…

Machine Learning · Computer Science 2022-03-22 Jun Xia , Yanqiao Zhu , Yuanqi Du , Stan Z. Li

Knowledge Graph (KG) reasoning that predicts missing facts for incomplete KGs has been widely explored. However, reasoning over Temporal KG (TKG) that predicts facts in the future is still far from resolved. The key to predict future facts…

Artificial Intelligence · Computer Science 2021-04-22 Zixuan Li , Xiaolong Jin , Wei Li , Saiping Guan , Jiafeng Guo , Huawei Shen , Yuanzhuo Wang , Xueqi Cheng

Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs) by making predictions for missing links. Description-based KGC leverages pre-trained language models to learn entity and relation…

Computation and Language · Computer Science 2024-03-05 Derong Xu , Ziheng Zhang , Zhenxi Lin , Xian Wu , Zhihong Zhu , Tong Xu , Xiangyu Zhao , Yefeng Zheng , Enhong Chen

Conventional embedding-based models approach event time prediction in temporal knowledge graphs (TKGs) as a ranking problem. However, they often fall short in capturing essential temporal relationships such as order and distance. In this…

Computation and Language · Computer Science 2024-01-30 Siheng Xiong , Yuan Yang , Ali Payani , James C Kerce , Faramarz Fekri

The task of multi-hop link prediction within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, as it requires the model to reason through and understand all intermediate connections before making a…

Computation and Language · Computer Science 2025-06-17 Dong Shu , Tianle Chen , Mingyu Jin , Chong Zhang , Mengnan Du , Yongfeng Zhang

Temporal Knowledge Graphs (TKGs) represent dynamic facts as timestamped relations between entities. TKG completion involves forecasting missing or future links, requiring models to reason over time-evolving structure. While LLMs show…

Machine Learning · Computer Science 2025-05-26 Ömer Faruk Akgül , Feiyu Zhu , Yuxin Yang , Rajgopal Kannan , Viktor Prasanna

Entity alignment (EA) aims to find entities in different knowledge graphs (KGs) that refer to the same object in the real world. Recent studies incorporate temporal information to augment the representations of KGs. The existing methods for…

Artificial Intelligence · Computer Science 2022-09-21 Li Cai , Xin Mao , Meirong Ma , Hao Yuan , Jianchao Zhu , Man Lan

Contextualized entity representations learned by state-of-the-art transformer-based language models (TLMs) like BERT, GPT, T5, etc., leverage the attention mechanism to learn the data context from training data corpus. However, these models…

Computation and Language · Computer Science 2021-09-06 Keyur Faldu , Amit Sheth , Prashant Kikani , Hemang Akbari

Entity alignment aims to identify equivalent entity pairs between different knowledge graphs (KGs). Recently, the availability of temporal KGs (TKGs) that contain time information created the need for reasoning over time in such TKGs.…

Artificial Intelligence · Computer Science 2022-03-15 Chengjin Xu , Fenglong Su , Jens Lehmann

Leveraging Large Language Models (LLMs) for Knowledge Graph Completion (KGC) is promising but hindered by a fundamental granularity mismatch. LLMs operate on fragmented token sequences, whereas entities are the fundamental units in…

Computation and Language · Computer Science 2026-02-27 Siyue Su , Jian Yang , Bo Li , Guanglin Niu

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel…

Machine Learning · Computer Science 2025-03-12 Shule Hao , Junpeng Bao , Chuncheng Lu

Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information…

Computation and Language · Computer Science 2020-10-05 Donghan Yu , Chenguang Zhu , Yiming Yang , Michael Zeng

KEPLMs are pre-trained models that utilize external knowledge to enhance language understanding. Previous language models facilitated knowledge acquisition by incorporating knowledge-related pre-training tasks learned from relation triples…

Computation and Language · Computer Science 2024-03-19 Junbing Yan , Chengyu Wang , Taolin Zhang , Xiaofeng He , Jun Huang , Longtao Huang , Hui Xue , Wei Zhang

Inferring missing facts in temporal knowledge graphs (TKGs) is a fundamental and challenging task. Previous works have approached this problem by augmenting methods for static knowledge graphs to leverage time-dependent representations.…

Machine Learning · Computer Science 2020-10-09 Jiapeng Wu , Meng Cao , Jackie Chi Kit Cheung , William L. Hamilton

Knowledge Graph (KG) can effectively integrate valuable information from massive data, and thus has been rapidly developed and widely used in many fields. Traditional KG construction methods rely on manual annotation, which often consumes a…

Computation and Language · Computer Science 2026-04-22 Qiubai Zhu , Qingwang Wang , Haibin Yuan , Wei Chen , Tao Shen

Modeling time-evolving knowledge graphs (KGs) has recently gained increasing interest. Here, graph representation learning has become the dominant paradigm for link prediction on temporal KGs. However, the embedding-based approaches largely…

Machine Learning · Computer Science 2021-04-02 Zhen Han , Peng Chen , Yunpu Ma , Volker Tresp