English
Related papers

Related papers: Dipping PLMs Sauce: Bridging Structure and Text fo…

200 papers

Knowledge-enhanced Pre-trained Language Model (PLM) has recently received significant attention, which aims to incorporate factual knowledge into PLMs. However, most existing methods modify the internal structures of fixed types of PLMs by…

Computation and Language · Computer Science 2022-10-18 Jianing Wang , Wenkang Huang , Qiuhui Shi , Hongbin Wang , Minghui Qiu , Xiang Li , Ming Gao

Commonsense question answering has demonstrated considerable potential across various applications like assistants and social robots. Although fully fine-tuned pre-trained Language Models(LM) have achieved remarkable performance in…

Computation and Language · Computer Science 2024-05-10 Ruiting Dai , Yuqiao Tan , Lisi Mo , Shuang Liang , Guohao Huo , Jiayi Luo , Yao Cheng

Knowledge Graphs (KGs) provide a structured representation of knowledge but often suffer from challenges of incompleteness. To address this, link prediction or knowledge graph completion (KGC) aims to infer missing new facts based on…

Machine Learning · Computer Science 2025-01-03 Wenkai Tu , Guojia Wan , Zhengchun Shang , Bo Du

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate…

Computation and Language · Computer Science 2024-06-13 Yihao Li , Ru Zhang , Jianyi Liu

Temporal Knowledge Graphs (TKGs) represent dynamic facts as timestamped relations between entities. TKG completion involves forecasting missing or future links, requiring models to reason over time-evolving structure. While LLMs show…

Machine Learning · Computer Science 2025-05-26 Ömer Faruk Akgül , Feiyu Zhu , Yuxin Yang , Rajgopal Kannan , Viktor Prasanna

Large Language Models (LLMs) have been extensively adopted in Knowledge Graph Completion (KGC), showcasing significant research advancements. However, as black-box models driven by deep neural architectures, current LLM-based KGC methods…

Computation and Language · Computer Science 2025-10-22 Wenbin Guo , Xin Wang , Jiaoyan Chen , Zhao Li , Zirui Chen

Knowledge Graph Completion (KGC) aims at automatically predicting missing links for large-scale knowledge graphs. A vast number of state-of-the-art KGC techniques have got published at top conferences in several research fields, including…

Computation and Language · Computer Science 2020-07-10 Zhiqing Sun , Shikhar Vashishth , Soumya Sanyal , Partha Talukdar , Yiming Yang

Autoregressive large language models (LLMs) pre-trained by next token prediction are inherently proficient in generative tasks. However, their performance on knowledge-driven tasks such as factual knowledge querying remains unsatisfactory.…

Computation and Language · Computer Science 2026-01-14 Peng Yu , Cheng Deng , Beiya Dai , Xinbing Wang , Ying Wen

Knowledge Graph-based recommendations have gained significant attention due to their ability to leverage rich semantic relationships. However, constructing and maintaining Knowledge Graphs (KGs) is resource-intensive, and the accuracy of…

Information Retrieval · Computer Science 2025-02-07 Rui Cai , Chao Wang , Qianyi Cai , Dazhong Shen , Hui Xiong

Large Language Models (LLMs) have shown impressive performance in various tasks, including knowledge graph completion (KGC). However, current studies mostly apply LLMs to classification tasks, like identifying missing triplets, rather than…

Artificial Intelligence · Computer Science 2025-01-07 Zaiyi Zheng , Yushun Dong , Song Wang , Haochen Liu , Qi Wang , Jundong Li

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Zhao Li , Xiao Ding , Xindong Wu

In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information. This makes them attractive for systems that supplement or ground the knowledge found in pre-trained language…

Computation and Language · Computer Science 2023-06-06 Sondre Wold , Lilja Øvrelid , Erik Velldal

Pre-trained Language Models (PTLMs) have been shown to perform well on natural language tasks. Many prior works have leveraged structured commonsense present in the form of entities linked through labeled relations in Knowledge Graphs (KGs)…

Computation and Language · Computer Science 2022-06-20 Rachit Bansal , Milan Aggarwal , Sumit Bhatia , Jivat Neet Kaur , Balaji Krishnamurthy

Knowledge graphs (KGs) are valuable for representing structured, interconnected information across domains, enabling tasks like semantic search, recommendation systems and inference. A pertinent challenge with KGs, however, is that many…

Computation and Language · Computer Science 2024-12-17 Haji Gul , Abdul Ghani Naim , Ajaz A. Bhat

Large Language Models (LLMs) have shown remarkable capabilities across various tasks but remain prone to hallucinations in knowledge-intensive scenarios. Knowledge Base Question Answering (KBQA) mitigates this by grounding generation in…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Xixi Wang , Yinan Yu

Knowledge Graph Completion (KGC) attempts to predict missing facts in a Knowledge Graph (KG). Recently, there's been an increased focus on designing KGC methods that can excel in the inductive setting, where a portion or all of the entities…

Artificial Intelligence · Computer Science 2025-06-26 Harry Shomer , Jay Revolinsky , Jiliang Tang

In the era of personalized education, the provision of comprehensible explanations for learning recommendations is of a great value to enhance the learner's understanding and engagement with the recommended learning content. Large language…

Artificial Intelligence · Computer Science 2025-01-23 Hasan Abu-Rasheed , Christian Weber , Madjid Fathi

In natural language processing (NLP) and computer vision (CV), the successful application of foundation models across diverse tasks has demonstrated their remarkable potential. However, despite the rich structural and textual information…

Computation and Language · Computer Science 2025-05-29 Yin Hua , Zhiqiang Liu , Mingyang Chen , Zheng Fang , Chi Man Wong , Lingxiao Li , Chi Man Vong , Huajun Chen , Wen Zhang

Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce system performance by providing structured information about entities and their relationships, such as complementary or substitutable relations between products or product…

Information Retrieval · Computer Science 2023-05-18 Jiao Chen , Luyi Ma , Xiaohan Li , Nikhil Thakurdesai , Jianpeng Xu , Jason H. D. Cho , Kaushiki Nag , Evren Korpeoglu , Sushant Kumar , Kannan Achan

The mission of open knowledge graph (KG) completion is to draw new findings from known facts. Existing works that augment KG completion require either (1) factual triples to enlarge the graph reasoning space or (2) manually designed prompts…

Computation and Language · Computer Science 2023-05-26 Pengcheng Jiang , Shivam Agarwal , Bowen Jin , Xuan Wang , Jimeng Sun , Jiawei Han