English
Related papers

Related papers: KELM: Knowledge Enhanced Pre-Trained Language Repr…

200 papers

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Large language models (LLMs) have made significant progress in general-purpose natural language processing tasks. However, LLMs are still facing challenges when applied to domain-specific areas like telecommunications, which demands…

Computation and Language · Computer Science 2025-05-22 Dun Yuan , Hao Zhou , Di Wu , Xue Liu , Hao Chen , Yan Xin , Jianzhong , Zhang

Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs), which describe facts in the form of triplets and allow…

Computation and Language · Computer Science 2024-10-11 Lingbing Guo , Zhongpu Bo , Zhuo Chen , Yichi Zhang , Jiaoyan Chen , Yarong Lan , Mengshu Sun , Zhiqiang Zhang , Yangyifei Luo , Qian Li , Qiang Zhang , Wen Zhang , Huajun Chen

Large pre-trained language models such as BERT have been the driving force behind recent improvements across many NLP tasks. However, BERT is only trained to predict missing words - either behind masks or in the next sentence - and has no…

Computation and Language · Computer Science 2020-10-26 Nicole Peinelt , Marek Rei , Maria Liakata

Recent work on enhancing BERT-based language representation models with knowledge graphs (KGs) and knowledge bases (KBs) has yielded promising results on multiple NLP tasks. State-of-the-art approaches typically integrate the original input…

Computation and Language · Computer Science 2022-10-21 Wei-Lin Liao , Cheng-En Su , Wei-Yun Ma

Recent advances in pretrained language models (PLMs) have significantly improved conversational recommender systems (CRS), enabling more fluent and context-aware interactions. To further enhance accuracy and mitigate hallucination, many…

Artificial Intelligence · Computer Science 2025-11-18 Yongwen Ren , Chao Wang , Peng Du , Chuan Qin , Dazhong Shen , Hui Xiong

Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce system performance by providing structured information about entities and their relationships, such as complementary or substitutable relations between products or product…

Information Retrieval · Computer Science 2023-05-18 Jiao Chen , Luyi Ma , Xiaohan Li , Nikhil Thakurdesai , Jianpeng Xu , Jason H. D. Cho , Kaushiki Nag , Evren Korpeoglu , Sushant Kumar , Kannan Achan

The use of knowledge graphs (KGs) enhances the accuracy and comprehensiveness of the responses provided by a conversational agent. While generating answers during conversations consists in generating text from these KGs, it is still…

Artificial Intelligence · Computer Science 2023-07-06 Hussam Ghanem , Massinissa Atmani , Christophe Cruz

Entities may have complex interactions in a knowledge graph (KG), such as multi-step relationships, which can be viewed as graph contextual information of the entities. Traditional knowledge representation learning (KRL) methods usually…

Computation and Language · Computer Science 2020-12-08 Bin He , Di Zhou , Jing Xie , Jinghui Xiao , Xin Jiang , Qun Liu

Embedding based Knowledge Graph (KG) Completion has gained much attention over the past few years. Most of the current algorithms consider a KG as a multidirectional labeled graph and lack the ability to capture the semantics underlying the…

Artificial Intelligence · Computer Science 2024-07-12 Mehwish Alam , Frank van Harmelen , Maribel Acosta

Recommendation systems are widely used in e-commerce websites and online platforms to address information overload. However, existing systems primarily rely on historical data and user feedback, making it difficult to capture user intent…

Information Retrieval · Computer Science 2024-02-22 Qian Zhao , Hao Qian , Ziqi Liu , Gong-Duo Zhang , Lihong Gu

Improving the performance of large language models (LLMs) in complex question-answering (QA) scenarios has always been a research focal point. Recent studies have attempted to enhance LLMs' performance by combining step-wise planning with…

Computation and Language · Computer Science 2024-10-24 Junjie Wang , Mingyang Chen , Binbin Hu , Dan Yang , Ziqi Liu , Yue Shen , Peng Wei , Zhiqiang Zhang , Jinjie Gu , Jun Zhou , Jeff Z. Pan , Wen Zhang , Huajun Chen

Knowledge Graphs (KG) provide us with a structured, flexible, transparent, cross-system, and collaborative way of organizing our knowledge and data across various domains in society and industrial as well as scientific disciplines. KGs…

In the process of digital transformation, enterprises are faced with problems such as insufficient semantic understanding of unstructured data and lack of intelligent decision-making basis in driving mechanisms. This study proposes a method…

Artificial Intelligence · Computer Science 2026-01-09 Huayi Liu

Relation classification is an important NLP task to extract relations between entities. The state-of-the-art methods for relation classification are primarily based on Convolutional or Recurrent Neural Networks. Recently, the pre-trained…

Computation and Language · Computer Science 2019-05-22 Shanchan Wu , Yifan He

Recent advancements in large language models (LLMs) have significantly improved various natural language processing (NLP) tasks. Typically, LLMs are trained to predict the next token, aligning well with many NLP tasks. However, in knowledge…

Computation and Language · Computer Science 2025-02-11 Lingbing Guo , Yichi Zhang , Zhongpu Bo , Zhuo Chen , Mengshu Sun , Zhiqiang Zhang , Wen Zhang , Huajun Chen

In this paper we present an approach to reduce hallucinations in Large Language Models (LLMs) by incorporating Knowledge Graphs (KGs) as an additional modality. Our method involves transforming input text into a set of KG embeddings and…

Computation and Language · Computer Science 2025-01-15 Viktoriia Chekalina , Anton Razzhigaev , Elizaveta Goncharova , Andrey Kuznetsov

Large language model (LLM) based knowledge graph completion (KGC) aims to predict the missing triples in the KGs with LLMs. However, research about LLM-based KGC fails to sufficiently harness LLMs' inference proficiencies, overlooking…

Computation and Language · Computer Science 2024-04-16 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Wen Zhang , Huajun Chen

Though pre-trained language models such as Bert and XLNet, have rapidly advanced the state-of-the-art on many NLP tasks, they implicit semantics only relying on surface information between words in corpus. Intuitively, background knowledge…

Computation and Language · Computer Science 2021-06-01 Ruiqing Yan , Lanchang Sun , Fang Wang , Xiaoming Zhang

Continual learning in computer vision faces the critical challenge of catastrophic forgetting, where models struggle to retain prior knowledge while adapting to new tasks. Although recent studies have attempted to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xusheng Cao , Haori Lu , Linlan Huang , Fei Yang , Xialei Liu , Ming-Ming Cheng