English
Related papers

Related papers: Incorporating Explicit Knowledge in Pre-trained La…

200 papers

Recent works have attempted to integrate external knowledge into LLMs to address the limitations and potential factual errors in LLM-generated content. However, how to retrieve the correct knowledge from the large amount of external…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

Reranking is a critical component in many information retrieval pipelines. Despite remarkable progress in text-only settings, multimodal reranking remains challenging, particularly when the candidate set contains hybrid text and image…

Information Retrieval · Computer Science 2026-05-26 Yupei Yang , Lin Yang , Wanxi Deng , Lin Qu , Shikui Tu , Lei Xu

With the improving semantic understanding capability of Large Language Models (LLMs), they exhibit a greater awareness and alignment with human values, but this comes at the cost of transparency. Although promising results are achieved via…

Computation and Language · Computer Science 2026-05-27 Nafis Tanveer Islam , Zhiming Zhao

The ability to reason over learned knowledge is an innate ability for humans and humans can easily master new reasoning rules with only a few demonstrations. While most existing studies on knowledge graph (KG) reasoning assume enough…

Computation and Language · Computer Science 2019-08-15 Hong Wang , Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Shiyu Chang , William Yang Wang

Recent advances in pretrained language models (PLMs) have significantly improved conversational recommender systems (CRS), enabling more fluent and context-aware interactions. To further enhance accuracy and mitigate hallucination, many…

Artificial Intelligence · Computer Science 2025-11-18 Yongwen Ren , Chao Wang , Peng Du , Chuan Qin , Dazhong Shen , Hui Xiong

Given unstructured text, Large Language Models (LLMs) are adept at answering simple (single-hop) questions. However, as the complexity of the questions increase, the performance of LLMs degrade. We believe this is due to the overhead…

Computation and Language · Computer Science 2024-06-11 Pranoy Panda , Ankush Agarwal , Chaitanya Devaguptapu , Manohar Kaul , Prathosh A P

In recent years, large language models (LLMs) have revolutionized the field of natural language processing. However, they often suffer from knowledge gaps and hallucinations. Graph retrieval-augmented generation (GraphRAG) enhances LLM…

Artificial Intelligence · Computer Science 2025-03-19 Kai Guo , Harry Shomer , Shenglai Zeng , Haoyu Han , Yu Wang , Jiliang Tang

Large language model (LLM) based listwise reranking has emerged as the dominant paradigm for achieving state-of-the-art ranking effectiveness in information retrieval. However, its reliance on feeding full passage texts into the LLM…

Information Retrieval · Computer Science 2026-04-27 Xiaojie Ke , Shuai Zhang , Liansheng Sun , Yongjin Wang , Hengjun Jiang , Xiangkun Liu , Cunxin Gu , Jian Xu , Guanjun Jiang

The paper describes a system that uses large language model (LLM) technology to support the automatic learning of new entries in an intelligent agent's semantic lexicon. The process is bootstrapped by an existing non-toy lexicon and a…

Computation and Language · Computer Science 2023-12-29 Sanjay Oruganti , Sergei Nirenburg , Jesse English , Marjorie McShane

Large Language Models (LLM) have demonstrated their strong ability in the field of machine translation (MT), yet they suffer from high computational cost and latency. Therefore, transferring translation knowledge from giant LLMs to…

Computation and Language · Computer Science 2024-04-02 Jiahuan Li , Shanbo Cheng , Shujian Huang , Jiajun Chen

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

In the realm of computational knowledge representation, Knowledge Graph Reasoning (KG-R) stands at the forefront of facilitating sophisticated inferential capabilities across multifarious domains. The quintessence of this research…

Artificial Intelligence · Computer Science 2024-03-12 Chen Li , Haotian Zheng , Yiping Sun , Cangqing Wang , Liqiang Yu , Che Chang , Xinyu Tian , Bo Liu

Introduction: Tracing the spread of ideas and the presence of influence is a question of special importance across a wide range of disciplines, ranging from intellectual history to cultural analytics, computational social science, and the…

Computation and Language · Computer Science 2024-11-01 Lucian Li , Eryclis Silva

The task of multi-hop link prediction within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, as it requires the model to reason through and understand all intermediate connections before making a…

Computation and Language · Computer Science 2025-06-17 Dong Shu , Tianle Chen , Mingyu Jin , Chong Zhang , Mengnan Du , Yongfeng Zhang

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

We introduce a simple yet effective method of integrating contextual embeddings with commonsense graph embeddings, dubbed BERT Infused Graphs: Matching Over Other embeDdings. First, we introduce a preprocessing method to improve the speed…

Computation and Language · Computer Science 2019-10-18 Jeff Da

Current captioning approaches tend to generate correct but "generic" descriptions that lack real-world knowledge, e.g., named entities and contextual information. Considering that Vision-Language Pre-Training (VLP) models master massive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Kanzhi Cheng , Wenpo Song , Zheng Ma , Wenhao Zhu , Zixuan Zhu , Jianbing Zhang

While Pre-trained Language Models (PLMs) internalize a great amount of world knowledge, they have been shown incapable of recalling these knowledge to solve tasks requiring complex & multi-step reasoning. Similar to how humans develop a…

Computation and Language · Computer Science 2022-10-25 Boshi Wang , Xiang Deng , Huan Sun

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

Retrieval Augmented Generation (RAG) has enjoyed increased attention in the recent past and recent advancements in Large Language Models (LLMs) have highlighted the importance of integrating world knowledge into these systems. Current RAG…

Computation and Language · Computer Science 2025-04-11 Joel Barmettler , Abraham Bernstein , Luca Rossetto