English
Related papers

Related papers: Prompting Large Language Models with Knowledge Gra…

200 papers

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

Computation and Language · Computer Science 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

Large language models (LLMs) frequently generate confident yet factually incorrect content when used for language generation (a phenomenon often known as hallucination). Retrieval augmented generation (RAG) tries to reduce factual errors by…

Information Retrieval · Computer Science 2026-04-01 Dobrik Georgiev , Kheeran Naidu , Alberto Cattaneo , Federico Monti , Carlo Luschi , Daniel Justus

LLM post-training has primarily relied on large text corpora and human feedback, without capturing the structure of domain knowledge. This has caused models to struggle dealing with complex reasoning tasks, especially for high-stakes…

Computation and Language · Computer Science 2026-01-21 Dezhao Song , Guglielmo Bonifazi , Frank Schilder , Jonathan Richard Schwarz

Data augmentation is necessary for graph representation learning due to the scarcity and noise present in graph data. Most of the existing augmentation methods overlook the context information inherited from the dataset as they rely solely…

Machine Learning · Computer Science 2025-02-20 Yushi Feng , Tsai Hor Chan , Guosheng Yin , Lequan Yu

Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains a key research area.…

Computation and Language · Computer Science 2024-08-07 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Jacopo Staiano , Andrea Passerini

Large language models (LLMs) continue to struggle with knowledge-intensive questions that require up-to-date information and multi-hop reasoning. Augmenting LLMs with hybrid external knowledge, such as unstructured text and structured…

Machine Learning · Computer Science 2026-02-12 Junhong Lin , Bing Zhang , Song Wang , Ziyan Liu , Dan Gutfreund , Julian Shun , Yada Zhu

Semi-inductive link prediction (LP) in knowledge graphs (KG) is the task of predicting facts for new, previously unseen entities based on context information. Although new entities can be integrated by retraining the model from scratch in…

Computation and Language · Computer Science 2023-10-19 Adrian Kochsiek , Rainer Gemulla

Large Language Models (LLMs) often encounter conflicts between their learned, internal (parametric knowledge, PK) and external knowledge provided during inference (contextual knowledge, CK). Understanding how LLMs models prioritize one…

Computation and Language · Computer Science 2024-11-12 Zineddine Tighidet , Andrea Mogini , Jiali Mei , Benjamin Piwowarski , Patrick Gallinari

This paper presents a question answering system that operates exclusively on a knowledge graph retrieval without relying on retrieval augmented generation (RAG) with large language models (LLMs). Instead, a small paraphraser model is used…

Computation and Language · Computer Science 2025-10-23 Kartikeya Aneja , Manasvi Srivastava , Subhayan Das , Nagender Aneja

Augmenting large language models (LLMs) with user-specific knowledge is crucial for real-world applications, such as personal AI assistants. However, LLMs inherently lack mechanisms for prompt-driven knowledge capture. This paper…

Computation and Language · Computer Science 2024-02-02 Tolga Çöplü , Arto Bendiken , Andrii Skomorokhov , Eduard Bateiko , Stephen Cobb , Joshua J. Bouw

Large Language Models (LLMs) have shown strong inductive reasoning ability across various domains, but their reliability is hindered by the outdated knowledge and hallucinations. Retrieval-Augmented Generation mitigates these issues by…

Computation and Language · Computer Science 2025-06-12 Tianjun Yao , Haoxuan Li , Zhiqiang Shen , Pan Li , Tongliang Liu , Kun Zhang

In this paper, we investigate whether Large Language Models (LLMs) actively recall or retrieve their internal repositories of factual knowledge when faced with reasoning tasks. Through an analysis of LLMs' internal factual recall at each…

Computation and Language · Computer Science 2024-10-02 Yifei Wang , Yuheng Chen , Wanting Wen , Yu Sheng , Linjing Li , Daniel Dajun Zeng

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n…

Computation and Language · Computer Science 2023-11-17 Tilahun Abedissa Taffa , Ricardo Usbeck

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Knowledge embeddings (KE) represent a knowledge graph (KG) by embedding entities and relations into continuous vector spaces. Existing methods are mainly structure-based or description-based. Structure-based methods learn representations…

Computation and Language · Computer Science 2023-06-30 Xintao Wang , Qianyu He , Jiaqing Liang , Yanghua Xiao

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Recent advancements in Large Language Models (LLMs) have demonstrated significant promise in clinical diagnosis. However, current models struggle to emulate the iterative, diagnostic hypothesis-driven reasoning of real clinical scenarios.…

Computation and Language · Computer Science 2026-01-06 Qipeng Wang , Rui Sheng , Yafei Li , Huamin Qu , Yushi Sun , Min Zhu

Large language models (LLMs), such as ChatGPT and GPT-4, are versatile and can solve different tasks due to their emergent ability and generalizability. However, LLMs sometimes lack domain-specific knowledge to perform tasks, which would…

Computation and Language · Computer Science 2023-09-07 Chao Feng , Xinyu Zhang , Zichu Fei

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

In the continuously advancing AI landscape, crafting context-rich and meaningful responses via Large Language Models (LLMs) is essential. Researchers are becoming more aware of the challenges that LLMs with fewer parameters encounter when…

Computation and Language · Computer Science 2024-10-17 Somnath Banerjee , Amruit Sahoo , Sayan Layek , Avik Dutta , Rima Hazra , Animesh Mukherjee