English
Related papers

Related papers: KALE: Enhancing Knowledge Manipulation in Large La…

200 papers

Large Language Models (LLMs) have shown remarkable reasoning capabilities on complex tasks, but they still suffer from out-of-date knowledge, hallucinations, and opaque decision-making. In contrast, Knowledge Graphs (KGs) can provide…

Artificial Intelligence · Computer Science 2024-11-01 Liyi Chen , Panrong Tong , Zhongming Jin , Ying Sun , Jieping Ye , Hui Xiong

Large language models (LLMs) have demonstrated impressive reasoning abilities yet remain unreliable on knowledge-intensive, multi-hop questions -- they miss long-tail facts, hallucinate when uncertain, and their internal knowledge lags…

Computation and Language · Computer Science 2025-10-13 Jia Ao Sun , Hao Yu , Fabrizio Gotti , Fengran Mo , Yihong Wu , Yuchen Hui , Jian-Yun Nie

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, although their susceptibility to hallucination poses significant challenges for their deployment in critical areas such as healthcare. To address…

Computation and Language · Computer Science 2024-05-13 Mengjia Niu , Hao Li , Jie Shi , Hamed Haddadi , Fan Mo

Large language models (LLMs) often struggle with context fidelity, producing inconsistent answers when responding to questions based on provided information. Existing approaches either rely on expensive supervised fine-tuning to generate…

Computation and Language · Computer Science 2025-09-18 Suyuchen Wang , Jinlin Wang , Xinyu Wang , Shiqi Li , Xiangru Tang , Sirui Hong , Xiao-Wen Chang , Chenglin Wu , Bang Liu

Knowledge editing (KE) aims to efficiently and precisely modify the behavior of large language models (LLMs) to update specific knowledge without negatively influencing other knowledge. Current research primarily focuses on white-box LLMs…

Computation and Language · Computer Science 2024-02-20 Xiaoshuai Song , Zhengyang Wang , Keqing He , Guanting Dong , Yutao Mou , Jinxu Zhao , Weiran Xu

Recent advances in large language models (LLMs) and the abundance of food data have resulted in studies to improve food understanding using LLMs. Despite several recommendation systems utilizing LLMs and Knowledge Graphs (KGs), there has…

Machine Learning · Computer Science 2025-05-21 Fnu Mohbat , Mohammed J Zaki

Incorporating external knowledge in large language models (LLMs) enhances their utility across diverse applications, but existing methods have trade-offs. Retrieval-Augmented Generation (RAG) fetches evidence via similarity search, but key…

Computation and Language · Computer Science 2025-03-10 Giulio Corallo , Orion Weller , Fabio Petroni , Paolo Papotti

Teaching large language models (LLMs) to use tools is crucial for improving their problem-solving abilities and expanding their applications. However, effectively using tools is challenging because it requires a deep understanding of tool…

Machine Learning · Computer Science 2025-06-27 Jingwei Wang , Zai Zhang , Hao Qian , Chunjing Gan , Binbin Hu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Bin Shi , Bo Dong

Despite their competitive performance on knowledge-intensive tasks, large language models (LLMs) still have limitations in memorizing all world knowledge especially long tail knowledge. In this paper, we study the KG-augmented language…

Computation and Language · Computer Science 2023-09-22 Yike Wu , Nan Hu , Sheng Bi , Guilin Qi , Jie Ren , Anhuan Xie , Wei Song

This paper presents an exhaustive quantitative and qualitative evaluation of Large Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We engage in experiments across eight diverse datasets, focusing on four…

Computation and Language · Computer Science 2024-12-30 Yuqi Zhu , Xiaohan Wang , Jing Chen , Shuofei Qiao , Yixin Ou , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

This project investigates the efficacy of Large Language Models (LLMs) in understanding and extracting scientific knowledge across specific domains and to create a deep learning framework: Knowledge AI. As a part of this framework, we…

Computation and Language · Computer Science 2024-08-12 Balaji Muralidharan , Hayden Beadles , Reza Marzban , Kalyan Sashank Mupparaju

Knowledge Graph Question Answering aims to answer natural language questions by reasoning over structured knowledge graphs. While large language models have advanced KGQA through their strong reasoning capabilities, existing methods…

Artificial Intelligence · Computer Science 2026-01-28 Yanlin Song , Ben Liu , Víctor Gutiérrez-Basulto , Zhiwei Hu , Qianqian Xie , Min Peng , Sophia Ananiadou , Jeff Z. Pan

With the emerging branch of incorporating factual knowledge into pre-trained language models such as BERT, most existing models consider shallow, static, and separately pre-trained entity embeddings, which limits the performance gains of…

Computation and Language · Computer Science 2020-10-02 Tianxiang Sun , Yunfan Shao , Xipeng Qiu , Qipeng Guo , Yaru Hu , Xuanjing Huang , Zheng Zhang

The development of large language models (LLMs) has been catalyzed by advancements in pre-training techniques. These models have demonstrated robust reasoning capabilities through manually designed prompts. In this work, we evaluate the…

Computation and Language · Computer Science 2024-11-18 Yuxuan Huang

Knowledge editing enables targeted updates without retraining, but prior work focuses on textual or visual facts, leaving abstract auditory perceptual knowledge underexplored. We introduce SAKE, the first benchmark for editing perceptual…

Large Language Models (LLMs) currently respond to every prompt. However, they can produce incorrect answers when they lack knowledge or capability -- a problem known as hallucination. We instead propose post-training an LLM to generate…

Computation and Language · Computer Science 2026-02-17 Tim Franzmeyer , Archie Sravankumar , Lijuan Liu , Yuning Mao , Rui Hou , Sinong Wang , Jakob N. Foerster , Luke Zettlemoyer , Madian Khabsa

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

Computation and Language · Computer Science 2023-06-13 Pouya Pezeshkpour

Large language models (LLMs) like Claude, Mistral IA, and GPT-4 excel in NLP but lack structured knowledge, leading to factual inconsistencies. We address this by integrating Knowledge Graphs (KGs) via KG-BERT to enhance grounding and…

Computation and Language · Computer Science 2025-12-12 Nour El Houda Ben Chaabene , Hamza Hammami

Foundational models with billions of parameters which have been trained on large corpora of data have demonstrated non-trivial skills in a variety of domains. However, due to their monolithic structure, it is challenging and expensive to…

Large language models (LLMs) show promise for diagnostic reasoning but often lack reliable, knowledge grounded inference. Knowledge graphs (KGs), such as the Unified Medical Language System (UMLS), offer structured biomedical knowledge that…

Computation and Language · Computer Science 2025-09-24 Saksham Khatwani , He Cheng , Majid Afshar , Dmitriy Dligach , Yanjun Gao