English
Related papers

Related papers: Multimodal Reasoning with Multimodal Knowledge Gra…

200 papers

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) enhances factual grounding and reasoning capabilities. This survey paper systematically examines the synergy between KGs and LLMs, categorizing…

Computation and Language · Computer Science 2025-06-12 Blaž Škrlj , Boshko Koloski , Senja Pollak , Nada Lavrač

In knowledge-intensive tasks, especially in high-stakes domains like medicine and law, it is critical not only to retrieve relevant information but also to provide causal reasoning and explainability. Large language models (LLMs) have…

Artificial Intelligence · Computer Science 2025-03-18 Hang Luo , Jian Zhang , Chujun Li

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

This paper presents an exhaustive quantitative and qualitative evaluation of Large Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We engage in experiments across eight diverse datasets, focusing on four…

Computation and Language · Computer Science 2024-12-30 Yuqi Zhu , Xiaohan Wang , Jing Chen , Shuofei Qiao , Yixin Ou , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Large language models (LLMs) have demonstrated remarkable capabilities in various complex tasks, yet they still suffer from hallucinations. By incorporating and exploring external knowledge, such as knowledge graphs(KGs), LLM's ability to…

Artificial Intelligence · Computer Science 2025-05-27 Qi Zhao , Hongyu Yang , Qi Song , Xinwei Yao , Xiangyang Li

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

Large language models (LLMs) have demonstrated impressive reasoning abilities, but they still struggle with faithful reasoning due to knowledge gaps and hallucinations. To address these issues, knowledge graphs (KGs) have been utilized to…

Computation and Language · Computer Science 2025-05-29 Linhao Luo , Zicheng Zhao , Gholamreza Haffari , Yuan-Fang Li , Chen Gong , Shirui Pan

Large Language Models (LLMs) have demonstrated impressive performance in natural language processing tasks by leveraging chain of thought (CoT) that enables step-by-step thinking. Extending LLMs with multimodal capabilities is the recent…

Computation and Language · Computer Science 2024-01-24 Debjyoti Mondal , Suraj Modi , Subhadarshi Panda , Rituraj Singh , Godawari Sudhakar Rao

Multimodal Knowledge Editing (MKE) extends traditional knowledge editing to settings involving both textual and visual modalities. However, existing MKE benchmarks primarily assess final answer correctness while neglecting the quality of…

Artificial Intelligence · Computer Science 2025-12-02 Li Yuan , Qingfei Huang , Bingshan Zhu , Yi Cai , Qingbao Huang , Changmeng Zheng , Zikun Deng , Tao Wang

Knowledge graph (KG) is an abstraction that can be extracted from text corpora and used for in-depth reasoning. Prior work has leveraged KGs to fine-tune language models (LMs), enabling domain-specific superintelligence. In this work, we…

Computation and Language · Computer Science 2026-05-28 Jake Stephen , Niraj K. Jha

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

Machine Learning · Computer Science 2025-05-13 Erica Coppolillo

Large language models have become integral to question-answering applications despite their propensity for generating hallucinations and factually inaccurate content. Querying knowledge graphs to reduce hallucinations in LLM meets the…

Computation and Language · Computer Science 2024-06-26 Tong Zhou , Yubo Chen , Kang Liu , Jun Zhao

Temporal knowledge graphs (TKGs) support reasoning over time-evolving facts, yet state-of-the-art models are often computationally heavy and costly to deploy. Existing compression and distillation techniques are largely designed for static…

Computation and Language · Computer Science 2026-02-17 Wang Xing , Wei Song , Siyu Lin , Chen Wu , Man Wang

Existing work on augmenting question answering (QA) models with external knowledge (e.g., knowledge graphs) either struggle to model multi-hop relations efficiently, or lack transparency into the model's prediction rationale. In this paper,…

Computation and Language · Computer Science 2020-09-21 Yanlin Feng , Xinyue Chen , Bill Yuchen Lin , Peifeng Wang , Jun Yan , Xiang Ren

Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable…

Computation and Language · Computer Science 2025-05-26 Abdullah Abdullah , Seong Tae Kim

The `pre-train, prompt, predict' paradigm of large language models (LLMs) has achieved remarkable success in open-domain question answering (OD-QA). However, few works explore this paradigm in the scenario of multi-document question…

Computation and Language · Computer Science 2023-12-27 Yu Wang , Nedim Lipka , Ryan A. Rossi , Alexa Siu , Ruiyi Zhang , Tyler Derr

Although large language models (LLMs) have achieved significant success in various tasks, they often struggle with hallucination problems, especially in scenarios requiring deep and responsible reasoning. These issues could be partially…

Computation and Language · Computer Science 2024-03-26 Jiashuo Sun , Chengjin Xu , Lumingyuan Tang , Saizhuo Wang , Chen Lin , Yeyun Gong , Lionel M. Ni , Heung-Yeung Shum , Jian Guo

In recent years, multimodal large language models (MLLMs) have shown remarkable capabilities in tasks like visual question answering and common sense reasoning, while visual perception models have made significant strides in perception…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Guanqun Wang , Xinyu Wei , Jiaming Liu , Ray Zhang , Yichi Zhang , Kevin Zhang , Maurice Chong , Shanghang Zhang