English
Related papers

Related papers: Multi-Modal Knowledge Graph Construction and Appli…

200 papers

In recent years, we have witnessed the proliferation of knowledge graphs (KG) in various domains, aiming to support applications like question answering, recommendations, etc. A frequent task when integrating knowledge from different KGs is…

Databases · Computer Science 2023-06-08 Nikolaos Fanourakis , Vasilis Efthymiou , Dimitris Kotzinos , Vassilis Christophides

Multimodal knowledge graph completion (MMKGC) aims to predict missing links in multimodal knowledge graphs (MMKGs) by leveraging information from various modalities alongside structural data. Existing MMKGC approaches primarily extend…

Computation and Language · Computer Science 2025-09-16 Haodi Ma , Dzmitry Kasinets , Daisy Zhe Wang

Sharing and reusing research artifacts, such as datasets, publications, or methods is a fundamental part of scientific activity, where heterogeneity of resources and metadata and the common practice of capturing information in unstructured…

Knowledge graphs (KGs) have shown to be an important asset of large companies like Google and Microsoft. KGs play an important role in providing structured and semantically rich information, making them available to people and machines, and…

Databases · Computer Science 2020-05-05 Elwin Huaman , Elias Kärle , Dieter Fensel

Despite many advances in knowledge engineering (KE), challenges remain in areas such as engineering knowledge graphs (KGs) at scale, keeping up with evolving domain knowledge, multilingualism, and multimodality. Recently, KE has used LLMs…

Human-Computer Interaction · Computer Science 2025-10-23 Elisavet Koutsiana , Johanna Walker , Michelle Nwachukwu , Bohui Zhang , Albert Meroño-Peñuela , Elena Simperl

Graph machine learning has made significant strides in recent years, yet the integration of visual information with graph structure and its potential for improving performance in downstream tasks remains an underexplored area. To address…

Machine Learning · Computer Science 2025-04-01 Jing Zhu , Yuhang Zhou , Shengyi Qian , Zhongmou He , Tong Zhao , Neil Shah , Danai Koutra

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Multimodal knowledge graphs (MMKGs) enrich traditional knowledge graphs (KGs) by incorporating diverse modalities such as images and text. multimodal knowledge graph completion (MMKGC) seeks to exploit these heterogeneous signals to infer…

Computation and Language · Computer Science 2025-08-12 Yongkang Xiao , Rui Zhang

We present MMCOMET, the first multimodal commonsense knowledge graph (MMKG) that integrates physical, social, and eventive knowledge. MMCOMET extends the ATOMIC2020 knowledge graph to include a visual dimension, through an efficient image…

Artificial Intelligence · Computer Science 2026-03-03 Eileen Wang , Hiba Arnaout , Dhita Pratama , Shuo Yang , Dangyang Liu , Jie Yang , Josiah Poon , Jeff Pan , Caren Han

The ability to construct domain specific knowledge graphs (KG) and perform question-answering or hypothesis generation is a transformative capability. Despite their value, automated construction of knowledge graphs remains an expensive…

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Knowledge graphs have become the primary vehicle for data integration and are critical to the success of modern AI, but the diversity of KG modelling practices, from lightweight vocabularies to richly axiomatised ontologies, makes…

Artificial Intelligence · Computer Science 2026-05-26 Enrico Daga , Valentina Tamma , Terry Payne

Automatic knowledge graph construction aims to manufacture structured human knowledge. To this end, much effort has historically been spent extracting informative fact patterns from different data sources. However, more recently, research…

Information Retrieval · Computer Science 2023-02-13 Lingfeng Zhong , Jia Wu , Qian Li , Hao Peng , Xindong Wu

In recent years, multimodal large language models (MLLMs) have achieved significant breakthroughs, enhancing understanding across text and vision. However, current MLLMs still face challenges in effectively integrating knowledge across…

Computation and Language · Computer Science 2025-03-10 Boyu Jia , Junzhe Zhang , Huixuan Zhang , Xiaojun Wan

Multimodal reasoning in Large Language Models (LLMs) struggles with incomplete knowledge and hallucination artifacts, challenges that textual Knowledge Graphs (KGs) only partially mitigate due to their modality isolation. While Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Junming Liu , Siyuan Meng , Yanting Gao , Song Mao , Pinlong Cai , Guohang Yan , Yirong Chen , Zilin Bian , Ding Wang , Botian Shi

Multilingual Knowledge Graph Completion (mKGC) aim at solving queries like (h, r, ?) in different languages by reasoning a tail entity t thus improving multilingual knowledge graphs. Previous studies leverage multilingual pretrained…

Computation and Language · Computer Science 2024-06-27 Ran Song , Shizhu He , Shengxiang Gao , Li Cai , Kang Liu , Zhengtao Yu , Jun Zhao

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) enhances factual grounding and reasoning capabilities. This survey paper systematically examines the synergy between KGs and LLMs, categorizing…

Computation and Language · Computer Science 2025-06-12 Blaž Škrlj , Boshko Koloski , Senja Pollak , Nada Lavrač

Knowledge graphs (KGs) have emerged as a powerful paradigm for structuring and leveraging diverse real-world knowledge, which serve as a fundamental technology for enabling cognitive intelligence systems with advanced understanding and…

Artificial Intelligence · Computer Science 2025-06-16 Guanglin Niu , Bo Li , Yangguang Lin

Artificial intelligence for graphs has achieved remarkable success in modeling complex systems, ranging from dynamic networks in biology to interacting particle systems in physics. However, the increasingly heterogeneous graph datasets call…

Machine Learning · Computer Science 2023-01-25 Yasha Ektefaie , George Dasoulas , Ayush Noori , Maha Farhat , Marinka Zitnik

Large language models appear to learn facts from the large text corpora they are trained on. Such facts are encoded implicitly within their many parameters, making it difficult to verify or manipulate what knowledge has been learned.…

Computation and Language · Computer Science 2022-10-27 Yifan Hou , Wenxiang Jiao , Meizhen Liu , Carl Allen , Zhaopeng Tu , Mrinmaya Sachan