English
Related papers

Related papers: Multi-Modal Knowledge Graph Construction and Appli…

200 papers

Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the semantic web community's exploration into multi-modal dimensions unlocking new avenues for innovation. In this survey, we carefully review over 300…

We present MMKG, a collection of three knowledge graphs that contain both numerical features and (links to) images for all entities as well as entity alignments between pairs of KGs. Therefore, multi-relational link prediction and entity…

Artificial Intelligence · Computer Science 2019-03-14 Ye Liu , Hui Li , Alberto Garcia-Duran , Mathias Niepert , Daniel Onoro-Rubio , David S. Rosenblum

Multi-modal knowledge graphs (MMKGs), which ground various non-symbolic data (e.g., images and videos) into symbols, have attracted attention as resources enabling knowledge processing and machine learning across modalities. However, the…

Artificial Intelligence · Computer Science 2024-08-29 Shusaku Egami , Takahiro Ugai , Swe Nwe Nwe Htun , Ken Fukuda

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

Computation and Language · Computer Science 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Multi-modal knowledge graphs (MKGs) include not only the relation triplets, but also related multi-modal auxiliary data (i.e., texts and images), which enhance the diversity of knowledge. However, the natural incompleteness has…

Artificial Intelligence · Computer Science 2022-09-07 Shangfei Zheng , Weiqing Wang , Jianfeng Qu , Hongzhi Yin , Wei Chen , Lei Zhao

Current Multimodal Knowledge Graph Construction (MKGC) models struggle with the real-world dynamism of continuously emerging entities and relations, often succumbing to catastrophic forgetting-loss of previously acquired knowledge. This…

Computation and Language · Computer Science 2024-05-28 Xiang Chen , Jintian Zhang , Xiaohan Wang , Ningyu Zhang , Tongtong Wu , Yuxiang Wang , Yongheng Wang , Huajun Chen

Knowledge graphs (KGs) are structured representations of diversified knowledge. They are widely used in various intelligent applications. In this article, we provide a comprehensive survey on the evolution of various types of knowledge…

Artificial Intelligence · Computer Science 2025-05-22 Xuhui Jiang , Chengjin Xu , Yinghan Shen , Xun Sun , Lumingyuan Tang , Saizhuo Wang , Zhongwu Chen , Yuanzhuo Wang , Jian Guo

Knowledge in materials science is widely dispersed across extensive scientific literature, posing significant challenges to the efficient discovery and integration of new materials. Traditional methods, often reliant on costly and…

Computation and Language · Computer Science 2025-05-16 Yanpeng Ye , Jie Ren , Shaozhou Wang , Yuwei Wan , Imran Razzak , Bram Hoex , Haofen Wang , Tong Xie , Wenjie Zhang

Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing continual knowledge graph reasoning (CKGR) methods focus on structural triples and cannot fully…

Computation and Language · Computer Science 2026-04-06 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Yuanpeng He , Haoran Duan , Gadeng Luosang , Nyima Tashi

With the explosive growth of artificial intelligence (AI) and big data, it has become vitally important to organize and represent the enormous volume of knowledge appropriately. As graph data, knowledge graphs accumulate and convey…

Artificial Intelligence · Computer Science 2023-03-27 Ciyuan Peng , Feng Xia , Mehdi Naseriparsa , Francesco Osborne

Knowledge Graph embedding provides a versatile technique for representing knowledge. These techniques can be used in a variety of applications such as completion of knowledge graph to predict missing information, recommender systems,…

Information Retrieval · Computer Science 2021-07-19 Shivani Choudhary , Tarun Luthra , Ashima Mittal , Rajat Singh

Medical deep learning models depend heavily on domain-specific knowledge to perform well on knowledge-intensive clinical tasks. Prior work has primarily leveraged unimodal knowledge graphs, such as the Unified Medical Language System…

Artificial Intelligence · Computer Science 2025-05-26 Xiaochen Wang , Yuan Zhong , Lingwei Zhang , Lisong Dai , Ting Wang , Fenglong Ma

Multimodal data pervades various domains, including healthcare, social media, and transportation, where multimodal graphs play a pivotal role. Machine learning on multimodal graphs, referred to as multimodal graph learning (MGL), is…

Machine Learning · Computer Science 2024-02-09 Ciyuan Peng , Jiayuan He , Feng Xia

Knowledge graph reasoning (KGR), aiming to deduce new facts from existing facts based on mined logic rules underlying knowledge graphs (KGs), has become a fast-growing research direction. It has been proven to significantly benefit the…

Artificial Intelligence · Computer Science 2024-10-28 Ke Liang , Lingyuan Meng , Meng Liu , Yue Liu , Wenxuan Tu , Siwei Wang , Sihang Zhou , Xinwang Liu , Fuchun Sun

The real value of knowledge lies not just in its accumulation, but in its potential to be harnessed effectively to conquer the unknown. Although recent multimodal large language models (MLLMs) exhibit impressing multimodal capabilities,…

Artificial Intelligence · Computer Science 2025-08-26 Bowen Wang , Zhouqiang Jiang , Yasuaki Susumu , Shotaro Miwa , Tianwei Chen , Yuta Nakashima

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering. However, most MKGs are still…

Artificial Intelligence · Computer Science 2023-07-10 Ke Liang , Sihang Zhou , Yue Liu , Lingyuan Meng , Meng Liu , Xinwang Liu

Multi-modal Knowledge Graphs (MMKGs) have been widely applied across various domains for knowledge representation. However, the existing MMKGs are significantly fewer than required, and their construction faces numerous challenges,…

Artificial Intelligence · Computer Science 2025-04-21 Yajing Xu , Zhiqiang Liu , Jiaoyan Chen , Mingchen Tu , Zhuo Chen , Jeff Z. Pan , Yichi Zhang , Yushan Zhu , Wen Zhang , Huajun Chen

Multimodal Knowledge Graphs (MMKGs), which represent explicit knowledge across multiple modalities, play a pivotal role by complementing the implicit knowledge of Multimodal Large Language Models (MLLMs) and enabling more grounded reasoning…

Computation and Language · Computer Science 2025-09-29 Hyeongcheol Park , Jiyoung Seo , MinHyuk Jang , Hogun Park , Ha Dam Baek , Gyusam Chang , Hyeonsoo Im , Sangpil Kim

Knowledge Graphs (KGs) have long served as a fundamental infrastructure for structured knowledge representation and reasoning. With the advent of Large Language Models (LLMs), the construction of KGs has entered a new paradigm-shifting from…

Artificial Intelligence · Computer Science 2025-10-24 Haonan Bian

Embodied AI is one of the most popular studies in artificial intelligence and robotics, which can effectively improve the intelligence of real-world agents (i.e. robots) serving human beings. Scene knowledge is important for an agent to…

Artificial Intelligence · Computer Science 2024-05-14 Song Yaoxian , Sun Penglei , Liu Haoyu , Li Zhixu , Song Wei , Xiao Yanghua , Zhou Xiaofang
‹ Prev 1 2 3 10 Next ›