English
Related papers

Related papers: Towards Structure-aware Model for Multi-modal Know…

200 papers

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

Machine Learning · Computer Science 2025-05-13 Erica Coppolillo

Knowledge Graphs (KGs) have been applied to many tasks including Web search, link prediction, recommendation, natural language processing, and entity linking. However, most KGs are far from complete and are growing at a rapid pace. To…

Artificial Intelligence · Computer Science 2017-11-10 Baoxu Shi , Tim Weninger

While deep-learning-enabled recommender systems demonstrate strong performance benchmarks, many struggle to adapt effectively in real-world environments due to limited use of user-item relationship data and insufficient transparency in…

Machine Learning · Computer Science 2025-01-09 Dong Hyun Jeon , Wenbo Sun , Houbing Herbert Song , Dongfang Liu , Velasquez Alvaro , Yixin Chloe Xie , Shuteng Niu

Knowledge graphs (KGs) that modelings the world knowledge as structural triples are inevitably incomplete. Such problems still exist for multimodal knowledge graphs (MMKGs). Thus, knowledge graph completion (KGC) is of great importance to…

Artificial Intelligence · Computer Science 2022-09-16 Yichi Zhang , Wen Zhang

Knowledge Graph Completion (KGC) is crucial for addressing knowledge graph incompleteness and supporting downstream applications. Many models have been proposed for KGC. They can be categorized into two main classes: triple-based and…

Computation and Language · Computer Science 2024-02-26 Yanbin Wei , Qiushi Huang , James T. Kwok , Yu Zhang

Graph Machine Learning (GML) with Graph Databases (GDBs) has gained significant relevance in recent years, due to its ability to handle complex interconnected data and apply ML techniques using Graph Data Science (GDS). However, a critical…

Databases · Computer Science 2026-01-22 Rosario Napoli , Antonio Celesti , Massimo Villari , Maria Fazio

Multimodal semantic segmentation integrates complementary information from diverse sensors for remote sensing Earth observation. However, practical systems often encounter missing modalities due to sensor failures or incomplete coverage,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Lekang Wen , Liang Liao , Jing Xiao , Mi Wang

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Knowledge Graphs (KG) are the backbone of many data-intensive applications since they can represent data coupled with its meaning and context. Aligning KGs across different domains and providers is necessary to afford a fuller and…

Artificial Intelligence · Computer Science 2023-10-12 Pedro Giesteira Cotovio , Ernesto Jimenez-Ruiz , Catia Pesquita

Accurate extraction of molecular representations is a critical step in the drug discovery process. In recent years, significant progress has been made in molecular representation learning methods, among which multi-modal molecular…

Machine Learning · Computer Science 2025-05-13 Rong Yin , Ruyue Liu , Xiaoshuai Hao , Xingrui Zhou , Yong Liu , Can Ma , Weiping Wang

Integrating diverse data modalities is crucial for enhancing the performance of personalized recommendation systems. Traditional models, which often rely on singular data sources, lack the depth needed to accurately capture the multifaceted…

Information Retrieval · Computer Science 2025-02-18 Luyi Ma , Xiaohan Li , Zezhong Fan , Kai Zhao , Jianpeng Xu , Jason Cho , Praveen Kanumala , Kaushiki Nag , Sushant Kumar , Kannan Achan

The growing demand for robust scene understanding in mobile robotics and autonomous driving has highlighted the importance of integrating multiple sensing modalities. By combining data from diverse sensors like cameras and LIDARs, fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Depanshu Sani , Saket Anand

Knowledge graph completion (KGC) aims to predict missing triples in knowledge graphs (KGs) by leveraging existing triples and textual information. Recently, generative large language models (LLMs) have been increasingly employed for graph…

Artificial Intelligence · Computer Science 2025-11-11 Yongkang Xiao , Sinian Zhang , Yi Dai , Huixue Zhou , Jue Hou , Jie Ding , Rui Zhang

Knowledge Graph Completion (KGC) aims at automatically predicting missing links for large-scale knowledge graphs. A vast number of state-of-the-art KGC techniques have got published at top conferences in several research fields, including…

Computation and Language · Computer Science 2020-07-10 Zhiqing Sun , Shikhar Vashishth , Soumya Sanyal , Partha Talukdar , Yiming Yang

Knowledge Graphs (KGs) are crucial in the field of artificial intelligence and are widely used in downstream tasks, such as question-answering (QA). The construction of KGs typically requires significant effort from domain experts. Large…

Computation and Language · Computer Science 2025-02-04 Rui Yang , Boming Yang , Aosong Feng , Sixun Ouyang , Moritz Blum , Tianwei She , Yuang Jiang , Freddy Lecue , Jinghui Lu , Irene Li

In sequential recommendation, multi-modal information (e.g., text or image) can provide a more comprehensive view of an item's profile. The optimal stage (early or late) to fuse modality features into item representations is still debated.…

Information Retrieval · Computer Science 2023-08-31 Hengchang Hu , Wei Guo , Yong Liu , Min-Yen Kan

Medical visual question answering (Med-VQA) is a crucial multimodal task in clinical decision support and telemedicine. Recent methods fail to fully leverage domain-specific medical knowledge, making it difficult to accurately associate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xianyao Zheng , Hong Yu , Hui Cui , Changming Sun , Xiangyu Li , Ran Su , Leyi Wei , Jia Zhou , Junbo Wang , Qiangguo Jin

Multimodal Attributed Graphs (MAGs) are ubiquitous in real-world applications, encompassing extensive knowledge through multimodal attributes attached to nodes (e.g., texts and images) and topological structure representing node…

Machine Learning · Computer Science 2025-02-28 Hao Yan , Chaozhuo Li , Jun Yin , Zhigang Yu , Weihao Han , Mingzheng Li , Zhengxin Zeng , Hao Sun , Senzhang Wang

Graph-based multi-view clustering aiming to obtain a partition of data across multiple views, has received considerable attention in recent years. Although great efforts have been made for graph-based multi-view clustering, it remains a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Yao Zhao

Multimodal tabular-image fusion is an emerging task that has received increasing attention in various domains. However, existing methods may be hindered by gradient conflicts between modalities, misleading the optimization of the unimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Longfei Huang , Yang Yang