English
Related papers

Related papers: Robust Multimodal Recommendation via Graph Retriev…

200 papers

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Multimodal recommendation systems have attracted increasing attention for their improved performance by leveraging items' multimodal information. Prior methods often build modality-specific item-item semantic graphs from raw modality…

Information Retrieval · Computer Science 2025-08-11 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Dusit Niyato , Zhiqi Shen

Multimodal learning with incomplete modality is practical and challenging. Recently, researchers have focused on enhancing the robustness of pre-trained MultiModal Transformers (MMTs) under missing modality conditions by applying learnable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jian Lang , Zhangtao Cheng , Ting Zhong , Fan Zhou

Recent works in multimodal recommendations, which leverage diverse modal information to address data sparsity and enhance recommendation accuracy, have garnered considerable interest. Two key processes in multimodal recommendations are…

Information Retrieval · Computer Science 2025-05-23 Jinfeng Xu , Zheyu Chen , Wei Wang , Xiping Hu , Sang-Wook Kim , Edith C. H. Ngai

Multi-modal learning has made significant advances across diverse pattern recognition applications. However, handling missing modalities, especially under imbalanced missing rates, remains a major challenge. This imbalance triggers a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Binyu Zhao , Wei Zhang , Zhaonian Zou

Multi-modal knowledge graph completion (MMKGC) aims to discover missing facts in multi-modal knowledge graphs (MMKGs) by leveraging both structural relationships and diverse modality information of entities. Existing MMKGC methods follow…

Computation and Language · Computer Science 2026-04-20 Zhiqiang Liu , Yichi Zhang , Mengshu Sun , Lei Liang , Wen Zhang

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while…

Information Retrieval · Computer Science 2026-04-08 Sijun Dai , Qiang Huang , Xiaoxing You , Jun Yu

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

Graph learning models have been widely deployed in collaborative filtering (CF) based recommendation systems. Due to the issue of data sparsity, the graph structure of the original input lacks potential positive preference edges, which…

Information Retrieval · Computer Science 2024-07-02 Peng Yuan , Haojie Li , Minying Fang , Xu Yu , Yongjing Hao , Junwei Du

Multimodal recommender systems improve the performance of canonical recommender systems with no item features by utilizing diverse content types such as text, images, and videos, while alleviating inherent sparsity of user-item interactions…

Information Retrieval · Computer Science 2026-03-25 Yu-Seung Roh , Joo-Young Kim , Jin-Duk Park , Won-Yong Shin

In multimodal graph learning, graph structures that integrate information from multiple sources, such as vision and text, can more comprehensively model complex entity relationships. However, the continuous growth of their data scale poses…

Machine Learning · Computer Science 2026-02-10 Lian Shen , Zhendan Chen , Meijia Song , Yinhui jiang , Ziming Su , Juan Liu , Xiangrong Liu

Learning representations of multimodal data that are both informative and robust to missing modalities at test time remains a challenging problem due to the inherent heterogeneity of data obtained from different channels. To address it, we…

Machine Learning · Computer Science 2022-11-21 Petra Poklukar , Miguel Vasco , Hang Yin , Francisco S. Melo , Ana Paiva , Danica Kragic

Generative Recommendation (GR) has emerged as a new paradigm in recommender systems. This approach relies on quantized representations to discretize item features, modeling users' historical interactions as sequences of discrete tokens.…

Information Retrieval · Computer Science 2025-11-25 Fuwei Zhang , Xiaoyu Liu , Dongbo Xi , Jishen Yin , Huan Chen , Peng Yan , Fuzhen Zhuang , Zhao Zhang

Recent years have seen significant advancements in multi-modal knowledge graph completion (MMKGC). MMKGC enhances knowledge graph completion (KGC) by integrating multi-modal entity information, thereby facilitating the discovery of…

Computation and Language · Computer Science 2023-08-15 Yichi Zhang , Zhuo Chen , Wen Zhang

Developing effective path representations has become increasingly essential across various fields within intelligent transportation. Although pre-trained path representation learning models have shown improved performance, they…

Machine Learning · Computer Science 2025-01-03 Ronghui Xu , Hanyin Cheng , Chenjuan Guo , Hongfan Gao , Jilin Hu , Sean Bin Yang , Bin Yang

Multimodal recommender systems (MRS) improve recommendation performance by integrating complementary semantic information from multiple modalities. However, the assumption of complete multimodality rarely holds in practice due to missing…

Information Retrieval · Computer Science 2025-10-16 Huilin Chen , Miaomiao Cai , Fan Liu , Zhiyong Cheng , Richang Hong , Meng Wang

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

Multimodal learning with incomplete input data (missing modality) is practical and challenging. In this work, we conduct an in-depth analysis of this challenge and find that modality dominance has a significant negative impact on the model…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hao Wang , Shengda Luo , Guosheng Hu , Jianguo Zhang

Graph neural networks (GNNs) have become crucial in multimodal recommendation tasks because of their powerful ability to capture complex relationships between neighboring nodes. However, increasing the number of propagation layers in GNNs…

Multimedia · Computer Science 2024-11-05 Feng Mo , Lin Xiao , Qiya Song , Xieping Gao , Eryao Liang

Addressing missing modalities presents a critical challenge in multimodal learning. Current approaches focus on developing models that can handle modality-incomplete inputs during inference, assuming that the full set of modalities are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yunpeng Zhao , Cheng Chen , Qing You Pang , Quanzheng Li , Carol Tang , Beng-Ti Ang , Yueming Jin