English
Related papers

Related papers: Hypercomplex Prompt-aware Multimodal Recommendatio…

200 papers

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Explainable recommendation is far from being well solved partly due to three challenges. The first is the personalization of preference learning, which requires that different items/users have different contributions to the learning of user…

Information Retrieval · Computer Science 2020-01-29 Huanrui Luo , Ning Yang , Philip S. Yu

Multimodal federated learning in real-world settings often encounters incomplete and heterogeneous data across clients. This results in misaligned local feature representations that limit the effectiveness of model aggregation. Unlike prior…

Machine Learning · Computer Science 2025-10-28 Duong M. Nguyen , Trong Nghia Hoang , Thanh Trung Huynh , Quoc Viet Hung Nguyen , Phi Le Nguyen

User purchasing prediction with multi-behavior information remains a challenging problem for current recommendation systems. Various methods have been proposed to address it via leveraging the advantages of graph neural networks (GNNs) or…

Information Retrieval · Computer Science 2022-01-20 Haoran Yang , Hongxu Chen , Lin Li , Philip S. Yu , Guandong Xu

The development of multimodal models has significantly advanced multimodal sentiment analysis and emotion recognition. However, in real-world applications, the presence of various missing modality cases often leads to a degradation in the…

Computation and Language · Computer Science 2024-07-09 Zirun Guo , Tao Jin , Zhou Zhao

Existing sequential recommendation methods rely on large amounts of training data and usually suffer from the data sparsity problem. To tackle this, the pre-training mechanism has been widely adopted, which attempts to leverage large-scale…

Information Retrieval · Computer Science 2021-02-23 Chaojun Xiao , Ruobing Xie , Yuan Yao , Zhiyuan Liu , Maosong Sun , Xu Zhang , Leyu Lin

Multimodal learning has mainly focused on learning large models on, and fusing feature representations from, different modalities for better performances on downstream tasks. In this work, we take a detour from this trend and study the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Yifeng Shi , Marc Niethammer

Although existing multimodal recommendation models have shown promising performance, their effectiveness continues to be limited by the pervasive data sparsity problem. This problem arises because users typically interact with only a small…

Information Retrieval · Computer Science 2025-12-10 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Zitong Wan , Hewei Wang , Weijie Liu , Yijie Li , Edith C. H. Ngai

The heterogeneity-gap between different modalities brings a significant challenge to multimedia information retrieval. Some studies formalize the cross-modal retrieval tasks as a ranking problem and learn a shared multi-modal embedding…

Machine Learning · Computer Science 2017-07-11 Minnan Luo , Xiaojun Chang , Zhihui Li , Liqiang Nie , Alexander G. Hauptmann , Qinghua Zheng

For modern recommender systems, the use of low-dimensional latent representations to embed users and items based on their observed interactions has become commonplace. However, many existing recommendation models are primarily designed for…

Information Retrieval · Computer Science 2024-12-30 Lianghao Xia , Meiyan Xie , Yong Xu , Chao Huang

Existing vehicle trajectory prediction models struggle with generalizability, prediction uncertainties, and handling complex interactions. It is often due to limitations like complex architectures customized for a specific dataset and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Kaouther Messaoud , Matthieu Cord , Alexandre Alahi

In recommender systems, models mostly use a combination of embedding layers and multilayer feedforward neural networks. The high-dimensional sparse original features are downscaled in the embedding layer and then fed into the fully…

Information Retrieval · Computer Science 2022-05-19 Mohan Hasama , Jing Li

Neural network approaches in recommender systems have shown remarkable success by representing a large set of items as a learnable vector embedding table. However, infrequent items may suffer from inadequate training opportunities, making…

Information Retrieval · Computer Science 2023-12-12 Jinseok Seol , Minseok Gang , Sang-goo Lee , Jaehui Park

Graph Neural Networks (GNNs) have been emerging as a promising method for relational representation including recommender systems. However, various challenging issues of social graphs hinder the practical usage of GNNs for social…

Social and Information Networks · Computer Science 2019-08-08 Kyung-Min Kim , Donghyun Kwak , Hanock Kwak , Young-Jin Park , Sangkwon Sim , Jae-Han Cho , Minkyu Kim , Jihun Kwon , Nako Sung , Jung-Woo Ha

Recently, real-world recommendation systems need to deal with millions of candidates. It is extremely challenging to conduct sophisticated end-to-end algorithms on the entire corpus due to the tremendous computation costs. Therefore,…

Information Retrieval · Computer Science 2021-10-15 Ruobing Xie , Qi Liu , Shukai Liu , Ziwei Zhang , Peng Cui , Bo Zhang , Leyu Lin

For multimodal tasks, a good feature extraction network should extract information as much as possible and ensure that the extracted feature embedding and other modal feature embedding have an excellent mutual understanding. The latter is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jianning Wu , Zhuqing Jiang , Shiping Wen , Aidong Men , Haiying Wang

Many real-world problems are inherently multimodal, from spoken language, gestures, and paralinguistics humans use to communicate, to force, proprioception, and visual sensors on robots. While there has been an explosion of interest in…

Cancer survival prediction requires integrating pathological Whole Slide Images (WSIs) and genomic profiles, a challenging task due to the inherent heterogeneity and the complexity of modeling both inter- and intra-modality interactions.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Mingxin Liu , Chengfei Cai , Jun Li , Pengbo Xu , Jinze Li , Jiquan Ma , Jun Xu

Multimodal recommendation aims to enhance user preference modeling by leveraging rich item content such as images and text. Yet dominant systems fuse modalities in the spatial domain, obscuring the frequency structure of signals and…

Information Retrieval · Computer Science 2026-02-02 Wei Yang , Rui Zhong , Yiqun Chen , Shixuan Li , Heng Ping , Chi Lu , Peng Jiang

This study focuses on the problem of path modeling in heterogeneous information networks and proposes a multi-hop path-aware recommendation framework. The method centers on multi-hop paths composed of various types of entities and…

Information Retrieval · Computer Science 2025-05-12 Hongye Zheng , Yue Xing , Lipeng Zhu , Xu Han , Junliang Du , Wanyu Cui