English
Related papers

Related papers: Adaptive Multi-Modalities Fusion in Sequential Rec…

200 papers

Multimedia recommendation has received much attention in recent years. It models user preferences based on both behavior information and item multimodal information. Though current GCN-based methods achieve notable success, they suffer from…

Information Retrieval · Computer Science 2023-08-08 Penghang Yu , Zhiyi Tan , Guanming Lu , Bing-Kun Bao

Super-resolution (SR) is a severely ill-posed problem with inherent ambiguity, as widely recognized in both empirical and theoretical studies. Although recent semantic-guided and multi-modal SR methods exploit large models or external…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Jinyi Luo , Minghao Liu , Yifan Li , Zejia Fan , Jiaying Liu

Sequential recommender systems rank relevant items by modeling a user's interaction history and computing the inner product between the resulting user representation and stored item embeddings. To avoid the significant memory overhead of…

Multimodal recommender systems improve the performance of canonical recommender systems with no item features by utilizing diverse content types such as text, images, and videos, while alleviating inherent sparsity of user-item interactions…

Information Retrieval · Computer Science 2026-03-25 Yu-Seung Roh , Joo-Young Kim , Jin-Duk Park , Won-Yong Shin

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang

The online emergence of multi-modal sharing platforms (eg, TikTok, Youtube) is powering personalized recommender systems to incorporate various modalities (eg, visual, textual and acoustic) into the latent user representations. While…

Information Retrieval · Computer Science 2023-07-19 Wei Wei , Chao Huang , Lianghao Xia , Chuxu Zhang

Modeling the sequential correlation of users' historical interactions is essential in sequential recommendation. However, the majority of the approaches mainly focus on modeling the \emph{intra-sequence} item correlation within each…

Information Retrieval · Computer Science 2020-04-30 Feng Liu , Weiwen Liu , Xutao Li , Yunming Ye

In late fusion, each modality is processed in a separate unimodal Convolutional Neural Network (CNN) stream and the scores of each modality are fused at the end. Due to its simplicity late fusion is still the predominant approach in many…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Hamid Reza Vaezi Joze , Amirreza Shaban , Michael L. Iuzzolino , Kazuhito Koishida

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving recommendation…

Information Retrieval · Computer Science 2024-03-01 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Edith C. -H. Ngai

Sequential recommendation aims at identifying the next item that is preferred by a user based on their behavioral history. Compared to conventional sequential models that leverage attention mechanisms and RNNs, recent efforts mainly follow…

Information Retrieval · Computer Science 2022-05-04 Yu Tian , Jianxin Chang , Yannan Niu , Yang Song , Chenliang Li

The inevitable modality imperfection in real-world scenarios poses significant challenges for Multimodal Sentiment Analysis (MSA). While existing methods tailor reconstruction or joint representation learning strategies to restore missing…

Multimedia · Computer Science 2025-08-05 Hu Zhangfeng , Shi mengxin

Sequential recommendation has become increasingly prominent in both academia and industry, particularly in e-commerce. The primary goal is to extract user preferences from historical interaction sequences and predict items a user is likely…

Information Retrieval · Computer Science 2026-04-16 Xiaofan Zhou , Kyumin Lee

Modern Sequential Recommendation (SR) models commonly utilize modality features to represent items, motivated in large part by recent advancements in language and vision modeling. To do so, several works completely replace ID embeddings…

Machine Learning · Computer Science 2026-01-06 Liam Collins , Bhuvesh Kumar , Clark Mingxuan Ju , Tong Zhao , Donald Loveland , Leonardo Neves , Neil Shah

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these advances, existing…

Information Retrieval · Computer Science 2025-08-25 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Yongjie Wang , Dusit Niyato , Zhiqi Shen

Generative recommendation systems have achieved significant advances by leveraging semantic IDs to represent items. However, existing approaches that tokenize each modality independently face two critical limitations: (1) redundancy across…

Information Retrieval · Computer Science 2026-01-14 Haven Kim , Yupeng Hou , Julian McAuley

Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal fused representations. Existing approaches typically adopt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dingkang Yang , Mingcheng Li , Xuecheng Wu , Zhaoyu Chen , Kaixun Jiang , Keliang Liu , Peng Zhai , Lihua Zhang

Multimodal change detection (MMCD) identifies changed areas in multimodal remote sensing (RS) data, demonstrating significant application value in land use monitoring, disaster assessment, and urban sustainable development. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Xuanguang Liu , Lei Ding , Yujie Li , Chenguang Dai , Zhenchao Zhang , Mengmeng Li , Ziyi Yang , Yifan Sun , Yongqi Sun , Hanyun Wang

This study presents a novel Multi-Modal Graph Neural Network (MM-GNN) framework for socially aware music recommendation, designed to enhance personalization and foster community-based engagement. The proposed model introduces a fusion-free…

Information Retrieval · Computer Science 2025-11-11 Kajwan Ziaoddini

Multimodal Emotion Recognition (MER) aims to perceive human emotions through three modes: language, vision, and audio. Previous methods primarily focused on modal fusion without adequately addressing significant distributional differences…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jichao Zhu , Jun Yu

Recent advances in Large Language Models (LLMs) have demonstrated significant potential in the field of Recommendation Systems (RSs). Most existing studies have focused on converting user behavior logs into textual prompts and leveraging…

Information Retrieval · Computer Science 2025-01-14 Yuyang Ye , Zhi Zheng , Yishan Shen , Tianshu Wang , Hengruo Zhang , Peijun Zhu , Runlong Yu , Kai Zhang , Hui Xiong