English
Related papers

Related papers: Multimodality Invariant Learning for Multimedia-Ba…

200 papers

In this paper, we focus on multimedia recommender systems using graph convolutional networks (GCNs) where the multimodal features as well as user-item interactions are employed together. Our study aims to exploit multimodal features more…

Information Retrieval · Computer Science 2023-12-18 Yungi Kim , Taeri Kim , Won-Yong Shin , Sang-Wook Kim

Accurate prediction of users' responses to items is one of the main aims of many computational advising applications. Examples include recommending movies, news articles, songs, jobs, clothes, books and so forth. Accurate prediction of…

Applications · Statistics 2022-12-20 Baode Gao , Guangpeng Zhan , Hanzhang Wang , Yiming Wang , Shengxin Zhu

Multimedia recommender systems suggest media items, e.g., songs, (digital) books and movies, to users by utilizing concepts of traditional recommender systems such as collaborative filtering. In this paper, we investigate a potential issue…

Information Retrieval · Computer Science 2022-03-02 Dominik Kowald , Emanuel Lacic

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

Recent advances in multimodal recommendation (MMR) highlight the potential of integrating visual and textual content to enrich item representations. However, existing methods often rely on coarse visual features and naive fusion strategies,…

Information Retrieval · Computer Science 2025-11-11 Hai-Dang Kieu , Min Xu , Thanh Trung Huynh , Dung D. Le

ID-based Recommender Systems (RecSys), where each item is assigned a unique identifier and subsequently converted into an embedding vector, have dominated the designing of RecSys. Though prevalent, such ID-based paradigm is not suitable for…

Information Retrieval · Computer Science 2023-12-19 Youhua Li , Hanwen Du , Yongxin Ni , Pengpeng Zhao , Qi Guo , Fajie Yuan , Xiaofang Zhou

Building a scalable and real-time recommendation system is vital for many businesses driven by time-sensitive customer feedback, such as short-videos ranking or online ads. Despite the ubiquitous adoption of production-scale deep learning…

Information Retrieval · Computer Science 2022-09-29 Zhuoran Liu , Leqi Zou , Xuan Zou , Caihua Wang , Biao Zhang , Da Tang , Bolin Zhu , Yijie Zhu , Peng Wu , Ke Wang , Youlong Cheng

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Addressing the challenges related to data sparsity, cold-start problems, and diversity in recommendation systems is both crucial and demanding. Many current solutions leverage knowledge graphs to tackle these issues by combining both…

Information Retrieval · Computer Science 2024-03-28 Yejin Kim , Scott Rome , Kevin Foley , Mayur Nankani , Rimon Melamed , Javier Morales , Abhay Yadav , Maria Peifer , Sardar Hamidian , H. Howie Huang

Cold-start item recommendation is a long-standing challenge in recommendation systems. A common remedy is to use a content-based approach, but rich information from raw contents in various forms has not been fully utilized. In this paper,…

Information Retrieval · Computer Science 2024-04-23 Jooeun Kim , Jinri Kim , Kwangeun Yeo , Eungi Kim , Kyoung-Woon On , Jonghwan Mun , Joonseok Lee

Recommendation models that utilize unique identities (IDs) to represent distinct users and items have been state-of-the-art (SOTA) and dominated the recommender systems (RS) literature for over a decade. Meanwhile, the pre-trained modality…

Information Retrieval · Computer Science 2023-05-04 Zheng Yuan , Fajie Yuan , Yu Song , Youhua Li , Junchen Fu , Fei Yang , Yunzhu Pan , Yongxin Ni

Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and collaborative filtering. Following the convention of RS, existing practices exploit…

Information Retrieval · Computer Science 2024-09-04 Shilong Bao , Qianqian Xu , Zhiyong Yang , Yuan He , Xiaochun Cao , Qingming Huang

The problem of missing modalities is both critical and non-trivial to be handled in multi-modal models. It is common for multi-modal tasks that certain modalities contribute more compared to other modalities, and if those important…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Hu Wang , Congbo Ma , Jianpeng Zhang , Yuan Zhang , Jodie Avery , Louise Hull , Gustavo Carneiro

In recent years, multimodal recommendation has received significant attention and achieved remarkable success in GCN-based recommendation methods. However, there are two key challenges here: (1) There is a significant amount of redundant…

Information Retrieval · Computer Science 2026-04-07 Xiangchen Pan , Wei Wei

Recently, prompt learning has garnered considerable attention for its success in various Vision-Language (VL) tasks. However, existing prompt-based models are primarily focused on studying prompt generation and prompt strategies with…

Artificial Intelligence · Computer Science 2024-09-10 Ruiting Dai , Yuqiao Tan , Lisi Mo , Tao He , Ke Qin , Shuang Liang

Multimodal recommendation has emerged as an effective paradigm for enhancing collaborative filtering by incorporating heterogeneous content modalities. Existing multimodal recommenders predominantly focus on reinforcing cross-modal…

Information Retrieval · Computer Science 2026-03-03 Hao Zhan , Yihui Wang , Yonghui Yang , Danyang Yue , Yu Wang , Pengyang Shao , Fei Shen , Fei Liu , Le Wu

Missing-modality information on e-commerce platforms, such as absent product images or textual descriptions, often arises from annotation errors or incomplete metadata, impairing both product presentation and downstream applications such as…

Multimedia · Computer Science 2026-01-29 Junchen Fu , Wenhao Deng , Kaiwen Zheng , Ioannis Arapakis , Yu Ye , Yongxin Ni , Joemon M. Jose , Xuri Ge

Group recommendation provides personalized recommendations to a group of users based on their shared interests, preferences, and characteristics. Current studies have explored different methods for integrating individual preferences and…

Information Retrieval · Computer Science 2023-08-09 Jianye Ji , Jiayan Pei , Shaochuan Lin , Taotao Zhou , Hengxu He , Jia Jia , Ning Hu

In a variety of online settings involving interaction with end-users it is critical for the systems to adapt to changes in user preferences. User preferences on items tend to change over time due to a variety of factors such as change in…

Information Retrieval · Computer Science 2019-05-17 Farzad Eskandanian , Bamshad Mobasher

Multi-modal learning has achieved remarkable success by integrating information from various modalities, achieving superior performance in tasks like recognition and retrieval compared to uni-modal approaches. However, real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaohao Liu , Xiaobo Xia , Zhuo Huang , See-Kiong Ng , Tat-Seng Chua