English
Related papers

Related papers: Disentangled Multimodal Representation Learning fo…

200 papers

Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However,…

Information Retrieval · Computer Science 2026-01-27 Yuzhuo Dang , Xin Zhang , Zhiqiang Pan , Yuxiao Duan , Wanyu Chen , Fei Cai , Honghui Chen

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and Collaborative Filtering. Following the convention of RS, existing methods exploit…

Information Retrieval · Computer Science 2022-10-03 Shilong Bao , Qianqian Xu , Zhiyong Yang , Yuan He , Xiaochun Cao , Qingming Huang

Ophthalmologists typically require multimodal data sources to improve diagnostic accuracy in clinical decisions. However, due to medical device shortages, low-quality data and data privacy concerns, missing data modalities are common in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Chengzhi Liu , Zile Huang , Zhe Chen , Feilong Tang , Yu Tian , Zhongxing Xu , Zihong Luo , Yalin Zheng , Yanda Meng

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

Relevant recommendation is a special recommendation scenario which provides relevant items when users express interests on one target item (e.g., click, like and purchase). Besides considering the relevance between recommendations and…

Information Retrieval · Computer Science 2022-06-13 Zihan Lin , Hui Wang , Jingshu Mao , Wayne Xin Zhao , Cheng Wang , Peng Jiang , Ji-Rong Wen

Multiple clustering has gathered significant attention in recent years due to its potential to reveal multiple hidden structures of the data from different perspectives. Most of multiple clustering methods first derive feature…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Jiawei Yao , Juhua Hu

People usually have different intents for choosing items, while their preferences under the same intent may also different. In traditional collaborative filtering approaches, both intent and preference factors are usually entangled in the…

Information Retrieval · Computer Science 2023-05-19 Chao Wang , Hengshu Zhu , Dazhong Shen , Wei wu , Hui Xiong

While recommender systems with multi-modal item representations (image, audio, and text), have been widely explored, learning recommendations from multi-modal user interactions (e.g., clicks and speech) remains an open problem. We study the…

Information Retrieval · Computer Science 2024-05-08 Simone Borg Bruun , Krisztian Balog , Maria Maistro

Multimodal emotion recognition (MMER) is an active research field that aims to accurately recognize human emotions by fusing multiple perceptual modalities. However, inherent heterogeneity across modalities introduces distribution gaps and…

Sound · Computer Science 2023-12-22 Haoqin Sun , Shiwan Zhao , Xuechen Wang , Wenjia Zeng , Yong Chen , Yong Qin

Session-based recommendation aims to predict intents of anonymous users based on their limited behaviors. Modeling user behaviors involves two distinct rationales: co-occurrence patterns reflected by item IDs, and fine-grained preferences…

Information Retrieval · Computer Science 2024-04-22 Xiaokun Zhang , Bo Xu , Zhaochun Ren , Xiaochen Wang , Hongfei Lin , Fenglong Ma

In a practical recommender system, new interactions are continuously observed. Some interactions are expected, because they largely follow users' long-term preferences. Some other interactions are indications of recent trends in user…

Information Retrieval · Computer Science 2023-05-08 Yitong Ji , Aixin Sun , Jie Zhang

Multimodal Sentiment Analysis (MSA) leverages heterogeneous modalities, such as language, vision, and audio, to enhance the understanding of human sentiment. While existing models often focus on extracting shared information across…

Machine Learning · Computer Science 2025-04-10 Pan Wang , Qiang Zhou , Yawen Wu , Tianlong Chen , Jingtong Hu

Modern industrial recommendation systems improve recommendation performance by integrating multimodal representations from pre-trained models into ID-based Click-Through Rate (CTR) prediction frameworks. However, existing approaches…

Information Retrieval · Computer Science 2026-04-17 Alin Fan , Hanqing Li , Sihan Lu , Jingsong Yuan , Jiandong Zhang

Multimodal recommendation systems integrate diverse multimodal information into the feature representations of both items and users, thereby enabling a more comprehensive modeling of user preferences. However, existing methods are hindered…

Multimedia · Computer Science 2025-01-03 Qiya Song , Jiajun Hu , Lin Xiao , Bin Sun , Xieping Gao , Shutao Li

Item representations in recommendation systems are expected to reveal the properties of items. Collaborative recommender methods usually represent an item as one single latent vector. Nowadays the e-commercial platforms provide various…

Information Retrieval · Computer Science 2021-04-02 Zeyu Cui , Feng Yu , Shu Wu , Qiang Liu , Liang Wang

Interactive recommendation that models the explicit interactions between users and the recommender system has attracted a lot of research attentions in recent years. Most previous interactive recommendation systems only focus on optimizing…

Information Retrieval · Computer Science 2019-03-20 Yong Liu , Yinan Zhang , Qiong Wu , Chunyan Miao , Lizhen Cui , Binqiang Zhao , Yin Zhao , Lu Guan

A well-designed recommender system can accurately capture the attributes of users and items, reflecting the unique preferences of individuals. Traditional recommendation techniques usually focus on modeling the singular type of behaviors…

Information Retrieval · Computer Science 2023-03-06 Hongrui Xuan , Yi Liu , Bohan Li , Hongzhi Yin

Recommender systems aim to recommend new items to users by learning user and item representations. In practice, these representations are highly entangled as they consist of information about multiple factors, including user's interests,…

Information Retrieval · Computer Science 2022-04-18 Paras Sheth , Ruocheng Guo , Lu Cheng , Huan Liu , K. Selçuk Candan

There is a rapidly-growing research interest in engaging users with multi-modal data for accurate user modeling on recommender systems. Existing multimedia recommenders have achieved substantial improvements by incorporating various…

Information Retrieval · Computer Science 2023-05-04 Dong Yao , Shengyu Zhang , Zhou Zhao , Jieming Zhu , Wenqiao Zhang , Rui Zhang , Xiaofei He , Fei Wu