English
Related papers

Related papers: STAIR: Manipulating Collaborative and Multimodal I…

200 papers

Designing an effective representation learning method for multimodal sentiment analysis tasks is a crucial research direction. The challenge lies in learning both shared and private information in a complete modal representation, which is…

Computation and Language · Computer Science 2024-03-20 Songning Lai , Jiakang Li , Guinan Guo , Xifeng Hu , Yulong Li , Yuan Tan , Zichen Song , Yutong Liu , Zhaoxia Ren , Chun Wan , Danmin Miao , Zhi Liu

Cross-domain recommendation aims to leverage knowledge from multiple domains to alleviate the data sparsity and cold-start problems in traditional recommender systems. One popular paradigm is to employ overlapping user representations to…

Information Retrieval · Computer Science 2023-01-30 Chuang Zhao , Hongke Zhao , Ming He , Jian Zhang , Jianping Fan

Many multimodal recommender systems have been proposed to exploit the rich side information associated with users or items (e.g., user reviews and item images) for learning better user and item representations to improve the recommendation…

Information Retrieval · Computer Science 2022-10-26 Fan Liu , Huilin Chen , Zhiyong Cheng , Anan Liu , Liqiang Nie , Mohan Kankanhalli

This paper studies recommender systems with knowledge graphs, which can effectively address the problems of data sparsity and cold start. Recently, a variety of methods have been developed for this problem, which generally try to learn…

Information Retrieval · Computer Science 2022-01-10 Weiping Song , Zhijian Duan , Ziqing Yang , Hao Zhu , Ming Zhang , Jian Tang

Multimodal recommendation systems integrate diverse multimodal information into the feature representations of both items and users, thereby enabling a more comprehensive modeling of user preferences. However, existing methods are hindered…

Multimedia · Computer Science 2025-01-03 Qiya Song , Jiajun Hu , Lin Xiao , Bin Sun , Xieping Gao , Shutao Li

Multimodal learning enhances the performance of various machine learning tasks by leveraging complementary information across different modalities. However, existing methods often learn multimodal representations that retain substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tong Zhang , Shu Shen , C. L. Philip Chen

Video-based visible-infrared person re-identification (VVI-ReID) is challenging due to significant modality feature discrepancies. Spatial-temporal information in videos is crucial, but the accuracy of spatial-temporal information is often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Wenjia Jiang , Xiaoke Zhu , Jiakang Gao , Di Liao

In Sequential Recommenders (SR), encoding and utilizing modalities in an end-to-end manner is costly in terms of modality encoder sizes. Two-stage approaches can mitigate such concerns, but they suffer from poor performance due to modality…

Information Retrieval · Computer Science 2024-01-17 Hengchang Hu , Qijiong Liu , Chuang Li , Min-Yen Kan

With the rapid development of mobile Internet and big data, a huge amount of data is generated in the network, but the data that users are really interested in a very small portion. To extract the information that users are interested in…

Information Retrieval · Computer Science 2022-05-09 Bo Liu

Accurately recommending products has long been a subject requiring in-depth research. This study proposes a multimodal paradigm for clothing recommendations. Specifically, it designs a multimodal analysis method that integrates clothing…

Information Retrieval · Computer Science 2024-10-22 Bingjie Huang , Qingyi Lu , Shuaishuai Huang , Xue-she Wang , Haowei Yang

Multimodal data plays a critical role in web-based recommendation systems, where information from diverse modalities such as vision and text enhances representation learning. However, real-world multimodal datasets often suffer from…

Information Retrieval · Computer Science 2026-05-04 Yuan Li , Jun Hu , Jiaxin Jiang , Bryan Hooi , Bingsheng He

The explosion of multimedia data in information-rich environments has intensified the challenges of personalized content discovery, positioning recommendation systems as an essential form of passive data management. Multimodal sequential…

Information Retrieval · Computer Science 2026-03-05 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Yijie Li , Jianheng Tang , Yunhuai Liu , Edith C. H. Ngai

Intelligent recommendation technology has been playing an increasingly important role in various industry applications such as e-commerce product promotion and Internet advertisement display. Besides users' feedbacks (e.g., numerical…

Information Retrieval · Computer Science 2014-07-11 Weike Pan

Multimodal recommender systems utilizing multimodal features (e.g., images and textual descriptions) typically show better recommendation accuracy than general recommendation models based solely on user-item interactions. Generally, prior…

Information Retrieval · Computer Science 2023-08-24 Xin Zhou , Zhiqi Shen

Given the convenience of collecting information through online services, recommender systems now consume large scale data and play a more important role in improving user experience. With the recent emergence of Graph Neural Networks…

Information Retrieval · Computer Science 2020-09-03 Yishi Xu , Yingxue Zhang , Wei Guo , Huifeng Guo , Ruiming Tang , Mark Coates

This paper designs and implements an explainable recommendation model that integrates knowledge graphs with structure-aware attention mechanisms. The model is built on graph neural networks and incorporates a multi-hop neighbor aggregation…

Information Retrieval · Computer Science 2025-10-14 Shuangquan Lyu , Ming Wang , Huajun Zhang , Jiasen Zheng , Junjiang Lin , Xiaoxuan Sun

Although significant achievements have been achieved by recurrent neural network (RNN) based video prediction methods, their performance in datasets with high resolutions is still far from satisfactory because of the information loss…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zheng Chang , Xinfeng Zhang , Shanshe Wang , Siwei Ma , Wen Gao

In sequential recommendation, multi-modal information (e.g., text or image) can provide a more comprehensive view of an item's profile. The optimal stage (early or late) to fuse modality features into item representations is still debated.…

Information Retrieval · Computer Science 2023-08-31 Hengchang Hu , Wei Guo , Yong Liu , Min-Yen Kan

Personalized recommender systems have been widely studied and deployed to reduce information overload and satisfy users' diverse needs. However, conventional recommendation models solely conduct a one-time training-test fashion and can…

Information Retrieval · Computer Science 2023-03-22 Bowei He , Xu He , Yingxue Zhang , Ruiming Tang , Chen Ma

Item representations in recommendation systems are expected to reveal the properties of items. Collaborative recommender methods usually represent an item as one single latent vector. Nowadays the e-commercial platforms provide various…

Information Retrieval · Computer Science 2021-04-02 Zeyu Cui , Feng Yu , Shu Wu , Qiang Liu , Liang Wang