English
Related papers

Related papers: Multi-modal Relational Item Representation Learnin…

200 papers

Learning from multimodal datasets can leverage complementary information and improve performance in prediction tasks. A commonly used strategy to account for feature correlations in high-dimensional datasets is the latent variable approach.…

Machine Learning · Computer Science 2024-10-01 Lingchao Mao , Qi wang , Yi Su , Fleming Lure , Jing Li

Self-supervised cross-modal super-resolution (SR) can overcome the difficulty of acquiring paired training data, but is challenging because only low-resolution (LR) source and high-resolution (HR) guide images from different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xiaoyu Dong , Naoto Yokoya , Longguang Wang , Tatsumi Uezato

Recently, relational metric learning methods have been received great attention in recommendation community, which is inspired by the translation mechanism in knowledge graph. Different from the knowledge graph where the entity-to-entity…

Information Retrieval · Computer Science 2024-06-18 Mingming Li , Fuqing Zhu , Feng Yuan , Songlin Hu

Session-based recommendation techniques aim to capture dynamic user behavior by analyzing past interactions. However, existing methods heavily rely on historical item ID sequences to extract user preferences, leading to challenges such as…

Information Retrieval · Computer Science 2023-07-21 Zhipeng Zhang , Piao Tong , Yingwei Ma , Qiao Liu , Xujiang Liu , Xu Luo

Multi-modal recommender system focuses on utilizing rich modal information ( i.e., images and textual descriptions) of items to improve recommendation performance. The current methods have achieved remarkable success with the powerful…

Information Retrieval · Computer Science 2025-08-20 Shouxing Ma , Yawen Zeng , Shiqing Wu , Guandong Xu

Learning with noisy labels has become an effective strategy for enhancing the robustness of models, which enables models to better tolerate inaccurate data. Existing methods either focus on optimizing the loss function to mitigate the…

Artificial Intelligence · Computer Science 2024-06-04 Xiaming Che , Junlin Zhang , Zhuang Qi , Xin Qi

A well-designed recommender system can accurately capture the attributes of users and items, reflecting the unique preferences of individuals. Traditional recommendation techniques usually focus on modeling the singular type of behaviors…

Information Retrieval · Computer Science 2023-03-06 Hongrui Xuan , Yi Liu , Bohan Li , Hongzhi Yin

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

Recommender systems are crucial for personalizing user experiences but often depend on implicit feedback data, which can be noisy and misleading. Existing denoising studies involve incorporating auxiliary information or learning strategies…

Information Retrieval · Computer Science 2025-02-14 Shuyao Wang , Zhi Zheng , Yongduo Sui , Hui Xiong

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Explainability and effectiveness are two key aspects for building recommender systems. Prior efforts mostly focus on incorporating side information to achieve better recommendation performance. However, these methods have some weaknesses:…

Information Retrieval · Computer Science 2019-03-12 Weizhi Ma , Min Zhang , Yue Cao , Woojeong , Jin , Chenyang Wang , Yiqun Liu , Shaoping Ma , Xiang Ren

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

To offer accurate and diverse recommendation services, recent methods use auxiliary information to foster the learning process of user and item representations. Many SOTA methods fuse different sources of information (user, item, knowledge…

Information Retrieval · Computer Science 2022-11-14 Haolun Wu , Yingxue Zhang , Chen Ma , Wei Guo , Ruiming Tang , Xue Liu , Mark Coates

Sequential recommender systems predict items that may interest users by modeling their preferences based on historical interactions. Traditional sequential recommendation methods rely on capturing implicit collaborative filtering signals…

Information Retrieval · Computer Science 2024-03-28 Shenghao Yang , Weizhi Ma , Peijie Sun , Qingyao Ai , Yiqun Liu , Mingchen Cai , Min Zhang

Representation Learning is a significant and challenging task in multimodal learning. Effective modality representations should contain two parts of characteristics: the consistency and the difference. Due to the unified multimodal…

Computation and Language · Computer Science 2021-02-10 Wenmeng Yu , Hua Xu , Ziqi Yuan , Jiele Wu

Sequential Recommender Systems (SRS), which model a user's interaction history to predict the next item of interest, are widely used in various applications. However, existing SRS often struggle with low-popularity items, a challenge known…

Information Retrieval · Computer Science 2024-12-24 Qidong Liu , Xian Wu , Wanyu Wang , Yejing Wang , Yuanshao Zhu , Xiangyu Zhao , Feng Tian , Yefeng Zheng

The increasing availability and diversity of multimodal data in recommender systems offer new avenues for enhancing recommendation accuracy and user satisfaction. However, these systems must contend with high-dimensional, sparse user-item…

Information Retrieval · Computer Science 2024-12-04 Yasser Khalafaoui , Martino Lovisetto , Basarab Matei , Nistor Grozavu

We propose a visual-linguistic representation learning approach within a self-supervised learning framework by introducing a new operation, loss, and data augmentation strategy. First, we generate diverse features for the image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jaeyoo Park , Bohyung Han

With the rapid advancement of e-commerce, exploring general representations rather than task-specific ones has attracted increasing research attention. For product understanding, although existing discriminative dual-flow architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Daoze Zhang , Chenghan Fu , Zhanheng Nie , Jianyu Liu , Wanxian Guan , Yuan Gao , Jun Song , Pengjie Wang , Jian Xu , Bo Zheng

Multimodal sentiment analysis (MSA) identifies individuals' sentiment states in videos by integrating visual, audio, and text modalities. Despite progress in existing methods, the inherent modality heterogeneity limits the effective capture…

Machine Learning · Computer Science 2025-12-19 Shanmin Wang , Chengguang Liu , Qingshan Liu