English
Related papers

Related papers: STAIR: Manipulating Collaborative and Multimodal I…

200 papers

Multi-modal object Re-Identification (ReID) aims to exploit complementary information from different modalities to retrieve specific objects. However, existing methods often rely on hard token filtering or simple fusion strategies, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xingguo Xu , Zhanyu Liu , Weixiang Zhou , Yuansheng Gao , Junjie Cao , Yuhao Wang , Jixiang Luo , Dell Zhang

Recommender systems (RSs) offer personalized navigation experiences on online platforms, but recommendation remains a challenging task, particularly in specific scenarios and domains. Multimodality can help tap into richer information…

The WWW 2025 EReL@MIR Workshop Multimodal CTR Prediction Challenge focuses on effectively applying multimodal embedding features to improve click-through rate (CTR) prediction in recommender systems. This technical report presents our…

Information Retrieval · Computer Science 2025-05-07 Junwei Xu , Zehao Zhao , Xiaoyu Hu , Zhenjie Song

\textit{Knowledge-aware} recommendation methods (KGR) based on \textit{graph neural networks} (GNNs) and \textit{contrastive learning} (CL) have achieved promising performance. However, they fall short in modeling fine-grained user…

Information Retrieval · Computer Science 2024-03-26 Taotian Pang , Xingyu Lou , Fei Zhao , Zhen Wu , Kuiyao Dong , Qiuying Peng , Yue Qi , Xinyu Dai

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang

Recommender systems are essential for modern content platforms, yet traditional behavior-based models often struggle with cold users who have limited interaction data. Engaging these users is crucial for platform growth. To bridge this gap,…

Information Retrieval · Computer Science 2025-10-13 Lin Wang , Weisong Wang , Xuanji Xiao , Qing Li

User interaction data in recommender systems is a form of dyadic relation that reflects the preferences of users with items. Learning the representations of these two discrete sets of objects, users and items, is critical for…

Information Retrieval · Computer Science 2023-02-10 Hongyu Zhou , Xin Zhou , Lingzi Zhang , Zhiqi Shen

Collaborative recommendation is an information-filtering technique that attempts to present information items (movies, music, books, news, images, Web pages, etc.) that are likely of interest to the Internet user. Traditionally,…

Machine Learning · Statistics 2009-10-14 Gérard Biau , Benoit Cadre , Laurent Rouvière

Each year, multi-modal interaction continues to grow within both industry and academia. However, researchers have yet to fully explore the impact of multi-modal systems on learning and memory retention. This research investigates how…

Human-Computer Interaction · Computer Science 2025-09-09 Omar Elgohary , Zhu-Tien

The rapid expansion of online fashion platforms has created an increasing demand for intelligent recommender systems capable of understanding both visual and textual cues. This paper proposes a hybrid multimodal deep learning framework for…

Information Retrieval · Computer Science 2025-11-20 Kamand Kalashi , Babak Teimourpour

Modern recommendation systems involve massive catalogs of multimodal items, where scalable item identification must balance compactness, semantic fidelity, and downstream effectiveness. Semantic IDs (SIDs) address this need by representing…

Information Retrieval · Computer Science 2026-04-28 Yongsen Pan , Yuxin Chen , Zheng Hu , Xu Yuan , Daoyuan Wang , Yuting Yin , Songhao Ni , Hongyang Wang , Jun Wang , Fuji Ren , Wenwu Ou

Class-incremental learning (CIL) requires models to learn new classes sequentially while preserving prior knowledge. Recently, approaches that combine pre-trained models with mixture-of-experts (MoE) have received increasing attention in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zirui Guo , Quan Cheng , Da-Wei Zhou , Lijun Zhang

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

The increasing availability and diversity of multimodal data in recommender systems offer new avenues for enhancing recommendation accuracy and user satisfaction. However, these systems must contend with high-dimensional, sparse user-item…

Information Retrieval · Computer Science 2024-12-04 Yasser Khalafaoui , Martino Lovisetto , Basarab Matei , Nistor Grozavu

Generative recommendation models often struggle with two key challenges: (1) the superficial integration of collaborative signals, and (2) the decoupled fusion of multimodal features. These limitations hinder the creation of a truly…

Information Retrieval · Computer Science 2025-12-29 Yuzhen Lin , Hongyi Chen , Xuanjing Chen , Shaowen Wang , Ivonne Xu , Dongming Jiang

Side information of items, e.g., images and text description, has shown to be effective in contributing to accurate recommendations. Inspired by the recent success of pre-training models on natural language and images, we propose a…

Information Retrieval · Computer Science 2021-01-08 Yong Liu , Susen Yang , Chenyi Lei , Guoxin Wang , Haihong Tang , Juyong Zhang , Aixin Sun , Chunyan Miao

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

The bilinear method is mainstream in Knowledge Graph Embedding (KGE), aiming to learn low-dimensional representations for entities and relations in Knowledge Graph (KG) and complete missing links. Most of the existing works are to find…

Machine Learning · Computer Science 2022-02-16 Jiayi Li , Yujiu Yang

In multimodal land cover classification (MLCC), a common challenge is the redundancy in data distribution, where irrelevant information from multiple modalities can hinder the effective integration of their unique features. To tackle this,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jiaqing Zhang , Jie Lei , Weiying Xie , Geng Yang , Daixun Li , Yunsong Li

Integrating diverse data modalities is crucial for enhancing the performance of personalized recommendation systems. Traditional models, which often rely on singular data sources, lack the depth needed to accurately capture the multifaceted…

Information Retrieval · Computer Science 2025-02-18 Luyi Ma , Xiaohan Li , Zezhong Fan , Kai Zhao , Jianpeng Xu , Jason Cho , Praveen Kanumala , Kaushiki Nag , Sushant Kumar , Kannan Achan