English
Related papers

Related papers: AlignRec: Aligning and Training in Multimodal Reco…

200 papers

User interest modeling is critical for personalized news recommendation. Existing news recommendation methods usually learn a single user embedding for each user from their previous behaviors to represent their overall interest. However,…

Information Retrieval · Computer Science 2021-06-09 Tao Qi , Fangzhao Wu , Chuhan Wu , Peiru Yang , Yang Yu , Xing Xie , Yongfeng Huang

Multimodal learning plays a critical role in e-commerce recommendation platforms today, enabling accurate recommendations and product understanding. However, existing vision-language models, such as CLIP, face key challenges in e-commerce…

Information Retrieval · Computer Science 2025-07-24 Ramin Giahi , Kehui Yao , Sriram Kollipara , Kai Zhao , Vahid Mirjalili , Jianpeng Xu , Topojoy Biswas , Evren Korpeoglu , Kannan Achan

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Existing works based on molecular knowledge neglect the 3D geometric structure of molecules and fail to learn the high-dimensional information of medications, leading to structural confusion. Additionally, it does not extract key…

Machine Learning · Computer Science 2024-11-13 Shi Mu , Chen Li , Xiang Li , Shunpan Liang

In recommendation systems, predicting Click-Through Rate (CTR) is crucial for accurately matching users with items. To improve recommendation performance for cold-start and long-tail items, recent studies focus on leveraging item multimodal…

Information Retrieval · Computer Science 2025-08-05 Yining Yao , Ziwei Li , Shuwen Xiao , Boya Du , Jialin Zhu , Junjun Zheng , Xiangheng Kong , Yuning Jiang

Recommendation systems have been essential for both user experience and platform efficiency by alleviating information overload and supporting decision-making. Traditional methods, i.e., content-based filtering, collaborative filtering, and…

Information Retrieval · Computer Science 2025-08-22 Lining Chen , Qingwen Zeng , Huaming Chen

With the rapid advancement of text-to-image (T2I) generation models, assessing the semantic alignment between generated images and text descriptions has become a significant research challenge. Current methods, including those based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Xinli Yue , JianHui Sun , Junda Lu , Liangchao Yao , Fan Xia , Tianyi Wang , Fengyun Rao , Jing Lyu , Yuetang Deng

Large foundational models, through upstream pre-training and downstream fine-tuning, have achieved immense success in the broad AI community due to improved model performance and significant reductions in repetitive engineering. By…

Information Retrieval · Computer Science 2024-03-19 Jiaqi Zhang , Yu Cheng , Yongxin Ni , Yunzhu Pan , Zheng Yuan , Junchen Fu , Youhua Li , Jie Wang , Fajie Yuan

Recommender systems aim to provide personalized item recommendations by capturing user behaviors derived from their interaction history. Considering that user interactions naturally occur sequentially based on users' intents in mind, user…

Information Retrieval · Computer Science 2025-01-14 Yijin Choi , Chiehyeon Lim

With the rapid expansion of user bases on short video platforms, personalized recommendation systems are playing an increasingly critical role in enhancing user experience and optimizing content distribution. Traditional interest modeling…

Information Retrieval · Computer Science 2025-09-08 Yushang Zhao , Yike Peng , Li Zhang , Qianyi Sun , Zhihui Zhang , Yingying Zhuang

Generative Recommendation (GenRec) models reformulate recommendation as a sequence generation task, representing items as discrete Semantic IDs used symmetrically as both inputs and prediction targets. We identify a critical dual-stage…

Information Retrieval · Computer Science 2026-05-15 Bin Huang , Xin Wang , Junwei Pan , Yongqi Zhou , Yifeng Zhou , Zhixiang Feng , Shudong Huang , Haijie Gu , Wenwu Zhu

Modern recommendation systems involve massive catalogs of multimodal items, where scalable item identification must balance compactness, semantic fidelity, and downstream effectiveness. Semantic IDs (SIDs) address this need by representing…

Information Retrieval · Computer Science 2026-04-28 Yongsen Pan , Yuxin Chen , Zheng Hu , Xu Yuan , Daoyuan Wang , Yuting Yin , Songhao Ni , Hongyang Wang , Jun Wang , Fuji Ren , Wenwu Ou

Fairness in recommendation has attracted increasing attention due to bias and discrimination possibly caused by traditional recommenders. In Interactive Recommender Systems (IRS), user preferences and the system's fairness status are…

Information Retrieval · Computer Science 2021-06-28 Weiwen Liu , Feng Liu , Ruiming Tang , Ben Liao , Guangyong Chen , Pheng Ann Heng

The fine-grained attribute descriptions can significantly supplement the valuable semantic information for person image, which is vital to the success of person re-identification (ReID) task. However, current ReID algorithms typically…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Yajing Zhai , Yawen Zeng , Zhiyong Huang , Zheng Qin , Xin Jin , Da Cao

Emerging research in Pluralistic Artificial Intelligence (AI) alignment seeks to address how intelligent systems can be designed and deployed in accordance with diverse human needs and values. We contribute to this pursuit with a dynamic…

Machine Learning · Computer Science 2024-11-01 Hadassah Harland , Richard Dazeley , Peter Vamplew , Hashini Senaratne , Bahareh Nakisa , Francisco Cruz

Text-based recommendation holds a wide range of practical applications due to its versatility, as textual descriptions can represent nearly any type of item. However, directly employing the original item descriptions may not yield optimal…

Computation and Language · Computer Science 2024-04-03 Hanjia Lyu , Song Jiang , Hanqing Zeng , Yinglong Xia , Qifan Wang , Si Zhang , Ren Chen , Christopher Leung , Jiajie Tang , Jiebo Luo

Learning the user-item relevance hidden in implicit feedback data plays an important role in modern recommender systems. Neural sequential recommendation models, which formulates learning the user-item relevance as a sequential…

Information Retrieval · Computer Science 2022-03-01 Jingwei Zhuo , Bin Liu , Xiang Li , Han Zhu , Xiaoqiang Zhu

Recommendation models are predominantly trained using implicit user feedback, since explicit feedback is often costly to obtain. However, implicit feedback, such as clicks, does not always reflect users' real preferences. For example, a…

Information Retrieval · Computer Science 2025-10-06 Mengchen Zhao , Yifan Gao , Yaqing Hou , Xiangyang Li , Pengjie Gu , Zhenhua Dong , Ruiming Tang , Yi Cai

Multimodal representation learning harmonizes distinct modalities by aligning them into a unified latent space. Recent research generalizes traditional cross-modal alignment to produce enhanced multimodal synergy but requires all modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xiaohao Liu , Xiaobo Xia , Jiaheng Wei , Shuo Yang , Xiu Su , See-Kiong Ng , Tat-Seng Chua

Generative recommendation aims to learn the underlying generative process over the entire item set to produce recommendations for users. Although it leverages non-linear probabilistic models to surpass the limited modeling capacity of…

Information Retrieval · Computer Science 2025-04-24 Yi Zhang , Yiwen Zhang , Yu Wang , Tong Chen , Hongzhi Yin