English
Related papers

Related papers: CM$^3$: Calibrating Multimodal Recommendation

200 papers

Recent work has highlighted the centrality of smooth calibration [Kakade and Foster, 2008] as a robust measure of calibration error. We generalize, unify, and extend previous results on smooth calibration, both as a robust calibration…

Machine Learning · Computer Science 2026-03-18 Parikshit Gopalan , Konstantinos Stavropoulos , Kunal Talwar , Pranay Tankala

Preference alignment has become a crucial component in enhancing the performance of Large Language Models (LLMs), yet its impact in Multimodal Large Language Models (MLLMs) remains comparatively underexplored. Similar to language models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Elmira Amirloo , Jean-Philippe Fauconnier , Christoph Roesmann , Christian Kerl , Rinu Boney , Yusu Qian , Zirui Wang , Afshin Dehghan , Yinfei Yang , Zhe Gan , Peter Grasch

Multimodal representation learning seeks to create a unified representation space by integrating diverse data modalities to improve multimodal understanding. Traditional methods often depend on pairwise contrastive learning, which relies on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

Calibration in recommender systems is an important performance criterion that ensures consistency between the distribution of user preference categories and that of recommendations generated by the system. Standard methods for mitigating…

Information Retrieval · Computer Science 2024-05-17 Kun Lin , Masoud Mansoury , Farzad Eskandanian , Milad Sabouri , Bamshad Mobasher

Modern recommender systems struggle to effectively utilize the rich, yet high-dimensional and noisy, multi-modal features generated by Large Language Models (LLMs). Treating these features as static inputs decouples them from the core…

Information Retrieval · Computer Science 2025-12-02 Jiahao Tian , Zhenkai Wang

Multimodal recommendation systems integrate diverse multimodal information into the feature representations of both items and users, thereby enabling a more comprehensive modeling of user preferences. However, existing methods are hindered…

Multimedia · Computer Science 2025-01-03 Qiya Song , Jiajun Hu , Lin Xiao , Bin Sun , Xieping Gao , Shutao Li

The explosion of multimedia data in information-rich environments has intensified the challenges of personalized content discovery, positioning recommendation systems as an essential form of passive data management. Multimodal sequential…

Information Retrieval · Computer Science 2026-03-05 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Yijie Li , Jianheng Tang , Yunhuai Liu , Edith C. H. Ngai

Multimodal recommender systems (MMRS) leverage images, text, and interaction signals to enrich item representations. However, recent alignment based MMRSs that enforce a unified embedding space often blur modality specific structures and…

Information Retrieval · Computer Science 2026-03-16 Yonghun Jeong , David Yoon Suk Kang , Yeon-Chang Lee

Multimodal representation learning harmonizes distinct modalities by aligning them into a unified latent space. Recent research generalizes traditional cross-modal alignment to produce enhanced multimodal synergy but requires all modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xiaohao Liu , Xiaobo Xia , Jiaheng Wei , Shuo Yang , Xiu Su , See-Kiong Ng , Tat-Seng Chua

Identifying relationships between items is a key task of an online recommender system, in order to help users discover items that are functionally complementary or visually compatible. In domains like clothing recommendation, this task is…

Information Retrieval · Computer Science 2016-09-30 Ruining He , Charles Packer , Julian McAuley

In the absence of prior knowledge, ordinal embedding methods obtain new representation for items in a low-dimensional Euclidean space via a set of quadruple-wise comparisons. These ordinal comparisons often come from human annotators, and…

Machine Learning · Computer Science 2018-12-06 Ke Ma , Qianqian Xu , Zhiyong Yang , Xiaochun Cao

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

Multimodal recommendation systems have attracted increasing attention for their improved performance by leveraging items' multimodal information. Prior methods often build modality-specific item-item semantic graphs from raw modality…

Information Retrieval · Computer Science 2025-08-11 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Dusit Niyato , Zhiqi Shen

In recent years, neural networks and other complex models have dominated recommender systems, often setting new benchmarks for state-of-the-art performance. Yet, despite these advancements, award-winning research has demonstrated that…

Information Retrieval · Computer Science 2026-04-20 Pedro R. Pires , Rafael T. Sereicikas , Gregorio F. Azevedo , Tiago A. Almeida

Heterogeneous sequential recommendation (HSR) aims to learn dynamic behavior dependencies from the diverse behaviors of user-item interactions to facilitate precise sequential recommendation. Despite many efforts yielding promising…

Information Retrieval · Computer Science 2026-04-17 Jing Xiao , Dongqi Wu , Liwei Pan , Yawen Luo , Weike Pan , Zhong Ming

Cross-Domain Sequential Recommendation (CDSR) predicts user behavior by leveraging historical interactions across multiple domains, focusing on modeling cross-domain preferences and capturing both intra- and inter-sequence item…

Information Retrieval · Computer Science 2026-03-02 Wangyu Wu , Zhenhong Chen , Wenqiao Zhang , Xianglin Qiu , Siqi Song , Xiaowei Huang , Fei Ma , Jimin Xiao

We propose a novel recommender framework, MuSTRec (Multimodal and Sequential Transformer-based Recommendation), that unifies multimodal and sequential recommendation paradigms. MuSTRec captures cross-item similarities and collaborative…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Most NN-RSs focus on accuracy by building representations from the direct user-item interactions (e.g., user-item rating matrix), while ignoring the underlying relatedness between users and items (e.g., users who rate the same ratings for…

Information Retrieval · Computer Science 2022-05-20 Yuanbo Xu , En Wang , Yongjian Yang , Yi Chang

While many approaches exist in the literature to learn low-dimensional representations for data collections in multiple modalities, the generalizability of multi-modal nonlinear embeddings to previously unseen data is a rather overlooked…

Machine Learning · Computer Science 2021-05-05 Semih Kaya , Elif Vural

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interactions with multimodal…

Information Retrieval · Computer Science 2022-03-18 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Mengqi Zhang , Shu Wu , Liang Wang