English
Related papers

Related papers: QARM: Quantitative Alignment Multi-Modal Recommend…

200 papers

Most existing recommender systems leverage user behavior data of one type only, such as the purchase behavior in E-commerce that is directly related to the business KPI (Key Performance Indicator) of conversion rate. Besides the key…

Information Retrieval · Computer Science 2020-02-11 Chen Gao , Xiangnan He , Dahua Gan , Xiangning Chen , Fuli Feng , Yong Li , Tat-Seng Chua , Lina Yao , Yang Song , Depeng Jin

Recently, multimodal recommendations (MMR) have gained increasing attention for alleviating the data sparsity problem of traditional recommender systems by incorporating modality-based representations. Although MMR exhibits notable…

Information Retrieval · Computer Science 2025-06-12 Weixin Chen , Li Chen , Yongxin Ni , Yuhan Zhao

Learning large-scale industrial recommender system models by fitting them to historical user interaction data makes them vulnerable to conformity bias. This may be due to a number of factors, including the fact that user interests may be…

Information Retrieval · Computer Science 2023-04-19 Ameya Raul , Amey Porobo Dharwadker , Brad Schumitsch

Large language models have recently shown promise for multimodal recommendation, particularly with text and image inputs. Yet real-world recommendation signals extend far beyond these modalities. To reflect this, we formalize recommendation…

Information Retrieval · Computer Science 2026-05-01 Zijie Lei , Tao Feng , Zhigang Hua , Yan Xie , Guanyu Lin , Shuang Yang , Ge Liu , Jiaxuan You

Many healthcare applications are inherently multimodal, involving several physiological signals. As sensors for these signals become more common, improving machine learning methods for multimodal healthcare data is crucial. Pretraining…

Machine Learning · Computer Science 2024-10-23 Ching Fang , Christopher Sandino , Behrooz Mahasseni , Juri Minxha , Hadi Pouransari , Erdrin Azemi , Ali Moin , Ellen Zippi

Multimodal learning has mainly focused on learning large models on, and fusing feature representations from, different modalities for better performances on downstream tasks. In this work, we take a detour from this trend and study the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Yifeng Shi , Marc Niethammer

Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However,…

Information Retrieval · Computer Science 2026-01-27 Yuzhuo Dang , Xin Zhang , Zhiqiang Pan , Yuxiao Duan , Wanyu Chen , Fei Cai , Honghui Chen

Traditional recommender systems heavily rely on ID features, which often encounter challenges related to cold-start and generalization. Modeling pre-extracted content features can mitigate these issues, but is still a suboptimal solution…

Information Retrieval · Computer Science 2024-04-10 Xiuqi Deng , Lu Xu , Xiyao Li , Jinkai Yu , Erpeng Xue , Zhongyuan Wang , Di Zhang , Zhaojie Liu , Guorui Zhou , Yang Song , Na Mou , Shen Jiang , Han Li

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

In the wave of generative recommendation, we present OneMall, an end-to-end generative recommendation framework tailored for e-commerce services at Kuaishou. Our OneMall systematically unifies the e-commerce's multiple item distribution…

Multimodal learning often grapples with the challenge of low-quality data, which predominantly manifests as two facets: modality imbalance and noisy corruption. While these issues are often studied in isolation, we argue that they share a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Xun Jiang , Yufan Gu , Disen Hu , Yuqing Hou , Yazhou Yao , Fumin Shen , Heng Tao Shen , Xing Xu

Human perception integrates multiple modalities, such as vision, hearing, and language, into a unified understanding of the surrounding reality. While recent multimodal models have achieved significant progress by aligning pairs of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Giordano Cicchetti , Eleonora Grassucci , Luigi Sigillo , Danilo Comminiello

This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item interaction graph,…

Information Retrieval · Computer Science 2023-05-02 Xin Zhou , Hongyu Zhou , Yong Liu , Zhiwei Zeng , Chunyan Miao , Pengwei Wang , Yuan You , Feijun Jiang

For Industry 4.0 Revolution, cooperative autonomous mobility systems are widely used based on multi-agent reinforcement learning (MARL). However, the MARL-based algorithms suffer from huge parameter utilization and convergence difficulties…

Multiagent Systems · Computer Science 2023-08-04 Soohyun Park , Jae Pyoung Kim , Chanyoung Park , Soyi Jung , Joongheon Kim

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

Logical query answering over Knowledge Graphs (KGs) is a fundamental yet complex task. A promising approach to achieve this is to embed queries and entities jointly into the same embedding space. Research along this line suggests that using…

Information Retrieval · Computer Science 2024-03-29 Yuhan Wu , Yuanyuan Xu , Wenjie Zhang , Xiwei Xu , Ying Zhang

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

Multimodal data encountered in real-world scenarios are typically of low quality, with noisy modalities and missing modalities being typical forms that severely hinder model performance and robustness. However, prior works often handle…

Machine Learning · Computer Science 2026-03-04 Sijie Mai , Shiqin Han , Haifeng Hu

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao