English
Related papers

Related papers: LEMUR: Large scale End-to-end MUltimodal Recommend…

200 papers

Large Multimodal Models (LMMs) exhibit remarkable multi-tasking ability by learning mixed instruction datasets. However, novel tasks would be encountered sequentially in dynamic world, which urges for equipping LMMs with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Fanhu Zeng , Fei Zhu , Haiyang Guo , Xu-Yao Zhang , Cheng-Lin Liu

The lack of training data gives rise to the system cold-start problem in recommendation systems, making them struggle to provide effective recommendations. To address this problem, Large Language Models (LLMs) can model recommendation tasks…

Information Retrieval · Computer Science 2024-12-25 Wenlin Zhang , Chuhan Wu , Xiangyang Li , Yuhao Wang , Kuicai Dong , Yichao Wang , Xinyi Dai , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

Multimodal recommender systems utilize various types of information to model user preferences and item features, helping users discover items aligned with their interests. The integration of multimodal information mitigates the inherent…

Information Retrieval · Computer Science 2024-02-20 Shanshan Zhong , Zhongzhan Huang , Daifeng Li , Wushao Wen , Jinghui Qin , Liang Lin

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

Recent advances in Large Language Models (LLMs) have opened new avenues for sequential recommendation by enabling natural language reasoning over user behavior sequences. A common approach formulates recommendation as a language modeling…

Information Retrieval · Computer Science 2026-04-08 Yu Wang , Yonghui Yang , Le Wu , Yi Zhang , Fei Liu , Richang Hong

Multimodal recommendation systems (MMRS) have received considerable attention from the research community due to their ability to jointly utilize information from user behavior and product images and text. Previous research has two main…

Information Retrieval · Computer Science 2024-07-18 Guojiao Lin , Zhen Meng , Dongjie Wang , Qingqing Long , Yuanchun Zhou , Meng Xiao

Practical recommender systems experience a cold-start problem when observed user-item interactions in the history are insufficient. Meta learning, especially gradient based one, can be adopted to tackle this problem by learning initial…

Information Retrieval · Computer Science 2021-11-01 Xidong Feng , Chen Chen , Dong Li , Mengchen Zhao , Jianye Hao , Jun Wang

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays…

Information Retrieval · Computer Science 2025-01-14 Artun Boz , Wouter Zorgdrager , Zoe Kotti , Jesse Harte , Panos Louridas , Dietmar Jannach , Vassilios Karakoidas , Marios Fragkoulis

Robust deployment of large multimodal models (LMMs) in real-world scenarios requires access to external knowledge sources, given the complexity and dynamic nature of real-world information. Existing approaches such as retrieval-augmented…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Jinming Wu , Zihao Deng , Wei Li , Yiding Liu , Bo You , Bo Li , Zejun Ma , Ziwei Liu

The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities…

Information Retrieval · Computer Science 2024-07-02 Hangyu Wang , Jianghao Lin , Bo Chen , Yang Yang , Ruiming Tang , Weinan Zhang , Yong Yu

Large Language Models (LLMs) have recently garnered significant attention in various domains, including recommendation systems. Recent research leverages the capabilities of LLMs to improve the performance and user modeling aspects of…

Information Retrieval · Computer Science 2024-11-05 Lei Chen , Chen Gao , Xiaoyi Du , Hengliang Luo , Depeng Jin , Yong Li , Meng Wang

Multimodal representation learning has attracted increasing attention in AI, driven by the strong performance of large, pretrained multimodal foundation models such as Qwen, LLaVA, and CLIP. These models deliver impressive performance on a…

Information Retrieval · Computer Science 2026-05-27 Junchen Fu , Xuri Ge , Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Xi Wang , Qijiong Liu , Qian Li , Joemon M. Jose

Instruction tuning has emerged as a critical paradigm for improving the capabilities and alignment of large language models (LLMs). However, existing iterative model-aware data selection methods incur significant computational overhead, as…

Machine Learning · Computer Science 2025-05-13 Xiaotian Lin , Yanlin Qi , Yizhang Zhu , Themis Palpanas , Chengliang Chai , Nan Tang , Yuyu Luo

Fine-tuning Large Language Models (LLMs) with multimodal encoders on modality-specific data expands the modalities that LLMs can handle, leading to the formation of Multimodal LLMs (MLLMs). However, this paradigm heavily relies on…

Computation and Language · Computer Science 2025-05-26 Junlin Li , Guodong DU , Jing Li , Sim Kuan Goh , Wenya Wang , Yequan Wang , Fangming Liu , Ho-Kin Tang , Saleh Alharbi , Daojing He , Min Zhang

The integration of multimodal information into sequential recommender systems has attracted significant attention in recent research. In the initial stages of multimodal sequential recommendation models, the mainstream paradigm was…

Information Retrieval · Computer Science 2024-03-06 Jiaxi Hu , Jingtong Gao , Xiangyu Zhao , Yuehong Hu , Yuxuan Liang , Yiqi Wang , Ming He , Zitao Liu , Hongzhi Yin

In recent years, the rapid growth of online multimedia services, such as e-commerce platforms, has necessitated the development of personalised recommendation approaches that can encode diverse content about each item. Indeed, modern…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Zijun Long , Iadh Ounis , Craig Macdonald , Richard Mccreadie

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

Information Retrieval · Computer Science 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

Recently, multimodal recommendations (MMR) have gained increasing attention for alleviating the data sparsity problem of traditional recommender systems by incorporating modality-based representations. Although MMR exhibits notable…

Information Retrieval · Computer Science 2025-06-12 Weixin Chen , Li Chen , Yongxin Ni , Yuhan Zhao

With the prevalence of multimedia content on the Web, developing recommender solutions that can effectively leverage the rich signal in multimedia data is in urgent need. Owing to the success of deep neural networks in representation…

Information Retrieval · Computer Science 2019-05-30 Jinhui Tang , Xiaoyu Du , Xiangnan He , Fajie Yuan , Qi Tian , Tat-Seng Chua

Multimodal recommendation has emerged as an effective paradigm for enhancing collaborative filtering by incorporating heterogeneous content modalities. Existing multimodal recommenders predominantly focus on reinforcing cross-modal…

Information Retrieval · Computer Science 2026-03-03 Hao Zhan , Yihui Wang , Yonghui Yang , Danyang Yue , Yu Wang , Pengyang Shao , Fei Shen , Fei Liu , Le Wu