English
Related papers

Related papers: Do Recommender Systems Really Leverage Multimodal …

200 papers

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

In recent years, multimodal large language models (MLLMs) have shown remarkable capabilities in tasks like visual question answering and common sense reasoning, while visual perception models have made significant strides in perception…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Guanqun Wang , Xinyu Wei , Jiaming Liu , Ray Zhang , Yichi Zhang , Kevin Zhang , Maurice Chong , Shanghang Zhang

Recommender systems in concert with Large Language Models (LLMs) present promising avenues for generating semantically-informed recommendations. However, LLM-based recommenders exhibit a tendency to overemphasize semantic correlations…

Computation and Language · Computer Science 2025-08-15 Minhao Wang , Yunhang He , Cong Xu , Zhangchi Zhu , Wei Zhang

Sequential recommendation (SR) aims to capture users' dynamic interests and sequential patterns based on their historical interactions. Recently, the powerful capabilities of large language models (LLMs) have driven their adoption in SR.…

Information Retrieval · Computer Science 2025-09-03 Yuhao Wang , Junwei Pan , Xinhang Li , Maolin Wang , Yuan Wang , Yue Liu , Dapeng Liu , Jie Jiang , Xiangyu Zhao

With recent advances in large language models (LLMs), there has been emerging numbers of research in developing Semantic IDs based on LLMs to enhance the performance of recommendation systems. However, the dimension of these embeddings…

Information Retrieval · Computer Science 2024-10-15 Taolin Zhang , Junwei Pan , Jinpeng Wang , Yaohua Zha , Tao Dai , Bin Chen , Ruisheng Luo , Xiaoxiang Deng , Yuan Wang , Ming Yue , Jie Jiang , Shu-Tao Xia

This paper explores the use of Large Language Models (LLMs) for sequential recommendation, which predicts users' future interactions based on their past behavior. We introduce a new concept, "Integrating Recommendation Systems as a New…

Information Retrieval · Computer Science 2024-12-24 Kai Zheng , Qingfeng Sun , Can Xu , Peng Yu , Qingwei Guo

Large language models (LLMs) excel at capturing semantic nuances and therefore show impressive relevance ranking performance in modern recommendation and search systems. However, they suffer from high computational overhead under industrial…

Sequential recommendation problems have received increasing attention in research during the past few years, leading to the inception of a large variety of algorithmic approaches. In this work, we explore how large language models (LLMs),…

Information Retrieval · Computer Science 2023-09-19 Jesse Harte , Wouter Zorgdrager , Panos Louridas , Asterios Katsifodimos , Dietmar Jannach , Marios Fragkoulis

Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However,…

Information Retrieval · Computer Science 2026-01-27 Yuzhuo Dang , Xin Zhang , Zhiqiang Pan , Yuxiao Duan , Wanyu Chen , Fei Cai , Honghui Chen

Multi-modal word semantics aims to enhance embeddings with perceptual input, assuming that human meaning representation is grounded in sensory experience. Most research focuses on evaluation involving direct visual input, however, visual…

Computation and Language · Computer Science 2021-10-07 Anita L. Verő , Ann Copestake

Existing video recommender systems rely primarily on user-defined metadata or on low-level visual and acoustic signals extracted by specialised encoders. These low-level features describe what appears on the screen but miss deeper semantics…

Information Retrieval · Computer Science 2025-08-14 Marco De Nadai , Andreas Damianou , Mounia Lalmas

Recently, large language models (LLMs) have notably positioned them as capable tools for addressing complex optimization challenges. Despite this recognition, a predominant limitation of existing LLM-based optimization methods is their…

Artificial Intelligence · Computer Science 2024-03-05 Yuxiao Huang , Wenjie Zhang , Liang Feng , Xingyu Wu , Kay Chen Tan

Context-aware recommendation systems improve upon classical recommender systems by including, in the modelling, a user's behaviour. Research into context-aware recommendation systems has previously only considered the sequential ordering of…

Information Retrieval · Computer Science 2022-10-20 Mufhumudzi Muthivhi , Terence L. van Zyl , Hairong Wang

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Loris Giulivi , Giacomo Boracchi

The paper underscores the significance of Large Language Models (LLMs) in reshaping recommender systems, attributing their value to unique reasoning abilities absent in traditional recommenders. Unlike conventional systems lacking direct…

Information Retrieval · Computer Science 2024-03-20 Arpita Vats , Vinija Jain , Rahul Raja , Aman Chadha

In today's world, emotional support is increasingly essential, yet it remains challenging for both those seeking help and those offering it. Multimodal approaches to emotional support show great promise by integrating diverse data sources…

As Large Vision-Language Models (LVLMs) are increasingly deployed in domains such as shopping, health, and news, they are exposed to pervasive persuasive content. A critical question is how these models function as persuadees-how and why…

Computation and Language · Computer Science 2025-10-28 Haoyi Qiu , Yilun Zhou , Pranav Narayanan Venkit , Kung-Hsiang Huang , Jiaxin Zhang , Nanyun Peng , Chien-Sheng Wu

We present ReMatch, a framework that leverages the generative strength of MLLMs for multimodal retrieval. Previous approaches treated an MLLM as a simple encoder, ignoring its generative nature, and under-utilising its compositional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Qianying Liu , Xiao Liang , Zhiqiang Zhang , Zhongfei Qing , Fengfan Zhou , Yibo Chen , Xu Tang , Yao Hu , Paul Henderson

Despite the success of vision-language models in various generative tasks, obtaining high-quality semantic representations for products and user intents is still challenging due to the inability of off-the-shelf models to capture nuanced…

Information Retrieval · Computer Science 2025-11-07 Omkar Gurjar , Kin Sum Liu , Praveen Kolli , Utsaw Kumar , Mandar Rahurkar

Large Language Models (LLMs) have attracted significant attention in recommender systems for their excellent world knowledge capabilities. However, existing methods that rely on Euclidean space struggle to capture the rich hierarchical…

Information Retrieval · Computer Science 2025-04-22 Wentao Cheng , Zhida Qin , Zexue Wu , Pengzhan Zhou , Tianyu Huang