English
Related papers

Related papers: Do Recommender Systems Really Leverage Multimodal …

200 papers

Recommender Systems are tools that improve how users find relevant information in web systems, so they do not face too much information. In order to generate better recommendations, the context of information should be used in the…

Information Retrieval · Computer Science 2020-07-10 Igor André Pegoraro Santana , Marcos Aurelio Domingues

As a paradigm that delves into the deep seated drivers of user behavior, motivation-based recommendation systems have emerged as a prominent research direction in the field of personalized information retrieval. Unlike traditional…

Information Retrieval · Computer Science 2026-03-16 Yicheng Di

The ability to accurately interpret complex visual information is a crucial topic of multimodal large language models (MLLMs). Recent work indicates that enhanced visual perception significantly reduces hallucinations and improves…

Text embeddings from large language models (LLMs) have achieved excellent results in tasks such as information retrieval, semantic textual similarity, etc. In this work, we show an interesting finding: when feeding a text into the LLM-based…

Computation and Language · Computer Science 2025-07-08 Zhijie Nie , Richong Zhang , Zhanyu Wu

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

Artificial Intelligence · Computer Science 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

This paper examines the performance of Multimodal LLMs (MLLMs) in skilled production work, with a focus on welding. Using a novel data set of real-world and online weld images, annotated by a domain expert, we evaluate the performance of…

Computation and Language · Computer Science 2025-03-24 Grigorii Khvatskii , Yong Suk Lee , Corey Angst , Maria Gibbs , Robert Landers , Nitesh V. Chawla

The objective of an expert recommendation system is to trace a set of candidates' expertise and preferences, recognize their expertise patterns, and identify experts. In this paper, we introduce a multimodal classification approach for…

Information Retrieval · Computer Science 2021-08-25 N. Nikzad-Khasmakhi , M. A. Balafar , M. Reza Feizi-Derakhshi , Cina Motamed

Creating a meaningful representation by fusing single modalities (e.g., text, images, or audio) is the core concept of multimodal learning. Although several techniques for building multimodal representations have been proven successful,…

Machine Learning · Computer Science 2025-08-08 Maciej Pawłowski , Anna Wróblewska , Sylwia Sysko-Romańczuk

Large Language Models (LLMs) have recently garnered significant attention in various domains, including recommendation systems. Recent research leverages the capabilities of LLMs to improve the performance and user modeling aspects of…

Information Retrieval · Computer Science 2024-11-05 Lei Chen , Chen Gao , Xiaoyi Du , Hengliang Luo , Depeng Jin , Yong Li , Meng Wang

Multimodal representation learning has been largely driven by contrastive models such as CLIP, which learn a shared embedding space by aligning paired image-text samples. While effective for general-purpose representation learning, such…

Machine Learning · Computer Science 2026-05-12 Yang Qiao , Yuntong Hu , Bowen Zhu , Hasibul Haque , Liang Zhao

With the advent of the information explosion era, the importance of recommendation systems in various applications is increasingly significant. Traditional collaborative filtering algorithms are widely used due to their effectiveness in…

Artificial Intelligence · Computer Science 2024-12-30 Xueting Lin , Zhan Cheng , Longfei Yun , Qingyi Lu , Yuanshuai Luo

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant…

Information Retrieval · Computer Science 2025-02-12 Jian Xu , Sichun Luo , Xiangyu Chen , Haoming Huang , Hanxu Hou , Linqi Song

Multimodal recommendation systems have attracted increasing attention for their improved performance by leveraging items' multimodal information. Prior methods often build modality-specific item-item semantic graphs from raw modality…

Information Retrieval · Computer Science 2025-08-11 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Dusit Niyato , Zhiqi Shen

Recommender systems serve as foundational infrastructure in modern information ecosystems, helping users navigate digital content and discover items aligned with their preferences. At their core, recommender systems address a fundamental…

Information Retrieval · Computer Science 2026-05-12 Min Hou , Le Wu , Yuxin Liao , Yonghui Yang , Zhen Zhang , Yu Wang , Changlong Zheng , Han Wu , Richang Hong

Recent advancements in Large Language Models (LLMs) have attracted considerable interest among researchers to leverage these models to enhance Recommender Systems (RSs). Existing work predominantly utilizes LLMs to generate knowledge-rich…

Information Retrieval · Computer Science 2024-07-25 Zhongxiang Sun , Zihua Si , Xiaoxue Zang , Kai Zheng , Yang Song , Xiao Zhang , Jun Xu

Text-rich visual understanding-the ability to process environments where dense textual content is integrated with visuals-is crucial for multimodal large language models (MLLMs) to interact effectively with structured environments. To…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Junpeng Liu , Tianyue Ou , Yifan Song , Yuxiao Qu , Wai Lam , Chenyan Xiong , Wenhu Chen , Graham Neubig , Xiang Yue

Large language models (LLMs), renowned for their powerful conversational abilities, are widely recognized as exceptional tools in the field of education, particularly in the context of automated intelligent instruction systems for language…

Computation and Language · Computer Science 2024-07-19 Kaiqi Fu , Linkai Peng , Nan Yang , Shuran Zhou

From extracting features to generating text, the outputs of large language models (LLMs) typically rely on the final layers, following the conventional wisdom that earlier layers capture only low-level cues. However, our analysis shows that…

Machine Learning · Computer Science 2025-06-17 Oscar Skean , Md Rifat Arefin , Dan Zhao , Niket Patel , Jalal Naghiyev , Yann LeCun , Ravid Shwartz-Ziv

Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e.g., purchasing and clicking). Humans perceive…

Information Retrieval · Computer Science 2023-02-10 Hongyu Zhou , Xin Zhou , Zhiwei Zeng , Lingzi Zhang , Zhiqi Shen

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang