English
Related papers

Related papers: Large-scale Benchmarks for Multimodal Recommendati…

200 papers

With the explosive growth of multimodal content online, pre-trained visual-language models have shown great potential for multimodal recommendation. However, while these models achieve decent performance when applied in a frozen manner,…

Information Retrieval · Computer Science 2025-02-24 Wenyu Zhang , Jie Luo , Xinming Zhang , Yuan Fang

As a paradigm that delves into the deep seated drivers of user behavior, motivation-based recommendation systems have emerged as a prominent research direction in the field of personalized information retrieval. Unlike traditional…

Information Retrieval · Computer Science 2026-03-16 Yicheng Di

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

We propose a novel recommender framework, MuSTRec (Multimodal and Sequential Transformer-based Recommendation), that unifies multimodal and sequential recommendation paradigms. MuSTRec captures cross-item similarities and collaborative…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Large multimodal models (LMMs) are increasingly adopted as judges in multimodal evaluation systems due to their strong instruction following and consistency with human preferences. However, their ability to follow diverse, fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Tianyi Xiong , Yi Ge , Ming Li , Zuolong Zhang , Pranav Kulkarni , Kaishen Wang , Qi He , Zeying Zhu , Chenxi Liu , Ruibo Chen , Tong Zheng , Yanshuo Chen , Xiyao Wang , Renrui Zhang , Wenhu Chen , Heng Huang

Usability is a key factor in the effectiveness of recommender systems. However, the analysis of user interfaces is a time-consuming process that requires expertise. Recent advances in multimodal large language models (LLMs) offer promising…

Human-Computer Interaction · Computer Science 2025-11-19 Sebastian Lubos , Alexander Felfernig , Damian Garber , Viet-Man Le , Thi Ngoc Trang Tran

Selecting the best data mixture is critical for successful Supervised Fine-Tuning (SFT) of Multimodal Large Language Models. However, determining the optimal mixture weights across multiple domain-specific datasets remains a significant…

Machine Learning · Computer Science 2026-02-06 Davide Berasi , Matteo Farina , Massimiliano Mancini , Elisa Ricci

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two…

Information Retrieval · Computer Science 2025-02-27 Hang Zhou , Yucheng Wang , Huijing Zhan

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang

Adaptive multimodal reasoning has emerged as a promising frontier in Vision-Language Models (VLMs), aiming to dynamically modulate between tool-augmented visual reasoning and text reasoning to enhance both effectiveness and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xintong Zhang , Xiaowen Zhang , Jingrong Wu , Zhi Gao , Shilin Yan , Zhenxin Diao , Kunpeng Gao , Xuanyan Chen , Yuwei Wu , Yunde Jia , Qing Li

Recent progress in deep research systems has been impressive, but evaluation still lags behind real user needs. Existing benchmarks predominantly assess final reports using fixed rubrics, failing to evaluate the underlying research process.…

Developing a universal model that can effectively harness heterogeneous resources and respond to a wide range of personalized needs has been a longstanding community aspiration. Our daily choices, especially in domains like fashion and…

Information Retrieval · Computer Science 2024-03-29 Tianxin Wei , Bowen Jin , Ruirui Li , Hansi Zeng , Zhengyang Wang , Jianhui Sun , Qingyu Yin , Hanqing Lu , Suhang Wang , Jingrui He , Xianfeng Tang

Nowadays, the recommendation systems are applied in the fields of e-commerce, video websites, social networking sites, etc., which bring great convenience to people's daily lives. The types of the information are diversified and abundant in…

Information Retrieval · Computer Science 2019-02-18 Junmei Lv , Bin Song , Jie Guo , Xiaojiang Du , Mohsen Guizani

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that convert the high-dimensional discrete features, such as user and…

Information Retrieval · Computer Science 2025-10-23 Maolin Wang , Xinjian Zhao , Wanyu Wang , Sheng Zhang , Jiansheng Li , Bowen Yu , Binhao Wang , Shucheng Zhou , Dawei Yin , Qing Li , Ruocheng Guo , Xiangyu Zhao

The popularity of multimodal large language models (MLLMs) has triggered a recent surge in research efforts dedicated to evaluating these models. Nevertheless, existing evaluation studies of MLLMs primarily focus on the comprehension and…

Computation and Language · Computer Science 2023-10-16 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

The broad goal of information extraction is to derive structured information from unstructured data. However, most existing methods focus solely on text, ignoring other types of unstructured data such as images, video and audio which…

Computation and Language · Computer Science 2017-12-01 Robert L. Logan , Samuel Humeau , Sameer Singh

Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of features with vocabularies on the order of millions to billions…

Machine Learning · Computer Science 2024-06-19 Benjamin Coleman , Wang-Cheng Kang , Matthew Fahrbach , Ruoxi Wang , Lichan Hong , Ed H. Chi , Derek Zhiyuan Cheng

The features used in many image analysis-based applications are frequently of very high dimension. Feature extraction offers several advantages in high-dimensional cases, and many recent studies have used multi-task feature extraction…

Machine Learning · Statistics 2019-04-09 Yong Luo , Yonggang Wen , Dacheng Tao , Jie Gui , Chao Xu

In the real world, where information is abundant and diverse across different modalities, understanding and utilizing various data types to improve retrieval systems is a key focus of research. Multimodal composite retrieval integrates…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Suyan Li , Fuxiang Huang , Lei Zhang

Traditional recommender systems primarily rely on a single type of user-item interaction, such as item purchases or ratings, to predict user preferences. However, in real-world scenarios, users engage in a variety of behaviors, such as…

Information Retrieval · Computer Science 2025-03-11 Kyungho Kim , Sunwoo Kim , Geon Lee , Jinhong Jung , Kijung Shin