English
Related papers

Related papers: Learning Item Representations Directly from Multim…

200 papers

With the growth of online shopping for fashion products, accurate fashion recommendation has become a critical problem. Meanwhile, social networks provide an open and new data source for personalized fashion analysis. In this work, we study…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Haitian Zheng , Kefei Wu , Jong-Hwi Park , Wei Zhu , Jiebo Luo

In modern e-commerce, item content features in various modalities offer accurate yet comprehensive information to recommender systems. The majority of previous work either focuses on learning effective item representation during modelling…

Information Retrieval · Computer Science 2024-08-15 Hao Wu , Alejandro Ariza-Casabona , Bartłomiej Twardowski , Tri Kurniawan Wijaya

Recent advancements in language models and pre-trained language models like BERT and RoBERTa have revolutionized natural language processing, enabling a deeper understanding of human-like language. In this paper, we explore enhancing…

Information Retrieval · Computer Science 2025-04-15 Ngoc Luyen Le , Marie-Hélène Abel

Large language models (LLMs) have shown great promise in recommender systems, where supervised fine-tuning (SFT) is commonly used for adaptation. Subsequent studies further introduce preference learning to incorporate negative samples into…

Information Retrieval · Computer Science 2026-02-20 Bingqian Li , Bowen Zheng , Xiaolei Wang , Long Zhang , Jinpeng Wang , Sheng Chen , Wayne Xin Zhao , Ji-rong Wen

Sequential Recommendation (SR) in multimodal settings typically relies on small frozen pretrained encoders, which limits semantic capacity and prevents Collaborative Filtering (CF) signals from being fully integrated into item…

Information Retrieval · Computer Science 2026-03-19 Junyoung Kim , Woojoo Kim , Jaehyung Lim , Dongha Kim , Hwanjo Yu

Learning a good representation of text is key to many recommendation applications. Examples include news recommendation where texts to be recommended are constantly published everyday. However, most existing recommendation techniques, such…

Information Retrieval · Computer Science 2017-06-27 Ting Chen , Liangjie Hong , Yue Shi , Yizhou Sun

Recent sequential recommendation models have combined pre-trained text embeddings of items with item ID embeddings to achieve superior recommendation performance. Despite their effectiveness, the expressive power of text features in these…

Information Retrieval · Computer Science 2024-02-19 Lingzi Zhang , Xin Zhou , Zhiwei Zeng , Zhiqi Shen

Multi-modal large language models (MLLMs) have shown remarkable abilities in various visual understanding tasks. However, MLLMs still struggle with fine-grained visual recognition (FGVR), which aims to identify subordinate-level categories…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Hulingxiao He , Geng Li , Zijun Geng , Jinglin Xu , Yuxin Peng

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

Recently, large language models (LLMs) have demonstrated impressive capabilities in dealing with new tasks with the help of in-context learning (ICL). In the study of Large Vision-Language Models (LVLMs), when implementing ICL, researchers…

Computation and Language · Computer Science 2024-12-11 Ellen Yi-Ge , Jiechao Gao , Wei Han , Wei Zhu

Multimodal embeddings are widely used in downstream tasks such as multimodal retrieval, enabling alignment of interleaved modalities in a shared representation space. While recent studies show that Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chunxu Liu , Jiyuan Yang , Ruopeng Gao , Yuhan Zhu , Feng Zhu , Rui Zhao , Limin Wang

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

Recent attempts to integrate large language models (LLMs) into recommender systems have gained momentum, but most remain limited to simple text generation or static prompt-based inference, failing to capture the complexity of user…

Information Retrieval · Computer Science 2025-10-16 Jiin Park , Misuk Kim

Traditional ID-based recommender systems often struggle with cold-start and generalization challenges. Multimodal recommendation systems, which leverage textual and visual data, offer a promising solution to mitigate these issues. However,…

Recommender systems are essential for guiding users through the vast and diverse landscape of digital content by delivering personalized and relevant suggestions. However, improving both personalization and interpretability remains a…

Information Retrieval · Computer Science 2025-08-05 Danial Ebrat , Tina Aminian , Sepideh Ahmadian , Luis Rueda

The recent breakthrough of large language models (LLMs) in natural language processing has sparked exploration in recommendation systems, however, their limited domain-specific knowledge remains a critical bottleneck. Specifically, LLMs…

Information Retrieval · Computer Science 2025-10-03 Xiaohan Yu , Li Zhang , Xin Zhao , Yue Wang

Large language models (LLMs) have recently demonstrated strong potential for sequential recommendation. However, current LLM-based approaches face critical limitations in modeling users' long-term and diverse interests. First, due to…

Information Retrieval · Computer Science 2025-10-30 Jingyi Zhou , Cheng Chen , Kai Zuo , Manjie Xu , Zhendong Fu , Yibo Chen , Xu Tang , Yao Hu

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

Information Retrieval · Computer Science 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

Generative Recommendation (GR) has emerged as a new paradigm in recommender systems. This approach relies on quantized representations to discretize item features, modeling users' historical interactions as sequences of discrete tokens.…

Information Retrieval · Computer Science 2025-11-25 Fuwei Zhang , Xiaoyu Liu , Dongbo Xi , Jishen Yin , Huan Chen , Peng Yan , Fuzhen Zhuang , Zhao Zhang

Food recommendation systems serve as pivotal components in the realm of digital lifestyle services, designed to assist users in discovering recipes and food items that resonate with their unique dietary predilections. Typically, multi-modal…

Information Retrieval · Computer Science 2025-02-28 Yixin Zhang , Xin Zhou , Qianwen Meng , Fanglin Zhu , Yonghui Xu , Zhiqi Shen , Lizhen Cui