English
Related papers

Related papers: Triple Modality Fusion: Aligning Visual, Textual, …

200 papers

Personalized recommendation is ubiquitous, playing an important role in many online services. Substantial research has been dedicated to learning vector representations of users and items with the goal of predicting a user's preference for…

Information Retrieval · Computer Science 2020-01-03 Jianing Sun , Yingxue Zhang , Chen Ma , Mark Coates , Huifeng Guo , Ruiming Tang , Xiuqiang He

The problem of data sparsity has long been a challenge in recommendation systems, and previous studies have attempted to address this issue by incorporating side information. However, this approach often introduces side effects such as…

Information Retrieval · Computer Science 2024-01-09 Wei Wei , Xubin Ren , Jiabin Tang , Qinyong Wang , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Multimodal recommendation systems have attracted increasing attention for their improved performance by leveraging items' multimodal information. Prior methods often build modality-specific item-item semantic graphs from raw modality…

Information Retrieval · Computer Science 2025-08-11 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Dusit Niyato , Zhiqi Shen

Adapting large language models (LLMs) for personalized recommendation requires aligning their general-purpose capabilities with user-specific preferences while effectively leveraging both behavioral and semantic signals. Existing approaches…

Information Retrieval · Computer Science 2026-05-27 Pingjun Pan , Tingting Zhou , Peiyao Lu , Tingting Fei , Hongxiang Chen , Chuanjiang Luo

Effective recommender systems demand dynamic user understanding, especially in complex, evolving environments. Traditional user profiling often fails to capture the nuanced, temporal contextual factors of user preferences, such as transient…

Information Retrieval · Computer Science 2025-08-13 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

Fashion styling and personalized recommendations are pivotal in modern retail, contributing substantial economic value in the fashion industry. With the advent of vision-language models (VLM), new opportunities have emerged to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Kaicheng Pang , Xingxing Zou , Waikeung Wong

Developing a universal model that can effectively harness heterogeneous resources and respond to a wide range of personalized needs has been a longstanding community aspiration. Our daily choices, especially in domains like fashion and…

Information Retrieval · Computer Science 2024-03-29 Tianxin Wei , Bowen Jin , Ruirui Li , Hansi Zeng , Zhengyang Wang , Jianhui Sun , Qingyu Yin , Hanqing Lu , Suhang Wang , Jingrui He , Xianfeng Tang

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential.…

Computation and Language · Computer Science 2024-10-21 Mozhi Zhang , Pengyu Wang , Chenkun Tan , Mianqiu Huang , Dong Zhang , Yaqian Zhou , Xipeng Qiu

Given the large volume of side information from different modalities, multimodal recommender systems have become increasingly vital, as they exploit richer semantic information beyond user-item interactions. Recent works highlight that…

Information Retrieval · Computer Science 2024-12-17 Junjie Huang , Jiarui Qin , Yong Yu , Weinan Zhang

Multimedia-based recommendation provides personalized item suggestions by learning the content preferences of users. With the proliferation of digital devices and APPs, a huge number of new items are created rapidly over time. How to…

Information Retrieval · Computer Science 2024-05-28 Haoyue Bai , Le Wu , Min Hou , Miaomiao Cai , Zhuangzhuang He , Yuyang Zhou , Richang Hong , Meng Wang

As e-commerce platforms expand their product catalogs, accurately recommending long-tail items becomes increasingly important for enhancing both user experience and platform revenue. A key challenge is the long-tail problem, where extreme…

Information Retrieval · Computer Science 2025-06-10 Qingyi Lu , Haotian Lyu , Jiayun Zheng , Yang Wang , Li Zhang , Chengrui Zhou

Recommendation systems often suffer from data sparsity caused by limited user-item interactions, which degrade their performance and amplify popularity bias in real-world scenarios. This paper proposes a novel data augmentation framework…

Information Retrieval · Computer Science 2026-04-22 Minh-Anh Nguyen , Bao Nguyen , Ha Lan N. T. , Tuan Anh Hoang , Duc-Trong Le , Dung D. Le

Personalization is a core capability across consumer technologies, streaming, shopping, wearables, and voice, yet it remains challenged by sparse interactions, fast content churn, and heterogeneous textual signals. We present RecMind, an…

Machine Learning · Computer Science 2025-09-09 Chang Xue , Youwei Lu , Chen Yang , Jinming Xing

Large language models (LLMs) have recently demonstrated remarkable advancements in embodying diverse personas, enhancing their effectiveness as conversational agents and virtual assistants. Consequently, LLMs have made significant strides…

Computation and Language · Computer Science 2025-03-03 Julius Broomfield , Kartik Sharma , Srijan Kumar

Large Language Models (LLMs) pose a new paradigm of modeling and computation for information tasks. Recommendation systems are a critical application domain poised to benefit significantly from the sequence modeling capabilities and world…

Semantic location prediction aims to derive meaningful location insights from multimodal social media posts, offering a more contextual understanding of daily activities than using GPS coordinates. This task faces significant challenges due…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhizhen Zhang , Ning Wang , Haojie Li , Zhihui Wang

Multimodal Emotion Recognition (MER) aims to perceive human emotions through three modes: language, vision, and audio. Previous methods primarily focused on modal fusion without adequately addressing significant distributional differences…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jichao Zhu , Jun Yu

Modern recommender systems struggle to effectively utilize the rich, yet high-dimensional and noisy, multi-modal features generated by Large Language Models (LLMs). Treating these features as static inputs decouples them from the core…

Information Retrieval · Computer Science 2025-12-02 Jiahao Tian , Zhenkai Wang