English
Related papers

Related papers: UniRec: Unified Multimodal Encoding for LLM-Based …

200 papers

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

Large foundational models, through upstream pre-training and downstream fine-tuning, have achieved immense success in the broad AI community due to improved model performance and significant reductions in repetitive engineering. By…

Information Retrieval · Computer Science 2024-03-19 Jiaqi Zhang , Yu Cheng , Yongxin Ni , Yunzhu Pan , Zheng Yuan , Junchen Fu , Youhua Li , Jie Wang , Fajie Yuan

Traditional recommender systems (RS) have been primarily optimized for accuracy and short-term engagement, often overlooking transparency and trustworthiness. Recently, platforms such as Amazon and Instagram have begun providing…

Information Retrieval · Computer Science 2026-01-07 Chung Park , Taesan Kim , Hyeongjun Yun , Dongjoon Hong , Junui Hong , Kijung Park , MinCheol Cho , Mira Myong , Jihoon Oh , Min sung Choi

Leveraging Large Language Models as Recommenders (LLMRec) has gained significant attention and introduced fresh perspectives in user preference modeling. Existing LLMRec approaches prioritize text semantics, usually neglecting the valuable…

Information Retrieval · Computer Science 2025-06-17 Yang Zhang , Fuli Feng , Jizhi Zhang , Keqin Bao , Qifan Wang , Xiangnan He

The Large Language models (LLMs) have demonstrated supreme capabilities in text understanding and generation, but cannot be directly applied to cross-modal tasks without fine-tuning. This paper proposes a cross-modal in-context learning…

Sound · Computer Science 2024-06-17 Dongchao Yang , Haohan Guo , Yuanyuan Wang , Rongjie Huang , Xiang Li , Xu Tan , Xixin Wu , Helen Meng

Large Language Models (LLMs) have made the ambitious quest for generalist agents significantly far from being a fantasy. A key hurdle for building such general models is the diversity and heterogeneity of tasks and modalities. A promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Mustafa Shukor , Corentin Dancette , Alexandre Rame , Matthieu Cord

Concept recommendation aims to suggest the next concept for learners to study based on their knowledge states and the human knowledge system. While knowledge states can be predicted using knowledge tracing models, previous approaches have…

Information Retrieval · Computer Science 2024-05-22 Qingyao Li , Wei Xia , Kounianhua Du , Qiji Zhang , Weinan Zhang , Ruiming Tang , Yong Yu

Multimodal Recommendation (MMR) systems are crucial for modern platforms but are often hampered by inherent noise and uncertainty in modal features, such as blurry images, diverse visual appearances, or ambiguous text. Existing methods…

Information Retrieval · Computer Science 2026-01-28 Xinzhuo Wu , Hongbo Wang , Yuan Lin , Kan Xu , Liang Yang , Hongfei Lin

In this paper, we propose \textbf{UniCode}, a novel approach within the domain of multimodal large language models (MLLMs) that learns a unified codebook to efficiently tokenize visual, text, and potentially other types of signals. This…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Sipeng Zheng , Bohan Zhou , Yicheng Feng , Ye Wang , Zongqing Lu

Multimodal large language models (MLLMs) have gained significant attention due to their strong multimodal understanding capability. However, existing works rely heavily on modality-specific encoders, which usually differ in architecture and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Jiaming Han , Kaixiong Gong , Yiyuan Zhang , Jiaqi Wang , Kaipeng Zhang , Dahua Lin , Yu Qiao , Peng Gao , Xiangyu Yue

Sequential recommendation demonstrates the capability to recommend items by modeling the sequential behavior of users. Traditional methods typically treat users as sequences of items, overlooking the collaborative relationships among them.…

Information Retrieval · Computer Science 2023-08-15 Sijia Liu , Jiahao Liu , Hansu Gu , Dongsheng Li , Tun Lu , Peng Zhang , Ning Gu

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang

When adapting Large Language Models for Recommendation (LLMRec), it is crucial to integrate collaborative information. Existing methods achieve this by learning collaborative embeddings in LLMs' latent space from scratch or by mapping from…

Information Retrieval · Computer Science 2024-06-06 Yang Zhang , Keqin Bao , Ming Yan , Wenjie Wang , Fuli Feng , Xiangnan He

Acquiring valuable data from the rapidly expanding information on the internet has become a significant concern, and recommender systems have emerged as a widely used and effective tool for helping users discover items of interest. The…

Information Retrieval · Computer Science 2025-02-25 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Wei Wang , Xiping Hu , Steven Hoi , Edith Ngai

We present UniBind, a flexible and efficient approach that learns a unified representation space for seven diverse modalities -- images, text, audio, point cloud, thermal, video, and event data. Existing works, eg., ImageBind, treat the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yuanhuiyi Lyu , Xu Zheng , Jiazhou Zhou , Lin Wang

Multimodal learning aims to build models that can process and relate information from multiple modalities. Despite years of development in this field, it still remains challenging to design a unified network for processing various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yiyuan Zhang , Kaixiong Gong , Kaipeng Zhang , Hongsheng Li , Yu Qiao , Wanli Ouyang , Xiangyu Yue

Large Language Models (LLMs) for Recommendation (LLM4Rec) is a promising research direction that has demonstrated exceptional performance in this field. However, its inability to capture real-time user preferences greatly limits the…

Information Retrieval · Computer Science 2025-02-26 Zheqi Lv , Tianyu Zhan , Wenjie Wang , Xinyu Lin , Shengyu Zhang , Wenqiao Zhang , Jiwei Li , Kun Kuang , Fei Wu

Recommender systems have become increasingly ubiquitous in daily life. While traditional recommendation approaches primarily rely on ID-based representations or item-side content features, they often fall short in capturing the underlying…

Information Retrieval · Computer Science 2025-08-12 Yunze Luo , Yinjie Jiang , Gaode Chen , Xinghua Zhang , Jun Zhang , Jian Liang , Kaigui Bian

Conventional recommendation systems frequently fail to fully exploit the high-dimensional semantic signals inherent in multimedia content, thereby limiting the fidelity of user preference modeling. While Multimodal Large Language Models…

Information Retrieval · Computer Science 2026-05-12 Yiming Zhu , Xu Liu , Ziyun Xu , Zheng Wu , Joena Zhang , Sirius Chen , Chenheli Hua , Silvester Yao , Qichao Que , Wentao Shi , Junfeng Pan , Linhong Zhu

The application of Large Language Models (LLMs) in recommender systems faces key challenges in delivering deep personalization and intelligent reasoning, especially for interactive scenarios. Current methods are often constrained by limited…

Information Retrieval · Computer Science 2025-10-17 Jiani Huang , Xingchen Zou , Lianghao Xia , Qing Li