English
Related papers

Related papers: Progressive Semantic Residual Quantization for Mul…

200 papers

Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp…

Information Retrieval · Computer Science 2024-09-20 Mingyue Cheng , Hao Zhang , Qi Liu , Fajie Yuan , Zhi Li , Zhenya Huang , Enhong Chen , Jun Zhou , Longfei Li

This article presents a novel approach to multimodal recommendation systems, focusing on integrating and purifying multimodal data. Our methodology starts by developing a filter to remove noise from various types of data, making the…

Information Retrieval · Computer Science 2024-05-30 Mert Burabak , Tevfik Aytekin

Referring image segmentation aims to localize and segment a target object in an image based on a free-form referring expression. The core challenge lies in effectively bridging linguistic descriptions with object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiachen Li , Hongyun Wang , Jinyu Xu , Wenbo Jiang , Yanchun Ma , Yongjian Liu , Qing Xie , Bolong Zheng

Generative recommendation models often struggle with two key challenges: (1) the superficial integration of collaborative signals, and (2) the decoupled fusion of multimodal features. These limitations hinder the creation of a truly…

Information Retrieval · Computer Science 2025-12-29 Yuzhen Lin , Hongyi Chen , Xuanjing Chen , Shaowen Wang , Ivonne Xu , Dongming Jiang

The recommender system (RS) has been an integral toolkit of online services. They are equipped with various deep learning techniques to model user preference based on identifier and attribute information. With the emergence of multimedia…

Information Retrieval · Computer Science 2024-09-05 Qidong Liu , Jiaxi Hu , Yutian Xiao , Xiangyu Zhao , Jingtong Gao , Wanyu Wang , Qing Li , Jiliang Tang

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

The sequential recommendation system utilizes historical user interactions to predict preferences. Effectively integrating diverse user behavior patterns with rich multimodal information of items to enhance the accuracy of sequential…

Information Retrieval · Computer Science 2025-08-08 Xiaoxi Cui , Weihai Lu , Yu Tong , Yiheng Li , Zhejun Zhao

Large language models (LLMs) have recently demonstrated strong potential for sequential recommendation. However, current LLM-based approaches face critical limitations in modeling users' long-term and diverse interests. First, due to…

Information Retrieval · Computer Science 2025-10-30 Jingyi Zhou , Cheng Chen , Kai Zuo , Manjie Xu , Zhendong Fu , Yibo Chen , Xu Tang , Yao Hu

In recent years, substantial research efforts have been devoted to enhancing sequential recommender systems by integrating abundant side information with ID-based collaborative information. This study specifically focuses on leveraging the…

Information Retrieval · Computer Science 2025-05-27 Enze Liu , Bowen Zheng , Wayne Xin Zhao , Ji-Rong Wen

Visually impaired users face significant challenges in daily information access and real-time environmental perception, and there is an urgent need for intelligent assistive systems with accurate recognition capabilities. Although…

Generative Recommendation (GR) has excelled by framing recommendation as next-token prediction. This paradigm relies on Semantic IDs (SIDs) to tokenize large-scale items into discrete sequences. Existing GR approaches predominantly generate…

Information Retrieval · Computer Science 2026-05-22 Jie Jiang , Xinxun Zhang , Enming Zhang , Yuling Xiong , Jun Zhang , Jingwen Wang , Huan Yu , Yuxiang Wang , Hao Wang , Xiao Yan , Jiawei Jiang

Vector Quantization (VQ) has become the cornerstone of tokenization for many multimodal Large Language Models and diffusion synthesis. However, existing VQ paradigms suffer from a fundamental conflict: they enforce discretization before the…

Machine Learning · Computer Science 2026-03-25 Wenhao Zhao , Qiran Zou , Zhouhan Lin , Dianbo Liu

Personalized recommendation serves as a ubiquitous channel for users to discover information tailored to their interests. However, traditional recommendation models primarily rely on unique IDs and categorical features for user-item…

Information Retrieval · Computer Science 2024-07-04 Qijiong Liu , Jieming Zhu , Yanting Yang , Quanyu Dai , Zhaocheng Du , Xiao-Ming Wu , Zhou Zhao , Rui Zhang , Zhenhua Dong

The main task of personalized recommendation is capturing users' interests based on their historical behaviors. Most of recent advances in recommender systems mainly focus on modeling users' preferences accurately using deep learning based…

Information Retrieval · Computer Science 2020-07-15 Shihao Li , Dekun Yang , Bufeng Zhang

Multimodal regression aims to predict a continuous target from heterogeneous input sources and typically relies on fusion strategies such as early or late fusion. However, existing methods lack principled tools to disentangle and quantify…

Machine Learning · Computer Science 2025-12-29 Zhaozhao Ma , Shujian Yu

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Intent-based recommender systems have garnered significant attention for uncovering latent fine-grained preferences. Intents, as underlying factors of interactions, are crucial for improving recommendation interpretability. Most methods…

Information Retrieval · Computer Science 2025-04-10 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Retrieving relevant images from a catalog based on a query image together with a modifying caption is a challenging multimodal task that can particularly benefit domains like apparel shopping, where fine details and subtle variations may be…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Eric Dodds , Jack Culpepper , Gaurav Srivastava

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interactions with multimodal…

Information Retrieval · Computer Science 2022-03-18 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Mengqi Zhang , Shu Wu , Liang Wang