English
Related papers

Related papers: SIREN: Unified Multi-Granularity Semantic Interact…

200 papers

Existing multimodal generative models fall short as qualified design copilots, as they often struggle to generate imaginative outputs once instructions are less detailed or lack the ability to maintain consistency with the provided…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zhipeng Huang , Shaobin Zhuang , Canmiao Fu , Binxin Yang , Ying Zhang , Chong Sun , Zhizheng Zhang , Yali Wang , Chen Li , Zheng-Jun Zha

In the rapidly evolving landscape of AI research and application, Multimodal Large Language Models (MLLMs) have emerged as a transformative force, adept at interpreting and integrating information from diverse modalities such as text,…

Artificial Intelligence · Computer Science 2024-07-23 Abdur Rahman , Rajat Chawla , Muskaan Kumar , Arkajit Datta , Adarsh Jha , Mukunda NS , Ishaan Bhola

Sequential recommendation aims to capture user preferences by modeling sequential patterns in user-item interactions. However, these models are often influenced by noise such as accidental interactions, leading to suboptimal performance.…

Information Retrieval · Computer Science 2025-10-07 Tongzhou Wu , Yuhao Wang , Maolin Wang , Chi Zhang , Xiangyu Zhao

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches…

Information Retrieval · Computer Science 2024-12-10 Minglai Shao , Hua Huang , Qiyao Peng , Hongtao Liu

Cross-modal retrieval (CMR) is a fundamental task in multimedia research, focused on retrieving semantically relevant targets across different modalities. While traditional CMR methods match text and image via embedding-based similarity…

Information Retrieval · Computer Science 2025-04-18 Haoxuan Li , Yi Bin , Yunshan Ma , Guoqing Wang , Yang Yang , See-Kiong Ng , Tat-Seng Chua

Many early neural Information Retrieval (NeurIR) methods are re-rankers that rely on a traditional first-stage retriever due to expensive query time computations. Recently, representation-based retrievers have gained much attention, which…

Information Retrieval · Computer Science 2023-11-28 Sibo Dong , Justin Goldstein , Grace Hui Yang

With the expansion of business scales and scopes on online platforms, multi-scenario matching has become a mainstream solution to reduce maintenance costs and alleviate data sparsity. The key to effective multi-scenario recommendation lies…

Information Retrieval · Computer Science 2025-06-24 Haotong Du , Yaqing Wang , Fei Xiong , Lei Shao , Ming Liu , Hao Gu , Quanming Yao , Zhen Wang

User interests can be viewed over different time scales, mainly including stable long-term preferences and changing short-term intentions, and their combination facilitates the comprehensive sequential recommendation. However, existing work…

Information Retrieval · Computer Science 2024-07-23 Xinyu Zhang , Beibei Li , Beihong Jin

With the rapid evolution of Large Language Models (LLMs), generative recommendation is gradually reshaping the paradigm of recommender systems. However, most existing methods remain confined to the interaction-driven next-item prediction…

Information Retrieval · Computer Science 2026-04-21 Yang Yu , Lei Kou , Huaikuan Yi , Bin Chen , Yayu Cao , Lei Shen , Chao Zhang , Bing Wang , Xiaoyi Zeng

Interest modeling in recommender system has been a constant topic for improving user experience, and typical interest modeling tasks (e.g. multi-interest, long-tail interest and long-term interest) have been investigated in many existing…

Information Retrieval · Computer Science 2024-02-06 Jing Yan , Liu Jiang , Jianfei Cui , Zhichen Zhao , Xingyan Bin , Feng Zhang , Zuotao Liu

Modern online service providers such as online shopping platforms often provide both search and recommendation (S&R) services to meet different user needs. Rarely has there been any effective means of incorporating user behavior data from…

Information Retrieval · Computer Science 2023-05-19 Zihua Si , Zhongxiang Sun , Xiao Zhang , Jun Xu , Xiaoxue Zang , Yang Song , Kun Gai , Ji-Rong Wen

Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e.g., purchasing and clicking). Humans perceive…

Information Retrieval · Computer Science 2023-02-10 Hongyu Zhou , Xin Zhou , Zhiwei Zeng , Lingzi Zhang , Zhiqi Shen

Multimodal learning has shown significant performance boost compared to ordinary unimodal models across various domains. However, in real-world scenarios, multimodal signals are susceptible to missing because of sensor failures and adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Nhi Kieu , Kien Nguyen , Arnold Wiliem , Clinton Fookes , Sridha Sridharan

Generative recommendation models often struggle with two key challenges: (1) the superficial integration of collaborative signals, and (2) the decoupled fusion of multimodal features. These limitations hinder the creation of a truly…

Information Retrieval · Computer Science 2025-12-29 Yuzhen Lin , Hongyi Chen , Xuanjing Chen , Shaowen Wang , Ivonne Xu , Dongming Jiang

Extracting users' interests from their lifelong behavior sequence is crucial for predicting Click-Through Rate (CTR). Most current methods employ a two-stage process for efficiency: they first select historical behaviors related to the…

Information Retrieval · Computer Science 2024-10-30 Qi Liu , Xuyang Hou , Haoran Jin , Xiaolong Chen , Jin Chen , Defu Lian , Zhe Wang , Jia Cheng , Jun Lei

Recommendation systems aim to learn user interests from historical behaviors and deliver relevant items. Recent methods leverage large language models (LLMs) to construct and integrate semantic representations of users and items for…

Information Retrieval · Computer Science 2026-03-17 Xiaofei Zhu , Jinfei Chen , Feiyang Yuan , Zhou Yang

With the evolution of large language models (LLMs), there is growing interest in leveraging their rich semantic understanding to enhance industrial recommendation systems (RecSys). Traditional RecSys relies on ID-based embeddings for user…

Multi-modal sequential recommendation systems leverage auxiliary signals (e.g., text, images) to alleviate data sparsity in user-item interactions. While recent methods exploit large language models to encode modalities into discrete…

Information Retrieval · Computer Science 2025-04-10 Kaiyuan Li , Rui Xiang , Yong Bai , Yongxiang Tang , Yanhua Cheng , Xialong Liu , Peng Jiang , Kun Gai

Multimodal intent recognition (MIR) seeks to accurately interpret user intentions by integrating verbal and non-verbal information across video, audio and text modalities. While existing approaches prioritize text analysis, they often…

Multimedia · Computer Science 2025-06-13 Weiyin Gong , Kai Zhang , Yanghai Zhang , Qi Liu , Xinjie Sun , Junyu Lu , Linbo Zhu

Modeling ultra-long user behavior sequences is critical for capturing both long- and short-term preferences in industrial recommender systems. Existing solutions typically rely on two-stage retrieval or indirect modeling paradigms, incuring…

Information Retrieval · Computer Science 2025-07-21 Zheng Chai , Qin Ren , Xijun Xiao , Huizhi Yang , Bo Han , Sijun Zhang , Di Chen , Hui Lu , Wenlin Zhao , Lele Yu , Xionghang Xie , Shiru Ren , Xiang Sun , Yaocheng Tan , Peng Xu , Yuchao Zheng , Di Wu