English
Related papers

Related papers: Modality Alignment with Multi-scale Bilateral Atte…

200 papers

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

Artificial Intelligence · Computer Science 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Vision Language Place Recognition (VLVPR) enhances robot localization performance by incorporating natural language descriptions from images. By utilizing language information, VLVPR directs robot place matching, overcoming the constraint…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Tianyi Shang , Zhenyu Li , Pengjie Xu , Jinwei Qiao

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Sequential recommendation systems aim to provide personalized recommendations by analyzing dynamic preferences and dependencies within user behavior sequences. Recently, Transformer models can effectively capture user preferences. However,…

Information Retrieval · Computer Science 2024-07-30 Shun Zhang , Runsen Zhang , Zhirong Yang

Multimodal recommendation has emerged as a promising solution to alleviate the cold-start and sparsity problems in collaborative filtering by incorporating rich content information, such as product images and textual descriptions. However,…

Information Retrieval · Computer Science 2025-06-03 Sibei Liu , Yuanzhe Zhang , Xiang Li , Yunbo Liu , Chengwei Feng , Hao Yang

The core of the general recommender systems lies in learning high-quality embedding representations of users and items to investigate their positional relations in the feature space. Unfortunately, data sparsity caused by…

Information Retrieval · Computer Science 2025-04-24 Yi Zhang , Yiwen Zhang

Modern recommendation systems face significant challenges in processing multimodal sequential data, particularly in temporal dynamics modeling and information flow coordination. Traditional approaches struggle with distribution…

Information Retrieval · Computer Science 2025-08-29 Maolin Wang , Yutian Xiao , Binhao Wang , Sheng Zhang , Shanshan Ye , Wanyu Wang , Hongzhi Yin , Ruocheng Guo , Zenglin Xu

The Sequential Recommendation modeling paradigm is shifting from Transformer to Mamba architecture, which comprises two generations: Mamba1, based on the State Space Model (SSM), and Mamba2, based on State Space Duality (SSD). Although SSD…

Information Retrieval · Computer Science 2025-08-21 Hao Fan , Mengyi Zhu , Yanrong Hu , Hailin Feng , Zhijie He , Hongjiu Liu , Qingyang Liu

Multi-interest recommendation has gained attention, especially in industrial retrieval stage. Unlike classical dual-tower methods, it generates multiple user representations instead of a single one to model comprehensive user interests.…

Information Retrieval · Computer Science 2025-10-17 Zhibo Wu , Yunfan Wu , Quan Liu , Lin Jiang , Ping Yang , Yao Hu

Modern recommender systems trained on domain-specific data often struggle to generalize across multiple domains. Cross-domain sequential recommendation has emerged as a promising research direction to address this challenge; however,…

Information Retrieval · Computer Science 2026-01-06 Hyunsoo Kim , Jaewan Moon , Seongmin Park , Jongwuk Lee

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

Recently, neural networks have been widely used in e-commerce recommender systems, owing to the rapid development of deep learning. We formalize the recommender system as a sequential recommendation problem, intending to predict the next…

Information Retrieval · Computer Science 2020-08-04 Yukuo Cen , Jianwei Zhang , Xu Zou , Chang Zhou , Hongxia Yang , Jie Tang

Multimodal large language models (MLLMs) recently showed strong capacity in integrating data among multiple modalities, empowered by a generalizable attention architecture. Advanced methods predominantly focus on language-centric tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zhicheng Zhang , Wuyou Xia , Chenxi Zhao , Zhou Yan , Xiaoqiang Liu , Yongjie Zhu , Wenyu Qin , Pengfei Wan , Di Zhang , Jufeng Yang

Deformed document image rectification is essential for real-world document understanding tasks, such as layout analysis and text recognition. However, current multi-task methods -- such as background removal, 3D coordinate prediction, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Heng Li , Xiangping Wu , Qingcai Chen

Recent advances in multimodal recommendation enable richer item understanding, while modeling users' multi-scale interests across temporal horizons has attracted growing attention. However, effectively exploiting multimodal item sequences…

Information Retrieval · Computer Science 2025-08-14 Yongrui Fu , Jian Liu , Tao Li , Zonggang Wu , Shouke Qin , Hanmeng Liu

Many multimodal recommender systems have been proposed to exploit the rich side information associated with users or items (e.g., user reviews and item images) for learning better user and item representations to improve the recommendation…

Information Retrieval · Computer Science 2022-10-26 Fan Liu , Huilin Chen , Zhiyong Cheng , Anan Liu , Liqiang Nie , Mohan Kankanhalli

Multimodal embedding models, built upon causal Vision Language Models (VLMs), have shown promise in various tasks. However, current approaches face three key limitations: the use of causal attention in VLM backbones is suboptimal for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Haonan Chen , Hong Liu , Yuping Luo , Liang Wang , Nan Yang , Furu Wei , Zhicheng Dou

Multi-modal recommender systems (MRSs) have achieved notable success in improving personalization by leveraging diverse modalities such as images, text, and audio. However, two key challenges remain insufficiently addressed: (1)…

Information Retrieval · Computer Science 2025-04-24 Jiwan Kim , Hongseok Kang , Sein Kim , Kibum Kim , Chanyoung Park

Most existing multimodal trackers adopt uniform fusion strategies, overlooking the inherent differences between modalities. Moreover, they propagate temporal information through mixed tokens, leading to entangled and less discriminative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Shilei Wang , Pujian Lai , Dong Gao , Jifeng Ning , Gong Cheng

The explosion of multimedia data in information-rich environments has intensified the challenges of personalized content discovery, positioning recommendation systems as an essential form of passive data management. Multimodal sequential…

Information Retrieval · Computer Science 2026-03-05 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Yijie Li , Jianheng Tang , Yunhuai Liu , Edith C. H. Ngai