English
Related papers

Related papers: Multi-Modality is All You Need for Transferable Re…

200 papers

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

Sequential Recommendation (SR) plays a pivotal role in recommender systems by tailoring recommendations to user preferences based on their non-stationary historical interactions. Achieving high-quality performance in SR requires attention…

Information Retrieval · Computer Science 2024-08-23 Wuchao Li , Rui Huang , Haijun Zhao , Chi Liu , Kai Zheng , Qi Liu , Na Mou , Guorui Zhou , Defu Lian , Yang Song , Wentian Bao , Enyun Yu , Wenwu Ou

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

Machine Learning · Computer Science 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Multimodal regression aims to predict a continuous target from heterogeneous input sources and typically relies on fusion strategies such as early or late fusion. However, existing methods lack principled tools to disentangle and quantify…

Machine Learning · Computer Science 2025-12-29 Zhaozhao Ma , Shujian Yu

We propose HyMoERec, a novel sequential recommendation framework that addresses the limitations of uniform Position-wise Feed-Forward Networks in existing models. Current approaches treat all user interactions and items equally, overlooking…

Information Retrieval · Computer Science 2025-11-11 Kunrong Li , Zhu Sun , Kwan Hui Lim

Multi-modal recommender systems (MRSs) have achieved notable success in improving personalization by leveraging diverse modalities such as images, text, and audio. However, two key challenges remain insufficiently addressed: (1)…

Information Retrieval · Computer Science 2025-04-24 Jiwan Kim , Hongseok Kang , Sein Kim , Kibum Kim , Chanyoung Park

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

The primary challenges in visible-infrared person re-identification arise from the differences between visible (vis) and infrared (ir) images, including inter-modal and intra-modal variations. These challenges are further complicated by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jiarui Li , Zhen Qiu , Yilin Yang , Yuqi Li , Zeyu Dong , Chuanguang Yang

Graph neural networks (GNNs) have revolutionized recommender systems by effectively modeling complex user-item interactions, yet data sparsity and the item cold-start problem significantly impair performance, particularly for new items with…

Machine Learning · Computer Science 2026-03-04 Jialin Liu , Zhaorui Zhang , Ray C. C. Cheung

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

Multimodal recommendation has emerged as a mainstream paradigm, typically leveraging text and visual embeddings extracted from pre-trained models such as Sentence-BERT, Vision Transformers, and ResNet. This approach is founded on the…

Information Retrieval · Computer Science 2026-01-19 Yu Ye , Junchen Fu , Yu Song , Kaiwen Zheng , Joemon M. Jose

Multimodal recommendation faces an issue of the performance degradation that the uni-modal recommendation sometimes achieves the better performance. A possible reason is that the unreliable item modality data hurts the fusion result.…

Information Retrieval · Computer Science 2025-04-24 Xue Dong , Xuemeng Song , Na Zheng , Sicheng Zhao , Guiguang Ding

Following recent successes in exploiting both latent factor and word embedding models in recommendation, we propose a novel Regularized Multi-Embedding (RME) based recommendation model that simultaneously encapsulates the following ideas…

Information Retrieval · Computer Science 2018-09-05 Thanh Tran , Kyumin Lee , Yiming Liao , Dongwon Lee

Sequential Recommender Systems (SRS) aim to predict users' next interaction based on their historical behaviors, while still facing the challenge of data sparsity. With the rapid advancement of Multimodal Large Language Models (MLLMs),…

Information Retrieval · Computer Science 2026-02-17 Mingyao Huang , Qidong Liu , Wenxuan Yang , Moranxin Wang , Yuqi Sun , Haiping Zhu , Feng Tian , Yan Chen

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Generative recommendation systems have gained increasing attention as an innovative approach that directly generates item identifiers for recommendation tasks. Despite their potential, a major challenge is the effective construction of item…

Information Retrieval · Computer Science 2025-06-05 Enze Liu , Bowen Zheng , Cheng Ling , Lantao Hu , Han Li , Wayne Xin Zhao

With the growth of online shopping for fashion products, accurate fashion recommendation has become a critical problem. Meanwhile, social networks provide an open and new data source for personalized fashion analysis. In this work, we study…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Haitian Zheng , Kefei Wu , Jong-Hwi Park , Wei Zhu , Jiebo Luo

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

Information Retrieval · Computer Science 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

Current multimodal sequential recommendation models are often unable to effectively explore and capture correlations among behavior sequences of users and items across different modalities, either neglecting correlations among sequence…

Information Retrieval · Computer Science 2024-07-23 Lingzi Zhang , Xin Zhou , Zhiwei Zeng , Zhiqi Shen

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang