中文
相关论文

相关论文: Multi-Modality is All You Need for Transferable Re…

200 篇论文

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

Sequential Recommendation (SR) plays a pivotal role in recommender systems by tailoring recommendations to user preferences based on their non-stationary historical interactions. Achieving high-quality performance in SR requires attention…

信息检索 · 计算机科学 2024-08-23 Wuchao Li , Rui Huang , Haijun Zhao , Chi Liu , Kai Zheng , Qi Liu , Na Mou , Guorui Zhou , Defu Lian , Yang Song , Wentian Bao , Enyun Yu , Wenwu Ou

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

机器学习 · 计算机科学 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Multimodal regression aims to predict a continuous target from heterogeneous input sources and typically relies on fusion strategies such as early or late fusion. However, existing methods lack principled tools to disentangle and quantify…

机器学习 · 计算机科学 2025-12-29 Zhaozhao Ma , Shujian Yu

We propose HyMoERec, a novel sequential recommendation framework that addresses the limitations of uniform Position-wise Feed-Forward Networks in existing models. Current approaches treat all user interactions and items equally, overlooking…

信息检索 · 计算机科学 2025-11-11 Kunrong Li , Zhu Sun , Kwan Hui Lim

Multi-modal recommender systems (MRSs) have achieved notable success in improving personalization by leveraging diverse modalities such as images, text, and audio. However, two key challenges remain insufficiently addressed: (1)…

信息检索 · 计算机科学 2025-04-24 Jiwan Kim , Hongseok Kang , Sein Kim , Kibum Kim , Chanyoung Park

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities.…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

The primary challenges in visible-infrared person re-identification arise from the differences between visible (vis) and infrared (ir) images, including inter-modal and intra-modal variations. These challenges are further complicated by…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Jiarui Li , Zhen Qiu , Yilin Yang , Yuqi Li , Zeyu Dong , Chuanguang Yang

Graph neural networks (GNNs) have revolutionized recommender systems by effectively modeling complex user-item interactions, yet data sparsity and the item cold-start problem significantly impair performance, particularly for new items with…

机器学习 · 计算机科学 2026-03-04 Jialin Liu , Zhaorui Zhang , Ray C. C. Cheung

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

信息检索 · 计算机科学 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

Multimodal recommendation has emerged as a mainstream paradigm, typically leveraging text and visual embeddings extracted from pre-trained models such as Sentence-BERT, Vision Transformers, and ResNet. This approach is founded on the…

信息检索 · 计算机科学 2026-01-19 Yu Ye , Junchen Fu , Yu Song , Kaiwen Zheng , Joemon M. Jose

Multimodal recommendation faces an issue of the performance degradation that the uni-modal recommendation sometimes achieves the better performance. A possible reason is that the unreliable item modality data hurts the fusion result.…

信息检索 · 计算机科学 2025-04-24 Xue Dong , Xuemeng Song , Na Zheng , Sicheng Zhao , Guiguang Ding

Following recent successes in exploiting both latent factor and word embedding models in recommendation, we propose a novel Regularized Multi-Embedding (RME) based recommendation model that simultaneously encapsulates the following ideas…

信息检索 · 计算机科学 2018-09-05 Thanh Tran , Kyumin Lee , Yiming Liao , Dongwon Lee

Sequential Recommender Systems (SRS) aim to predict users' next interaction based on their historical behaviors, while still facing the challenge of data sparsity. With the rapid advancement of Multimodal Large Language Models (MLLMs),…

信息检索 · 计算机科学 2026-02-17 Mingyao Huang , Qidong Liu , Wenxuan Yang , Moranxin Wang , Yuqi Sun , Haiping Zhu , Feng Tian , Yan Chen

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

图像与视频处理 · 电气工程与系统科学 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Generative recommendation systems have gained increasing attention as an innovative approach that directly generates item identifiers for recommendation tasks. Despite their potential, a major challenge is the effective construction of item…

信息检索 · 计算机科学 2025-06-05 Enze Liu , Bowen Zheng , Cheng Ling , Lantao Hu , Han Li , Wayne Xin Zhao

With the growth of online shopping for fashion products, accurate fashion recommendation has become a critical problem. Meanwhile, social networks provide an open and new data source for personalized fashion analysis. In this work, we study…

计算机视觉与模式识别 · 计算机科学 2020-05-27 Haitian Zheng , Kefei Wu , Jong-Hwi Park , Wei Zhu , Jiebo Luo

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

信息检索 · 计算机科学 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

Current multimodal sequential recommendation models are often unable to effectively explore and capture correlations among behavior sequences of users and items across different modalities, either neglecting correlations among sequence…

信息检索 · 计算机科学 2024-07-23 Lingzi Zhang , Xin Zhou , Zhiwei Zeng , Zhiqi Shen

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

信息检索 · 计算机科学 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang