English
Related papers

Related papers: EGRA:Toward Enhanced Behavior Graphs and Represent…

200 papers

This article presents a novel approach to multimodal recommendation systems, focusing on integrating and purifying multimodal data. Our methodology starts by developing a filter to remove noise from various types of data, making the…

Information Retrieval · Computer Science 2024-05-30 Mert Burabak , Tevfik Aytekin

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

Artificial Intelligence · Computer Science 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

Multimodal recommendation focuses primarily on effectively exploiting both behavioral and multimodal information for the recommendation task. However, most existing models suffer from the following issues when fusing information from two…

Information Retrieval · Computer Science 2024-09-10 Kangning Zhang , Yingjie Qin , Jiarui Jin , Yifan Liu , Ruilong Su , Weinan Zhang , Yong Yu

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very…

Multimedia · Computer Science 2022-11-01 Xuan Yang , Quanjin Tao , Xiao Feng , Donghong Cai , Xiang Ren , Yang Yang

Multi-modal entity alignment aims to identify equivalent entities between two multi-modal Knowledge graphs by integrating multi-modal data, such as images and text, to enrich the semantic representations of entities. However, existing…

Artificial Intelligence · Computer Science 2026-01-21 Zhifei Li , Ziyue Qin , Xiangyu Luo , Xiaoju Hou , Yue Zhao , Miao Zhang , Zhifang Huang , Kui Xiao , Bing Yang

Multimodal Emotion Recognition (MER) aims to perceive human emotions through three modes: language, vision, and audio. Previous methods primarily focused on modal fusion without adequately addressing significant distributional differences…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jichao Zhu , Jun Yu

Integrating diverse data modalities is crucial for enhancing the performance of personalized recommendation systems. Traditional models, which often rely on singular data sources, lack the depth needed to accurately capture the multifaceted…

Information Retrieval · Computer Science 2025-02-18 Luyi Ma , Xiaohan Li , Zezhong Fan , Kai Zhao , Jianpeng Xu , Jason Cho , Praveen Kanumala , Kaushiki Nag , Sushant Kumar , Kannan Achan

Multimodal recommendation enhances ranking by integrating user-item interactions with item content, which is particularly effective under sparse feedback and long-tail distributions. However, multimodal signals are inherently heterogeneous…

Artificial Intelligence · Computer Science 2026-02-27 Ji Dai , Quan Fang , Dengsheng Cai

Multi-modal recommendation greatly enhances the performance of recommender systems by modeling the auxiliary information from multi-modality contents. Most existing multi-modal recommendation models primarily exploit multimedia information…

Information Retrieval · Computer Science 2024-07-09 Xinglong Wu , Anfeng Huang , Hongwei Yang , Hui He , Yu Tai , Weizhe Zhang

Textual descriptions for multimodal inputs entail recurrent refinement of queries to produce relevant output images. Despite efforts to address challenges such as scaling model size and data volume, the cost associated with pre-training and…

Machine Learning · Computer Science 2025-08-14 Amit Kumar Jaiswal , Haiming Liu , Ingo Frommholz

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

Incomplete multi-modal emotion recognition (IMER) aims at understanding human intentions and sentiments by comprehensively exploring the partially observed multi-source data. Although the multi-modal data is expected to provide more…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Wen-Jue He , Xiaofeng Zhu , Zheng Zhang

Collaborative filtering-based recommender systems that rely on a single type of behavior often encounter serious sparsity issues in real-world applications, leading to unsatisfactory performance. Multi-behavior Recommendation (MBR) is a…

Information Retrieval · Computer Science 2023-06-21 Mingshi Yan , Zhiyong Cheng , Jing Sun , Fuming Sun , Yuxin Peng

Multi-behavior recommendation faces a critical challenge in practice: auxiliary behaviors (e.g., clicks, carts) are often noisy, weakly correlated, or semantically misaligned with the target behavior (e.g., purchase), which leads to biased…

Information Retrieval · Computer Science 2026-01-22 Miaomiao Cai , Zhijie Zhang , Junfeng Fang , Zhiyong Cheng , Xiang Wang , Meng Wang

Graph-based models have emerged as a powerful paradigm for modeling multimodal urban data and learning region representations for various downstream tasks. However, existing approaches face two major limitations. (1) They typically employ…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yaya Zhao , Kaiqi Zhao , Zixuan Tang , Zhiyuan Liu , Xiaoling Lu , Yalei Du

Generative Recommendation (GR) has emerged as a new paradigm in recommender systems. This approach relies on quantized representations to discretize item features, modeling users' historical interactions as sequences of discrete tokens.…

Information Retrieval · Computer Science 2025-11-25 Fuwei Zhang , Xiaoyu Liu , Dongbo Xi , Jishen Yin , Huan Chen , Peng Yan , Fuzhen Zhuang , Zhao Zhang

Multi-modal recommender systems (MRSs) are pivotal in diverse online web platforms and have garnered considerable attention in recent years. However, previous studies overlook the challenges of (1) noisy multi-modal content, (2) noisy user…

Information Retrieval · Computer Science 2025-04-03 Guipeng Xv , Xinyu Li , Ruobing Xie , Chen Lin , Chong Liu , Feng Xia , Zhanhui Kang , Leyu Lin

In the contemporary age characterized by information abundance, rapid advancements in artificial intelligence have rendered recommendation systems indispensable. Conventional recommendation methodologies based on collaborative filtering or…

Information Retrieval · Computer Science 2025-09-04 Yu Fang

Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from different modalities.…

Information Retrieval · Computer Science 2024-04-30 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

Machine Learning · Computer Science 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li