English
Related papers

Related papers: EGRA:Toward Enhanced Behavior Graphs and Represent…

200 papers

Multi-modal entity alignment (MMEA) aims to discover identical entities across different knowledge graphs (KGs) whose entities are associated with relevant images. However, current MMEA algorithms rely on KG-level modality fusion strategies…

Artificial Intelligence · Computer Science 2023-08-01 Zhuo Chen , Jiaoyan Chen , Wen Zhang , Lingbing Guo , Yin Fang , Yufeng Huang , Yichi Zhang , Yuxia Geng , Jeff Z. Pan , Wenting Song , Huajun Chen

Incorporating multi-modal features as side information has recently become a trend in recommender systems. To elucidate user-item preferences, recent studies focus on fusing modalities via concatenation, element-wise sum, or attention…

Information Retrieval · Computer Science 2024-12-20 Rongqing Kenneth Ong , Andy W. H. Khong

Multi-behavior recommendation systems enhance effectiveness by leveraging auxiliary behaviors (such as page views and favorites) to address the limitations of traditional models that depend solely on sparse target behaviors like purchases.…

Information Retrieval · Computer Science 2024-08-23 Haojie Li , Zhiyong Cheng , Xu Yu , Jinhuan Liu , Guanfeng Liu , Junwei Du

Multimodal recommendation faces an issue of the performance degradation that the uni-modal recommendation sometimes achieves the better performance. A possible reason is that the unreliable item modality data hurts the fusion result.…

Information Retrieval · Computer Science 2025-04-24 Xue Dong , Xuemeng Song , Na Zheng , Sicheng Zhao , Guiguang Ding

The rapid increase in multimedia data has spurred advancements in Multimodal Summarization with Multimodal Output (MSMO), which aims to produce a multimodal summary that integrates both text and relevant images. The inherent heterogeneity…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Yanghai Zhang , Ye Liu , Shiwei Wu , Kai Zhang , Xukai Liu , Qi Liu , Enhong Chen

Multi-Behavior Recommendation (MBR) leverages multiple user interaction types (e.g., views, clicks, purchases) to enrich preference modeling and alleviate data sparsity issues in traditional single-behavior approaches. However, existing MBR…

Information Retrieval · Computer Science 2026-03-27 Ranxu Zhang , Junjie Meng , Ying Sun , Ziqi Xu , Bing Yin , Hao Li , Yanyong Zhang , Chao Wang

With the rapid development of online multimedia services, especially in e-commerce platforms, there is a pressing need for personalised recommendation systems that can effectively encode the diverse multi-modal content associated with each…

Artificial Intelligence · Computer Science 2024-07-30 Zixuan Yi , Iadh Ounis

As one of the main solutions to the information overload problem, recommender systems are widely used in daily life. In the recent emerging micro-video recommendation scenario, micro-videos contain rich multimedia information, involving…

Information Retrieval · Computer Science 2022-05-31 Breda Lim , Shubhi Bansal , Ahmed Buru , Kayla Manthey

In the medical multi-modal frameworks, the alignment of cross-modality features presents a significant challenge. However, existing works have learned features that are implicitly aligned from the data, without considering the explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Chong Ma , Hanqi Jiang , Wenting Chen , Yiwei Li , Zihao Wu , Xiaowei Yu , Zhengliang Liu , Lei Guo , Dajiang Zhu , Tuo Zhang , Dinggang Shen , Tianming Liu , Xiang Li

Multimodal recommender systems improve the performance of canonical recommender systems with no item features by utilizing diverse content types such as text, images, and videos, while alleviating inherent sparsity of user-item interactions…

Information Retrieval · Computer Science 2026-03-25 Yu-Seung Roh , Joo-Young Kim , Jin-Duk Park , Won-Yong Shin

Multi-Modal Entity Alignment (MMEA) aims to retrieve equivalent entities from different Multi-Modal Knowledge Graphs (MMKGs), a critical information retrieval task. Existing studies have explored various fusion paradigms and consistency…

Multimedia · Computer Science 2025-05-16 Taoyu Su , Jiawei Sheng , Duohe Ma , Xiaodong Li , Juwei Yue , Mengxiao Song , Yingkai Tang , Tingwen Liu

Recent recommender system advancements have focused on developing sequence-based and graph-based approaches. Both approaches proved useful in modeling intricate relationships within behavioral data, leading to promising outcomes in…

Information Retrieval · Computer Science 2024-03-18 Vladimir Baikalov , Evgeny Frolov

Recent advances in reinforcement learning (RL) for large language model (LLM) fine-tuning show promise in addressing multi-objective tasks but still face significant challenges, including competing objective balancing, low training…

Computation and Language · Computer Science 2025-07-10 Lingxiao Kong , Cong Yang , Susanne Neufang , Oya Deniz Beyan , Zeyd Boukhers

Reinforcement learning (RL) agents often suffer from high sample complexity in sparse or delayed reward settings due to limited prior structure. Large language models (LLMs) can provide subgoal decompositions, plausible trajectories, and…

Machine Learning · Computer Science 2026-02-23 Narjes Nourzad , Carlee Joe-Wong

The objective of the Multiple Appropriate Facial Reaction Generation (MAFRG) task is to produce contextually appropriate and diverse listener facial behavioural responses based on the multimodal behavioural data of the conversational…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Guanyu Hu , Jie Wei , Siyang Song , Dimitrios Kollias , Xinyu Yang , Zhonglin Sun , Odysseus Kaloidas

Due to the notorious modality imbalance problem, multimodal learning (MML) leads to the phenomenon of optimization imbalance, thus struggling to achieve satisfactory performance. Recently, some representative methods have been proposed to…

Machine Learning · Computer Science 2024-07-08 Qing-Yuan Jiang , Zhouyang Chi , Yang Yang

Multimodal emotion recognition utilizes complete multimodal information and robust multimodal joint representation to gain high performance. However, the ideal condition of full modality integrity is often not applicable in reality and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Qi Fan , Hongyu Yuan , Haolin Zuo , Rui Liu , Guanglai Gao

Multi-behavior recommendation (MBR) has garnered growing attention recently due to its ability to mitigate the sparsity issue by inferring user preferences from various auxiliary behaviors to improve predictions for the target behavior.…

Information Retrieval · Computer Science 2024-12-20 Yabo Yin , Xiaofei Zhu , Wenshan Wang , Yihao Zhang , Pengfei Wang , Yixing Fan , Jiafeng Guo

Recent advances in path-based explainable recommendation systems have attracted increasing attention thanks to the rich information provided by knowledge graphs. Most existing explainable recommendations only utilize static knowledge graphs…

Information Retrieval · Computer Science 2021-11-25 Yicong Li , Hongxu Chen , Yile Li , Lin Li , Philip S. Yu , Guandong Xu

Multi-modal recommender system focuses on utilizing rich modal information ( i.e., images and textual descriptions) of items to improve recommendation performance. The current methods have achieved remarkable success with the powerful…

Information Retrieval · Computer Science 2025-08-20 Shouxing Ma , Yawen Zeng , Shiqing Wu , Guandong Xu