English
Related papers

Related papers: Modality-Guided Mixture of Graph Experts with Entr…

200 papers

Multi-behavior recommendation (MBR) aims to improve the performance w.r.t. the target behavior (i.e., purchase) by leveraging auxiliary behaviors (e.g., click, favourite). However, in real-world scenarios, a recommendation method often…

Information Retrieval · Computer Science 2026-01-13 Wenhao Lai , Weike Pan , Zhong Ming

Learning-based autonomous driving requires continuous integration of diverse knowledge in complex traffic , yet existing methods exhibit significant limitations in adaptive capabilities. Addressing this gap demands autonomous driving…

Robotics · Computer Science 2025-02-18 Yixin Cui , Shuo Yang , Chi Wan , Xincheng Li , Jiaming Xing , Yuanjian Zhang , Yanjun Huang , Hong Chen

Graph-based models have emerged as a powerful paradigm for modeling multimodal urban data and learning region representations for various downstream tasks. However, existing approaches face two major limitations. (1) They typically employ…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yaya Zhao , Kaiqi Zhao , Zixuan Tang , Zhiyuan Liu , Xiaoling Lu , Yalei Du

This study introduces a pioneering methodology for human action recognition by harnessing deep neural network techniques and adaptive fusion strategies across multiple modalities, including RGB, optical flows, audio, and depth information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Novanto Yudistira

Feature interaction is a core ingredient in ranking models for large-scale recommender systems, yet making it both expressive and efficiently scalable remains challenging. Exhaustive pairwise interaction is powerful but incurs quadratic…

Information Retrieval · Computer Science 2026-01-27 Kaiyuan Li , Yongxiang Tang , Wenzheng Shu , Yanxiang Zeng , Chao Wang , Yanhua Cheng , Xialong Liu , Peng Jiang

Mixture-of-Experts (MoE) architectures offer a scalable path for Graph Neural Networks (GNNs) in node classification tasks but typically rely on static and rigid routing strategies that enforce a uniform expert budget or coarse-grained…

Machine Learning · Computer Science 2026-04-14 Jiajun Zhou , Yadong Li , Xuanze Chen , Chen Ma , Chuang Zhao , Shanqing Yu , Qi Xuan

As one of the main solutions to the information overload problem, recommender systems are widely used in daily life. In the recent emerging micro-video recommendation scenario, micro-videos contain rich multimedia information, involving…

Information Retrieval · Computer Science 2022-05-31 Breda Lim , Shubhi Bansal , Ahmed Buru , Kayla Manthey

This study presents a novel Multi-Modal Graph Neural Network (MM-GNN) framework for socially aware music recommendation, designed to enhance personalization and foster community-based engagement. The proposed model introduces a fusion-free…

Information Retrieval · Computer Science 2025-11-11 Kajwan Ziaoddini

Multimodal datasets contain an enormous amount of relational information, which grows exponentially with the introduction of new modalities. Learning representations in such a scenario is inherently complex due to the presence of multiple…

Machine Learning · Computer Science 2019-09-24 Devanshu Arya , Stevan Rudinac , Marcel Worring

Recommender systems have long been built upon the modeling of interactions between users and items, while recent studies have sought to broaden this paradigm by generalizing to new users and items, incorporating diverse information sources,…

Information Retrieval · Computer Science 2025-10-28 Chanyoung Chung , Kyeongryul Lee , Sunbin Park , Joyce Jiyoung Whang

Session-based recommendation plays a central role in a wide spectrum of online applications, ranging from e-commerce to online advertising services. However, the majority of existing session-based recommendation techniques (e.g.,…

Information Retrieval · Computer Science 2021-10-11 Chao Huang , Jiahui Chen , Lianghao Xia , Yong Xu , Peng Dai , Yanqing Chen , Liefeng Bo , Jiashu Zhao , Jimmy Xiangji Huang

Effectively modeling multimodal spatial omics data is critical for understanding tissue complexity and underlying biological mechanisms. While spatial transcriptomics, proteomics, and epigenomics capture molecular features, they lack…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yongjun Xiao , Dian Meng , Xinlei Huang , Yanran Liu , Shiwei Ruan , Ziyue Qiao , Xubin Zheng

Fuzzy Graph Attention Network (FGAT), which combines Fuzzy Rough Sets and Graph Attention Networks, has shown promise in tasks requiring robust graph-based learning. However, existing models struggle to effectively capture dependencies from…

Machine Learning · Computer Science 2024-12-24 Jinming Xing , Dongwen Luo , Qisen Cheng , Chang Xue , Ruilin Xing

Multimedia recommendation has received much attention in recent years. It models user preferences based on both behavior information and item multimodal information. Though current GCN-based methods achieve notable success, they suffer from…

Information Retrieval · Computer Science 2023-08-08 Penghang Yu , Zhiyi Tan , Guanming Lu , Bing-Kun Bao

Multi-modal entity alignment (MMEA) aims to identify equivalent entity pairs across different multi-modal knowledge graphs (MMKGs). Existing approaches focus on how to better encode and aggregate information from different modalities.…

Information Retrieval · Computer Science 2024-04-30 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very…

Multimedia · Computer Science 2022-11-01 Xuan Yang , Quanjin Tao , Xiao Feng , Donghong Cai , Xiang Ren , Yang Yang

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng

Graph deep learning (GDL) has demonstrated impressive performance in predicting population-based brain disorders (BDs) through the integration of both imaging and non-imaging data. However, the effectiveness of GDL based methods heavily…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Luhui Cai , Weiming Zeng , Hongyu Chen , Hua Zhang , Yueyang Li , Yu Feng , Hongjie Yan , Lingbin Bian , Wai Ting Siok , Nizhuan Wang

Integrating diverse data modalities is crucial for enhancing the performance of personalized recommendation systems. Traditional models, which often rely on singular data sources, lack the depth needed to accurately capture the multifaceted…

Information Retrieval · Computer Science 2025-02-18 Luyi Ma , Xiaohan Li , Zezhong Fan , Kai Zhao , Jianpeng Xu , Jason Cho , Praveen Kanumala , Kaushiki Nag , Sushant Kumar , Kannan Achan

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering. However, most MKGs are still…

Artificial Intelligence · Computer Science 2023-07-10 Ke Liang , Sihang Zhou , Yue Liu , Lingyuan Meng , Meng Liu , Xinwang Liu