English
Related papers

Related papers: Multi-View Graph Convolutional Network for Multime…

200 papers

Recognizing human activities in videos is challenging due to the spatio-temporal complexity and context-dependence of human interactions. Prior studies often rely on single input modalities, such as RGB or skeletal data, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Tuyen Tran , Thao Minh Le , Hung Tran , Truyen Tran

Graph Neural Network(GNN) based social recommendation models improve the prediction accuracy of user preference by leveraging GNN in exploiting preference similarity contained in social relations. However, in terms of both effectiveness and…

Information Retrieval · Computer Science 2023-03-16 Yuhan Quan , Jingtao Ding , Chen Gao , Lingling Yi , Depeng Jin , Yong Li

Due to the distinctive characteristics of sensors, each modality exhibits unique physical properties. For this reason, in the context of multi-modal action recognition, it is important to consider not only the overall action content but…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sumin Lee , Sangmin Woo , Muhammad Adi Nugroho , Changick Kim

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang

Video affective understanding, which aims to predict the evoked expressions by the video content, is desired for video creation and recommendation. In the recent EEV challenge, a dense affective understanding task is proposed and requires…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Baoming Yan , Lin Wang , Ke Gao , Bo Gao , Xiao Liu , Chao Ban , Jiang Yang , Xiaobo Li

In real-world scenarios, audio and video signals are often subject to environmental noise and limited acquisition conditions, resulting in extracted features containing excessive noise. Furthermore, there is an imbalance in data quality and…

Computation and Language · Computer Science 2026-03-30 Ying Liu , Yuntao Shou , Wei Ai , Tao Meng , Keqin Li

The purpose of this paper is to explore a multi-modal approach to enhancing live broadcast engagement by developing a short video recommendation system that incorporates Multi-modal Graph Convolutional Networks (MMGCN) with user…

Information Retrieval · Computer Science 2025-09-30 Saeid Aghasoleymani Najafabadi , Elaheh Nabavi Nia

Multimodal recommendation enhances ranking by integrating user-item interactions with item content, which is particularly effective under sparse feedback and long-tail distributions. However, multimodal signals are inherently heterogeneous…

Artificial Intelligence · Computer Science 2026-02-27 Ji Dai , Quan Fang , Dengsheng Cai

Noise and inconsistency commonly exist in real-world information networks, due to inherent error-prone nature of human or user privacy concerns. To date, tremendous efforts have been made to advance feature learning from networks, including…

Machine Learning · Computer Science 2019-12-30 Min Shi , Yufei Tang , Xingquan Zhu , Jianxun Liu

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

Graph Neural Networks have significantly advanced research in recommender systems over the past few years. These methods typically capture global interests using aggregated past interactions and rely on static embeddings of users and items…

Information Retrieval · Computer Science 2025-03-19 Ashraf Ghiye , Baptiste Barreau , Laurent Carlier , Michalis Vazirgiannis

Spatial and temporal stream model has gained great success in video action recognition. Most existing works pay more attention to designing effective features fusion methods, which train the two-stream model in a separate way. However, it's…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Jingran Zhang , Fumin Shen , Xing Xu , Heng Tao Shen

Effective recommender systems play a crucial role in accurately capturing user and item attributes that mirror individual preferences. Some existing recommendation techniques have started to shift their focus towards modeling various types…

Information Retrieval · Computer Science 2025-06-26 Xiang Li , Chaofan Fu , Zhongying Zhao , Guanjie Zheng , Chao Huang , Yanwei Yu , Junyu Dong

Multimodal recommendation systems integrate diverse multimodal information into the feature representations of both items and users, thereby enabling a more comprehensive modeling of user preferences. However, existing methods are hindered…

Multimedia · Computer Science 2025-01-03 Qiya Song , Jiajun Hu , Lin Xiao , Bin Sun , Xieping Gao , Shutao Li

User-item interactions in recommendations can be naturally de-noted as a user-item bipartite graph. Given the success of graph neural networks (GNNs) in graph representation learning, GNN-based C methods have been proposed to advance…

Information Retrieval · Computer Science 2022-01-06 Yiqi Wang , Chaozhuo Li , Mingzheng Li , Wei Jin , Yuming Liu , Hao Sun , Xing Xie , Jiliang Tang

Bundle recommendation aims to enhance business profitability and user convenience by suggesting a set of interconnected items. In real-world scenarios, leveraging the impact of asymmetric item affiliations is crucial for effective bundle…

Information Retrieval · Computer Science 2024-08-20 Huy-Son Nguyen , Tuan-Nghia Bui , Long-Hai Nguyen , Hoang Manh-Hung , Cam-Van Thi Nguyen , Hoang-Quynh Le , Duc-Trong Le

Multi-modality image fusion enhances scene perception by combining complementary information. Unified models aim to share parameters across modalities for multi-modality image fusion, but large modality differences often cause gradient…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xilai Li , Xiaosong Li , Weijun Jiang

Graph Convolutional Networks (GCNs) and their variants have achieved significant performances on various recommendation tasks. However, many existing GCN models tend to perform recursive aggregations among all related nodes, which can arise…

Information Retrieval · Computer Science 2022-10-17 Yue Xu , Hao Chen , Zengde Deng , Yuanchen Bei , Feiran Huang

Graph-based collaborative filtering methods have prevailing performance for recommender systems since they can capture high-order information between users and items, in which the graphs are constructed from the observed user-item…

Information Retrieval · Computer Science 2024-01-24 Hongjian Gu , Yaochen Hu , Yingxue Zhang

Collaborative filtering is a very useful general technique for exploiting the preference patterns of a group of users to predict the utility of items to a particular user. Previous research has studied several probabilistic graphic models…

Information Retrieval · Computer Science 2012-12-12 Rong Jin , Luo Si , ChengXiang Zhai