English
Related papers

Related papers: SynerGraph: An Integrated Graph Convolution Networ…

200 papers

Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal fused representations. Existing approaches typically adopt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dingkang Yang , Mingcheng Li , Xuecheng Wu , Zhaoyu Chen , Kaixun Jiang , Keliang Liu , Peng Zhai , Lihua Zhang

Effectively leveraging multimodal data such as various images, laboratory tests and clinical information is gaining traction in a variety of AI-based medical diagnosis and prognosis tasks. Most existing multi-modal techniques only focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Yingying Fang , Shuang Wu , Sheng Zhang , Chaoyan Huang , Tieyong Zeng , Xiaodan Xing , Simon Walsh , Guang Yang

In this paper, we propose a novel method for projecting data from multiple modalities to a new subspace optimized for one-class classification. The proposed method iteratively transforms the data from the original feature space of each…

Machine Learning · Computer Science 2020-09-15 Fahad Sohrab , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

Multi-modal recommendation systems, which integrate diverse types of information, have gained widespread attention in recent years. However, compared to traditional collaborative filtering-based multi-modal recommendation systems, research…

Information Retrieval · Computer Science 2023-08-15 Wei Ji , Xiangyan Liu , An Zhang , Yinwei Wei , Yongxin Ni , Xiang Wang

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Recommendation systems have lately been popularized globally, with primary use cases in online interaction systems, with significant focus on e-commerce platforms. We have developed a machine learning-based recommendation platform, which…

The importance of recommender systems is growing rapidly due to the exponential increase in the volume of content generated daily. This surge in content presents unique challenges for designing effective recommender systems. Key among these…

Computation and Language · Computer Science 2025-06-12 Jiahao Tian , Jinman Zhao , Zhenkai Wang , Zhicheng Ding

Multimodal learning has increasingly become a focal point in research, primarily due to its ability to integrate complementary information from diverse modalities. Nevertheless, modality imbalance, stemming from factors such as insufficient…

Machine Learning · Computer Science 2025-11-04 Rongrong Xie , Guido Sanguinetti

This paper addresses key challenges in enhancing recommendation systems by leveraging Graph Neural Networks (GNNs) and addressing inherent limitations such as over-smoothing, which reduces model effectiveness as network hierarchy deepens.…

Information Retrieval · Computer Science 2024-12-05 Wenyi Liu , Ziqi Zhang , Xinshi Li , Jiacheng Hu , Yuanshuai Luo , Junliang Du

The dominant retrieve-then-rank pipeline in large-scale recommender systems suffers from mis-calibration and engineering overhead due to its architectural split and differing optimization objectives. While recent generative sequence models…

Recently, leveraging different channels to model social semantic information and using self-supervised learning tasks to boost recommendation performance has been proven to be a very promising work. However, how to deeply dig out the…

Information Retrieval · Computer Science 2022-09-27 Yundong Sun , Dongjie Zhu , Haiwen Du , Zhaoshuo Tian

The online emergence of multi-modal sharing platforms (eg, TikTok, Youtube) is powering personalized recommender systems to incorporate various modalities (eg, visual, textual and acoustic) into the latent user representations. While…

Information Retrieval · Computer Science 2023-07-19 Wei Wei , Chao Huang , Lianghao Xia , Chuxu Zhang

Micro-video recommendation aims to capture user preferences from the collaborative and context information of the interacted micro-videos, thereby predicting the appropriate videos. This target is often hindered by the inherent noise within…

Information Retrieval · Computer Science 2026-03-03 Xinxin Dong , Haokai Ma , Yuze Zheng , Yongfu Zha , Yonghui Yang , Xiaodong Wang

In the one-class recommendation problem, it's required to make recommendations basing on users' implicit feedback, which is inferred from their action and inaction. Existing works obtain representations of users and items by encoding…

Information Retrieval · Computer Science 2024-01-22 Chu-Jen Shao , Hao-Ming Fu , Pu-Jen Cheng

Recent advances in multimodal recommendation (MMR) highlight the potential of integrating visual and textual content to enrich item representations. However, existing methods often rely on coarse visual features and naive fusion strategies,…

Information Retrieval · Computer Science 2025-11-11 Hai-Dang Kieu , Min Xu , Thanh Trung Huynh , Dung D. Le

The multimodal recommendation has gradually become the infrastructure of online media platforms, enabling them to provide personalized service to users through a joint modeling of user historical behaviors (e.g., purchases, clicks) and item…

Information Retrieval · Computer Science 2024-04-19 Zhiqiang Guo , Jianjun Li , Guohui Li , Chaoyang Wang , Si Shi , Bin Ruan

Collaborative filtering (CF) has been one of the most important and popular recommendation methods, which aims at predicting users' preferences (ratings) based on their past behaviors. Recently, various types of side information beyond the…

Information Retrieval · Computer Science 2020-12-29 Huan Zhao , Quanming Yao , Yangqiu Song , James Kwok , Dik Lun Lee

Unsupervised Multiplex Graph Learning (UMGL) aims to learn node representations on various edge types without manual labeling. However, existing research overlooks a key factor: the reliability of the graph structure. Real-world data often…

Machine Learning · Computer Science 2024-09-27 Zhixiang Shen , Shuo Wang , Zhao Kang

In this work, we aim to learn multi-level user intents from the co-interacted patterns of items, so as to obtain high-quality representations of users and items and further enhance the recommendation performance. Towards this end, we…

Information Retrieval · Computer Science 2021-10-29 Wei Yinwei , Wang Xiang , He Xiangnan , Nie Liqiang , Rui Yong , Chua Tat-Seng

The sequential recommendation system utilizes historical user interactions to predict preferences. Effectively integrating diverse user behavior patterns with rich multimodal information of items to enhance the accuracy of sequential…

Information Retrieval · Computer Science 2025-08-08 Xiaoxi Cui , Weihai Lu , Yu Tong , Yiheng Li , Zhejun Zhao