English
Related papers

Related papers: Training-free Graph-based Imputation of Missing Mo…

200 papers

Although existing multimodal recommendation models have shown promising performance, their effectiveness continues to be limited by the pervasive data sparsity problem. This problem arises because users typically interact with only a small…

Information Retrieval · Computer Science 2025-12-10 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Zitong Wan , Hewei Wang , Weijie Liu , Yijie Li , Edith C. H. Ngai

Internet memes are powerful tools for communication, capable of spreading political, psychological, and sociocultural ideas. However, they can be harmful and can be used to disseminate hate toward targeted individuals or groups. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Felix Breiteneder , Mohammad Belal , Muhammad Saad Saeed , Shahed Masoudian , Usman Naseem , Kulshrestha Juhi , Markus Schedl , Shah Nawaz

Multi-modal knowledge graphs (MKGs) include not only the relation triplets, but also related multi-modal auxiliary data (i.e., texts and images), which enhance the diversity of knowledge. However, the natural incompleteness has…

Artificial Intelligence · Computer Science 2022-09-07 Shangfei Zheng , Weiqing Wang , Jianfeng Qu , Hongzhi Yin , Wei Chen , Lei Zhao

The rapid expansion of multimedia contents has led to the emergence of multimodal recommendation systems. It has attracted increasing attention in recommendation systems because its full utilization of data from different modalities…

Information Retrieval · Computer Science 2024-12-30 Zheyu Chen , Jinfeng Xu , Haibo Hu

Multi-modal learning has emerged as an increasingly promising avenue in vision recognition, driving innovations across diverse domains ranging from media and education to healthcare and transportation. Despite its success, the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Tiantian Feng , Daniel Yang , Digbalay Bose , Shrikanth Narayanan

In sequential recommendation, multi-modal information (e.g., text or image) can provide a more comprehensive view of an item's profile. The optimal stage (early or late) to fuse modality features into item representations is still debated.…

Information Retrieval · Computer Science 2023-08-31 Hengchang Hu , Wei Guo , Yong Liu , Min-Yen Kan

In this paper, we study the problem of recommendation system where the users and items to be recommended are rich data structures with multiple entity types and with multiple sources of side-information in the form of graphs. We provide a…

This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item interaction graph,…

Information Retrieval · Computer Science 2023-05-02 Xin Zhou , Hongyu Zhou , Yong Liu , Zhiwei Zeng , Chunyan Miao , Pengwei Wang , Yuan You , Feijun Jiang

Traditional text-based person re-identification (ReID) techniques heavily rely on fully matched multi-modal data, which is an ideal scenario. However, due to inevitable data missing and corruption during the collection and processing of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tiantian Gong , Guodong Du , Junsheng Wang , Yongkang Ding , Liyan Zhang

Multimodal data encountered in real-world scenarios are typically of low quality, with noisy modalities and missing modalities being typical forms that severely hinder model performance and robustness. However, prior works often handle…

Machine Learning · Computer Science 2026-03-04 Sijie Mai , Shiqin Han , Haifeng Hu

Background: Existing guidelines for handling missing data are generally not consistent with the goals of prediction modelling, where missing data can occur at any stage of the model pipeline. Multiple imputation (MI), often heralded as the…

Methodology · Statistics 2022-06-27 Rose Sisk , Matthew Sperrin , Niels Peek , Maarten van Smeden , Glen P. Martin

Images and structured tables are essential parts of real-world databases. Though tabular-image representation learning is promising to create new insights, it remains a challenging task, as tabular data is typically heterogeneous and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Siyi Du , Shaoming Zheng , Yinsong Wang , Wenjia Bai , Declan P. O'Regan , Chen Qin

Multimodal data, where different types of data are collected from the same subjects, are fast emerging in a large variety of scientific applications. Factor analysis is commonly used in integrative analysis of multimodal data, and is…

Statistics Theory · Mathematics 2021-03-31 Quefeng Li , Lexin Li

Multimodal learning assumes all modality combinations of interest are available during training to learn cross-modal correspondences. In this paper, we challenge this modality-complete assumption for multimodal learning and instead strive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Yunhua Zhang , Hazel Doughty , Cees G. M. Snoek

Analysis of the fairness of machine learning (ML) algorithms recently attracted many researchers' interest. Most ML methods show bias toward protected groups, which limits the applicability of ML models in many applications like crime rate…

Machine Learning · Computer Science 2022-11-03 Haris Mansoor , Sarwan Ali , Shafiq Alam , Muhammad Asad Khan , Umair ul Hassan , Imdadullah Khan

Many multimodal recommender systems have been proposed to exploit the rich side information associated with users or items (e.g., user reviews and item images) for learning better user and item representations to improve the recommendation…

Information Retrieval · Computer Science 2022-10-26 Fan Liu , Huilin Chen , Zhiyong Cheng , Anan Liu , Liqiang Nie , Mohan Kankanhalli

Multimodal sentiment analysis aims to identify the emotions expressed by individuals through visual, language, and acoustic cues. However, most existing research assume that all modalities are available during both training and testing,…

Sound · Computer Science 2026-04-21 Weide Liu , Huijing Zhan

We introduce the Markov missing graph (MMG), a novel framework that imputes missing data based on undirected graphs. MMG leverages conditional independence relationships to locally decompose the imputation model. To establish the…

Methodology · Statistics 2025-09-04 Yanjiao Yang , Yen-Chi Chen

Training multimodal models requires a large amount of labeled data. Active learning (AL) aim to reduce labeling costs. Most AL methods employ warm-start approaches, which rely on sufficient labeled data to train a well-calibrated model that…

Multimedia · Computer Science 2024-12-13 Meng Shen , Yake Wei , Jianxiong Yin , Deepu Rajan , Di Hu , Simon See

Recently, relational metric learning methods have been received great attention in recommendation community, which is inspired by the translation mechanism in knowledge graph. Different from the knowledge graph where the entity-to-entity…

Information Retrieval · Computer Science 2024-06-18 Mingming Li , Fuqing Zhu , Feng Yuan , Songlin Hu