English
Related papers

Related papers: Consistency-Aware Padding for Incomplete Multi-Mod…

200 papers

Due to the existence of various views or representations in many real-world data, multi-view learning has drawn much attention recently. Multi-view spectral clustering methods based on similarity matrixes or graphs are pretty popular.…

Computer Vision and Pattern Recognition · Computer Science 2017-09-13 Nan Xu , Yanqing Guo , Jiujun Wang , Xiangyang Luo , Ran He

Multimodal sarcasm detection, which aims to precisely identify pragmatic incongruities between literal text and nonverbal cues, has gained substantial attention in multimodal understanding. Recent advancements have predominantly relied on…

Computation and Language · Computer Science 2026-05-05 Maoheng Li , Ling Zhou , Xiaohua Huang , Rubing Huang , Wenming Zheng , Guoying Zhao

Multimodal learning integrates diverse modalities but suffers from modality imbalance, where dominant modalities suppress weaker ones due to inconsistent convergence rates. Existing methods predominantly rely on static modulation or…

Machine Learning · Computer Science 2026-02-11 Zhaocheng Liu , Zhiwen Yu , Xiaoqing Liu

For multi-view data in reality, part of its elements may be missing because of human or machine error. Incomplete multi-view clustering (IMC) clusters the incomplete multi-view data according to the characters of various views of the…

Optimization and Control · Mathematics 2024-04-09 Lishan Feng , Guoxu Zhou , Jingya Chang

In this paper, we introduce a Fast and Scalable Semi-supervised Multi-view Subspace Clustering (FSSMSC) method, a novel solution to the high computational complexity commonly found in existing approaches. FSSMSC features linear…

Machine Learning · Computer Science 2024-08-13 Huaming Ling , Chenglong Bao , Jiebo Song , Zuoqiang Shi

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Deep multi-view clustering incorporating graph learning has presented tremendous potential. Most methods encounter costly square time consumption w.r.t. data size. Theoretically, anchor-based graph learning can alleviate this limitation,…

Machine Learning · Computer Science 2025-04-15 Bocheng Wang , Chusheng Zeng , Mulin Chen , Xuelong Li

Collaborative game-based learning environments offer rich opportunities for small-group knowledge construction, yet automatically predicting student collaboration satisfaction remains challenging. A critical barrier is modality degradation:…

Machine Learning · Computer Science 2026-05-19 Wen-Hsin Tsai , Chia-Ming Lee , Yuk-Ying Tung

In recent years, Multimodal Emotion Recognition (MER) has made substantial progress. Nevertheless, most existing approaches neglect the semantic inconsistencies that may arise across modalities, such as conflicting emotional cues between…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Guowei Zhong , Junjie Li , Huaiyu Zhu , Ruohong Huan , Yun Pan

In this paper, we propose an inexact multi-block ADMM-type first-order method for solving a class of high-dimensional convex composite conic optimization problems to moderate accuracy. The design of this method combines an inexact 2-block…

Optimization and Control · Mathematics 2020-06-09 Liang Chen , Defeng Sun , Kim-Chuan Toh

Remote sensing (RS) image-text retrieval faces significant challenges in real-world datasets due to the presence of Pseudo-Matched Pairs (PMPs), semantically mismatched or weakly aligned image-text pairs, which hinder the learning of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Pengxiang Ouyang , Qing Ma , Zheng Wang , Cong Bai

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Multimodal representation learning harmonizes distinct modalities by aligning them into a unified latent space. Recent research generalizes traditional cross-modal alignment to produce enhanced multimodal synergy but requires all modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xiaohao Liu , Xiaobo Xia , Jiaheng Wei , Shuo Yang , Xiu Su , See-Kiong Ng , Tat-Seng Chua

Autism spectrum disorder (ASD) remains a challenging condition to diagnose effectively and promptly, despite global efforts in public health, clinical screening, and scientific research. Traditional diagnostic methods, primarily reliant on…

Computers and Society · Computer Science 2025-03-11 Nora Fink

Multimodal semantic segmentation integrates complementary information from diverse sensors for remote sensing Earth observation. However, practical systems often encounter missing modalities due to sensor failures or incomplete coverage,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Lekang Wen , Liang Liao , Jing Xiao , Mi Wang

Data condensation techniques aim to synthesize a compact dataset from a larger one to enable efficient model training, yet while successful in unimodal settings, they often fail in multimodal scenarios where preserving intricate inter-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yue Min , Shaobo Wang , Jiaze Li , Tianle Niu , Junxin Fan , Yongliang Miao , Lijin Yang , Linfeng Zhang

Automated incident management is critical for microservice reliability. While recent unified frameworks leverage multimodal data for joint optimization, they unrealistically assume perfect data completeness. In practice, network…

Machine Learning · Computer Science 2026-03-30 Wenzhuo Qian , Hailiang Zhao , Ziqi Wang , Zhipeng Gao , Jiayi Chen , Zhiwei Ling , Shuiguang Deng

Nowadays, multi-view clustering has attracted more and more attention. To date, almost all the previous studies assume that views are complete. However, in reality, it is often the case that each view may contain some missing instances.…

Machine Learning · Computer Science 2019-03-08 Menglei Hu , Songcan Chen

We introduce MultiMatch, a novel semi-supervised learning (SSL) algorithm combining the paradigms of co-training and consistency regularization with pseudo-labeling. At its core, MultiMatch features a pseudo-label weighting module designed…

Computation and Language · Computer Science 2025-11-04 Iustin Sirbu , Robert-Adrian Popovici , Cornelia Caragea , Stefan Trausan-Matu , Traian Rebedea

Human action recognition (HAR) with multi-modal inputs (RGB-D, skeleton, point cloud) can achieve high accuracy but typically relies on large labeled datasets and degrades sharply when sensors fail or are noisy. We present Robust…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Hasan Akgul , Mari Eplik , Javier Rojas , Akira Yamamoto , Rajesh Kumar , Maya Singh