English
Related papers

Related papers: A Novel Unified Conditional Score-based Generative…

200 papers

Multimodal learning with incomplete input data (missing modality) is practical and challenging. In this work, we conduct an in-depth analysis of this challenge and find that modality dominance has a significant negative impact on the model…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hao Wang , Shengda Luo , Guosheng Hu , Jianguo Zhang

Learning from multiple modalities often suffers from imbalance, where information-rich modalities dominate optimization while weaker or partially missing modalities contribute less. This imbalance becomes severe in realistic settings with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Phuong-Anh Nguyen , Tien Anh Pham , Duc-Trong Le , Cam-Van Thi Nguyen

Medical image segmentation is a critical step in computer-aided diagnosis, and convolutional neural networks are popular segmentation networks nowadays. However, the inherent local operation characteristics make it difficult to focus on the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Fenghe Tang , Jianrui Ding , Lingtao Wang , Min Xian , Chunping Ning

Unpaired Multi-Modal Learning (UMML) which leverages unpaired multi-modal data to boost model performance on each individual modality has attracted a lot of research interests in medical image analysis. However, existing UMML methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Lei Zhu , Yanyu Xu , Huazhu Fu , Xinxing Xu , Rick Siow Mong Goh , Yong Liu

Causal mediation analysis, pleiotropy analysis, and replication analysis are three highly popular genetic study designs. Although these analyses address different scientific questions, the underlying inference problems all involve…

Methodology · Statistics 2023-09-25 Ryan Sun , Zachary McCaw , Xihong Lin

In this study, we introduce a sophisticated generative conditional strategy designed to impute missing values within datasets, an area of considerable importance in statistical analysis. Specifically, we initially elucidate the theoretical…

Machine Learning · Statistics 2026-01-05 George Sun , Yi-Hui Zhou

Unified Multimodal Models (UMMs) offer powerful cross-modality capabilities but introduce new safety risks not observed in single-task models. Despite their emergence, existing safety benchmarks remain fragmented across tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Segyu Lee , Boryeong Cho , Hojung Jung , Seokhyun An , Juhyeong Kim , Jaehyun Kwak , Yongjin Yang , Sangwon Jang , Youngrok Park , Wonjun Chang , Se-Young Yun

Recently, remarkable progress has been made in Unified Multimodal Models (UMMs), which integrate vision-language generation and understanding capabilities within a single framework. However, a significant gap exists where a model's strong…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Weiyang Jin , Yuwei Niu , Jiaqi Liao , Chengqi Duan , Aoxue Li , Shenghua Gao , Xihui Liu

Reliable medical image classification requires accurate predictions and well-calibrated uncertainty estimates, especially in high-stakes clinical settings. This work presents MedSymmFlow, a generative-discriminative hybrid model built on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Francisco Caetano , Lemar Abdi , Christiaan Viviers , Amaan Valiuddin , Fons van der Sommen

Unimodality constitutes a key property indicating grouping behavior of the data around a single mode of its density. We propose a method that partitions univariate data into unimodal subsets through recursive splitting around valley points…

Machine Learning · Computer Science 2024-12-23 Paraskevi Chasani , Aristidis Likas

Multi-modal brain MRI provides essential complementary information for clinical diagnosis. However, acquiring all modalities in practice is often constrained by time and cost. To address this, various methods have been proposed to generate…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Hanyeol Yang , Sunggyu Kim , Mi Kyung Kim , Yongseon Yoo , Yu-Mi Kim , Min-Ho Shin , Insung Chung , Sang Baek Koh , Hyeon Chang Kim , Jong-Min Lee

Retrieval-Augmented Generation (RAG) has become a core paradigm in document question answering tasks. However, existing methods have limitations when dealing with multimodal documents: one category of methods relies on layout analysis and…

Computation and Language · Computer Science 2026-03-09 Wang Chen , Wenhan Yu , Guanqiang Qi , Weikang Li , Yang Li , Lei Sha , Deguo Xia , Jizhou Huang

Scalable Vector Graphics (SVG) is an important image format widely adopted in graphic design because of their resolution independence and editability. The study of generating high-quality SVG has continuously drawn attention from both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yiying Yang , Wei Cheng , Sijin Chen , Xianfang Zeng , Fukun Yin , Jiaxu Zhang , Liao Wang , Gang Yu , Xingjun Ma , Yu-Gang Jiang

Due to its complexity, graph learning-based multi-modal integration and classification is one of the most challenging obstacles for disease prediction. To effectively offset the negative impact between modalities in the process of…

Machine Learning · Computer Science 2025-02-14 Jin Liu , Junbin Mao , Hanhe Lin , Hulin Kuang , Shirui Pan , Xusheng Wu , Shan Xie , Fei Liu , Yi Pan

Multimodal Generative Models (MGMs) have rapidly evolved beyond text generation, now spanning diverse output modalities including images, music, video, human motion, and 3D objects, by integrating language with other sensory modalities…

Multimedia · Computer Science 2025-11-25 Longzhen Han , Awes Mubarak , Almas Baimagambetov , Nikolaos Polatidis , Thar Baker

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their sampling process is slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hengyuan Ma , Xiatian Zhu , Jianfeng Feng , Li Zhang

Joint analysis of multi-omic single-cell data across cohorts has significantly enhanced the comprehensive analysis of cellular processes. However, most of the existing approaches for this purpose require access to samples with complete…

Machine Learning · Computer Science 2024-05-21 Marianne Arriola , Weishen Pan , Manqi Zhou , Qiannan Zhang , Chang Su , Fei Wang

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

Diffusion models are widely used in applications ranging from image generation to inverse problems. However, training diffusion models typically requires clean ground-truth images, which are unavailable in many applications. We introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Chicago Y. Park , Shirin Shoushtari , Hongyu An , Ulugbek S. Kamilov