English
Related papers

Related papers: Uncertainty-Aware Vision-Language Segmentation for…

200 papers

Deep learning models frequently encounter feature uncertainty in diverse learning scenarios, significantly impacting their performance and reliability. This challenge is particularly complex in multi-modal scenarios, where models must…

Machine Learning · Computer Science 2025-06-05 Jiahao Qin , Bei Peng , Feng Liu , Guangliang Cheng , Lu Zong

The goal of unsupervised anomaly segmentation (UAS) is to detect the pixel-level anomalies unseen during training. It is a promising field in the medical imaging community, e.g, we can use the model trained with only healthy data to segment…

Image and Video Processing · Electrical Eng. & Systems 2021-03-17 Chenxin Li , Yunlong Zhang , Jiongcheng Li , Yue Huang , Xinghao Ding

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

Uncertainty quantification (UQ) is crucial in safety-critical applications such as medical image segmentation. Total uncertainty is typically decomposed into data-related aleatoric uncertainty (AU) and model-related epistemic uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Jakob Lønborg Christensen , Vedrana Andersen Dahl , Morten Rieger Hannemose , Anders Bjorholm Dahl , Christian F. Baumgartner

Domain shift has been a long-standing issue for medical image segmentation. Recently, unsupervised domain adaptation (UDA) methods have achieved promising cross-modality segmentation performance by distilling knowledge from a label-rich…

Image and Video Processing · Electrical Eng. & Systems 2023-03-29 Ziyuan Zhao , Kaixin Xu , Huai Zhe Yeo , Xulei Yang , Cuntai Guan

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

Reliable classification and detection of certain medical conditions, in images, with state-of-the-art semantic segmentation networks, require vast amounts of pixel-wise annotation. However, the public availability of such datasets is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Erik Ostrowski , Bharath Srinivas Prabakaran , Muhammad Shafique

As a crucial extension of entity alignment (EA), multi-modal entity alignment (MMEA) aims to identify identical entities across disparate knowledge graphs (KGs) by exploiting associated visual information. However, existing MMEA approaches…

Artificial Intelligence · Computer Science 2023-08-02 Zhuo Chen , Lingbing Guo , Yin Fang , Yichi Zhang , Jiaoyan Chen , Jeff Z. Pan , Yangning Li , Huajun Chen , Wen Zhang

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

Incomplete multi-modal medical image segmentation faces critical challenges from modality imbalance, including imbalanced modality missing rates and heterogeneous modality contributions. Due to their reliance on idealized assumptions of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Libin Lan , Hongxing Li , Zunhui Xia , Yudong Zhang

Accurate segmentation of organs at risk in the head and neck is essential for radiation therapy, yet deep learning models often fail on small, complexly shaped organs. While hybrid architectures that combine different models show promise,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Xiaoyu Liu , Siwen Wei , Linhao Qu , Mingyuan Pan , Chengsheng Zhang , Yonghong Shi , Zhijian Song

We propose a new deep learning method for tumour segmentation when dealing with missing imaging modalities. Instead of producing one network for each possible subset of observed modalities or using arithmetic operations to combine feature…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Reuben Dorent , Samuel Joutard , Marc Modat , Sébastien Ourselin , Tom Vercauteren

Medical image segmentation is a cornerstone of computer-assisted diagnosis and treatment planning. While recent multimodal vision-language models have shown promise in enhancing semantic understanding through textual descriptions, their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Saivan Talaei , Fatemeh Daneshfar , Abdulhady Abas Abdullah , Mustaqeem Khan

Weak-strong consistency learning strategies are widely employed in semi-supervised medical image segmentation to train models by leveraging limited labeled data and enforcing weak-to-strong consistency. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Chaowei Chen , Xiang Zhang , Honglie Guo , Shunfang Wang

Multi-modal medical image fusion is traditionally optimized for human visual perception, aiming to maximize generic contrast and structural fidelity. However, when these visually pleasing fused images are deployed in automated clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Multi-modal medical image fusion is essential for the precise clinical diagnosis and surgical navigation since it can merge the complementary information in multi-modalities into a single image. The quality of the fused image depends on the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xianming Gu , Lihui Wang , Zeyu Deng , Ying Cao , Xingyu Huang , Yue-min Zhu

Open-vocabulary semantic segmentation is a challenging task, which requires the model to output semantic masks of an image beyond a close-set vocabulary. Although many efforts have been made to utilize powerful CLIP models to accomplish…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Xiangheng Shan , Dongyue Wu , Guilin Zhu , Yuanjie Shao , Nong Sang , Changxin Gao

The recent Segment Anything Model (SAM) represents a significant breakthrough in scaling segmentation models, delivering strong performance across various downstream applications in the RGB modality. However, directly applying SAM to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Chenyang Zhu , Bin Xiao , Lin Shi , Shoukun Xu , Xu Zheng

Reliable uncertainty estimation is critical for medical image segmentation, where automated contours feed downstream quantification and clinical decision support. Many strong uncertainty methods require repeated inference, while efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tianhao Fu , Austin Wang , Charles Chen , Roby Aldave-Garza , Yucheng Chen

Accurate and efficient medical image segmentation is crucial but challenging due to anatomical variability and high computational demands on volumetric data. Recent hybrid CNN-Transformer architectures achieve state-of-the-art results but…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Nand Kumar Yadav , Rodrigue Rizk , William CW Chen , KC Santosh