English
Related papers

Related papers: SegICL: A Multimodal In-context Learning Framework…

200 papers

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

In-context learning (ICL) offers a promising paradigm for universal medical image analysis, enabling models to perform diverse image processing tasks without retraining. However, current ICL models for medical imaging remain limited in two…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Jiesi Hu , Jianfeng Cao , Yanwu Yang , Chenfei Ye , Yixuan Zhang , Hanyang Peng , Ting Ma

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks

Segmentation is one of the most important tasks in the medical imaging pipeline as it influences a number of image-based decisions. To be effective, fully supervised segmentation approaches require large amounts of manually annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Tyler Ward , Aaron Moseley , Abdullah-Al-Zubaer Imran

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

The Segment Anything Model (SAM) exhibits a capability to segment a wide array of objects in natural images, serving as a versatile perceptual tool for various downstream image segmentation tasks. In contrast, medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yizhe Zhang , Tao Zhou , Shuo Wang , Ye Wu , Pengfei Gu , Danny Z. Chen

Despite significant advancements, segmentation based on deep neural networks in medical and surgical imaging faces several challenges, two of which we aim to address in this work. First, acquiring complete pixel-level segmentation labels…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Junwen Wang , Zhonghao Wang , Oscar MacCormac , Jonathan Shapey , Tom Vercauteren

Semi-supervised learning has become increasingly popular in medical image segmentation due to its ability to leverage large amounts of unlabeled data to extract additional information. However, most existing semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shengbo Gao , Ziji Zhang , Jiechao Ma , Zihao Li , Shu Zhang

Surgical image segmentation is highly challenging, primarily due to scarcity of annotated data. Generalist prompted segmentation models like the Segment-Anything Model (SAM) can help tackle this task, but because they require image-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Aditya Murali , Farahdiba Zarin , Adrien Meyer , Pietro Mascagni , Didier Mutter , Nicolas Padoy

Traditional one-shot medical image segmentation (MIS) methods use registration networks to propagate labels from a reference atlas or rely on comprehensive sampling strategies to generate synthetic labeled data for training. However, these…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Feng Zhou , Yanjie Zhou , Longjie Wang , Yun Peng , David E. Carlson , Liyun Tu

In-context learning (ICL) is emerging as a promising technique for achieving universal medical image segmentation, where a variety of objects of interest across imaging modalities can be segmented using a single model. Nevertheless, its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Shishuai Hu , Zehui Liao , Liangli Zhen , Huazhu Fu , Yong Xia

Understanding surgical scenes can provide better healthcare quality for patients, especially with the vast amount of video data that is generated during MIS. Processing these videos generates valuable assets for training sophisticated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Fatmaelzahraa Ali Ahmed , Muhammad Arsalan , Abdulaziz Al-Ali , Khalid Al-Jalham , Shidin Balakrishnan

Surgical instrument segmentation is recognised as a key enabler in providing advanced surgical assistance and improving computer-assisted interventions. In this work, we propose SegMatch, a semi-supervised learning method to reduce the need…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Meng Wei , Charlie Budd , Luis C. Garcia-Peraza-Herrera , Reuben Dorent , Miaojing Shi , Tom Vercauteren

Medical image segmentation plays a critical role in clinical decision-making, treatment planning, and disease monitoring. However, accurate segmentation of medical images is challenging due to several factors, such as the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zihan Li , Yuan Zheng , Xiangde Luo , Dandan Shan , Qingqi Hong

Multimodal image-tabular learning is gaining attention, yet it faces challenges due to limited labeled data. While earlier work has applied self-supervised learning (SSL) to unlabeled data, its task-agnostic nature often results in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyi Du , Xinzhe Luo , Declan P. O'Regan , Chen Qin

Medical image segmentation is critical for computer-aided diagnosis. However, dense pixel-level annotation is time-consuming and expensive, and medical datasets often exhibit severe class imbalance. Such imbalance causes minority structures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yingxue Su , Yiheng Zhong , Keying Zhu , Zimu Zhang , Zhuoru Zhang , Yifang Wang , Yuxin Zhang , Jingxin Liu

Large foundation models, known for their strong zero-shot generalization, have excelled in visual and language applications. However, applying them to medical image segmentation, a domain with diverse imaging types and target labels,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Junde Wu , Jiayuan Zhu , Yueming Jin , Min Xu

Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However, this can be…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaoyang Chen , Hao Zheng , Yifang Xie , Yuncong Ma , Tengfei Li

Semantic segmentation consists of assigning a semantic label to each pixel according to predefined classes. This process facilitates the understanding of object appearance and spatial relationships, playing an important role in the global…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Mariana Dória Prata Lima , Gilson Antonio Giraldi , Jaime S. Cardoso

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape