English
Related papers

Related papers: UniSeg: A Prompt-driven Universal Segmentation Mod…

200 papers

Several unsupervised image segmentation approaches have been proposed which eliminate the need for dense manually-annotated segmentation masks; current models separately handle either semantic segmentation (e.g., STEGO) or class-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Dantong Niu , Xudong Wang , Xinyang Han , Long Lian , Roei Herzig , Trevor Darrell

A major focus of clinical imaging workflow is disease diagnosis and management, leading to medical imaging datasets strongly tied to specific clinical objectives. This scenario has led to the prevailing practice of developing task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yunhe Gao , Zhuowei Li , Di Liu , Mu Zhou , Shaoting Zhang , Dimitris N. Metaxas

Over the past few years, the rapid development of deep learning technologies for computer vision has significantly improved the performance of medical image segmentation (MedISeg). However, the diverse implementation strategies of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Dong Zhang , Yi Lin , Hao Chen , Zhuotao Tian , Xin Yang , Jinhui Tang , Kwang Ting Cheng

Deep learning based methods often suffer from performance degradation caused by domain shift. In recent years, many sophisticated network structures have been designed to tackle this problem. However, the advent of large model trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Zhikai Wei , Wenhui Dong , Peilin Zhou , Yuliang Gu , Zhou Zhao , Yongchao Xu

Segmentation is a fundamental task in computer vision, with prompt-driven methods gaining prominence due to their flexibility. The Segment Anything Model (SAM) excels at point-prompted segmentation, while text-based models, often leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Suzhe Xu , Jialin Peng , Chengyuan Zhang

Prompt-driven image analysis converts a single natural-language instruction into multiple steps: locate, segment, edit, and describe. We present a practical case study of a unified pipeline that combines open-vocabulary detection,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Kaleem Ahmad

Medical image segmentation is a crucial and time-consuming task in clinical care, where mask precision is extremely important. The Segment Anything Model (SAM) offers a promising approach, as it provides an interactive interface based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Julien Khlaut , Elodie Ferreres , Daniel Tordjman , Hélène Philippe , Tom Boeken , Pierre Manceron , Corentin Dancette

Universal medical image segmentation seeks to use a single foundational model to handle diverse tasks across multiple imaging modalities. However, existing approaches often rely heavily on manual visual prompts or retrieved reference…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Haoyun Chen , Fenghe Tang , Wenxin Ma , Shaohua Kevin Zhou

The universality of deep neural networks across different modalities and their generalization capabilities to unseen domains play an essential role in medical image segmentation. The recent segment anything model (SAM) has demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Qing Xu , Jiaxuan Li , Xiangjian He , Chenxin Li , Fiseha B. Tesem , Wenting Duan , Zhen Chen , Rong Qu , Jonathan M. Garibaldi , Chang Wen Chen

Medical image segmentation has immense clinical applicability but remains a challenge despite advancements in deep learning. The Segment Anything Model (SAM) exhibits potential in this field, yet the requirement for expertise intervention…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Yinsong Xu , Jiaqi Tang , Aidong Men , Qingchao Chen

Medical image segmentation typically adopts a point-wise convolutional segmentation head to predict dense labels, where each output channel is heuristically tied to a specific class. This rigid design limits both feature sharing and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Bin Xie , Gady Agam

Medical vision-language pre-training (Med-VLP) models have recently accelerated the fast-growing medical diagnostics application. However, most Med-VLP models learn task-specific representations independently from scratch, thereby leading…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Chenlu Zhan , Yufei Zhang , Yu Lin , Gaoang Wang , Hongwei Wang

MedSAM, a medical foundation model derived from the SAM architecture, has demonstrated notable success across diverse medical domains. However, its clinical application faces two major challenges: the dependency on labor-intensive manual…

Image and Video Processing · Electrical Eng. & Systems 2025-04-17 Peng Huang , Shu Hu , Bo Peng , Xun Gong , Penghang Yin , Hongtu Zhu , Xi Wu , Xin Wang

Medical image segmentation is fundamental to clinical decision-making, yet existing models remain fragmented. They are usually trained on single knowledge sources and specific to individual tasks, modalities, or organs. This fragmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Bangwei Guo , Yunhe Gao , Meng Ye , Difei Gu , Yang Zhou , Leon Axel , Dimitris Metaxas

Image segmentation, the process of partitioning an image into meaningful regions, plays a pivotal role in computer vision and medical imaging applications. Unsupervised segmentation, particularly in the absence of labeled data, remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Kovvuri Sai Gopal Reddy , Bodduluri Saran , A. Mudit Adityaja , Saurabh J. Shigwan , Nitin Kumar

An increasing number of public datasets have shown a marked impact on automated organ segmentation and tumor detection. However, due to the small size and partially labeled problem of each dataset, as well as a limited investigation of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-27 Jie Liu , Yixiao Zhang , Jie-Neng Chen , Junfei Xiao , Yongyi Lu , Bennett A. Landman , Yixuan Yuan , Alan Yuille , Yucheng Tang , Zongwei Zhou

Medical image segmentation plays an important role in clinical decision making, treatment planning, and disease tracking. However, it still faces two major challenges. On the one hand, there is often a ``soft boundary'' between foreground…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Mengqi Lei , Haochen Wu , Xinhua Lv , Xin Wang

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

The advancement of artificial intelligence (AI) for organ segmentation and tumor detection is propelled by the growing availability of computed tomography (CT) datasets with detailed, per-voxel annotations. However, these AI models often…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Jie Liu , Yixiao Zhang , Kang Wang , Mehmet Can Yavuz , Xiaoxi Chen , Yixuan Yuan , Haoliang Li , Yang Yang , Alan Yuille , Yucheng Tang , Zongwei Zhou

The recognition of multi-class cell nuclei can significantly facilitate the process of histopathological diagnosis. Numerous pathological datasets are currently available, but their annotations are inconsistent. Most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Junjia Huang , Haofeng Li , Xiang Wan , Guanbin Li