English
Related papers

Related papers: UniSeg: A Prompt-driven Universal Segmentation Mod…

200 papers

Ultrasound is widely used in clinical practice due to its affordability, portability, and safety. However, current AI research often overlooks combined disease prediction and tissue segmentation. We propose UniUSNet, a universal framework…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zehui Lin , Zhuoneng Zhang , Xindi Hu , Zhifan Gao , Xin Yang , Yue Sun , Dong Ni , Tao Tan

Computed tomography (CT) is extensively used for accurate visualization and segmentation of organs and lesions. While deep learning models such as convolutional neural networks (CNNs) and vision transformers (ViTs) have significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuheng Li , Yuxiang Lai , Maria Thor , Deborah Marshall , Zachary Buchwald , David S. Yu , Xiaofeng Yang

Surgical video segmentation is fundamental to computer-assisted surgery. In practice, surgeons need to dynamically specify targets throughout extended procedures, using heterogeneous cues such as visual selections, textual expressions, or…

Image and Video Processing · Electrical Eng. & Systems 2026-04-07 Haofeng Liu , Ziyue Wang , Alex Y. W. Kong , Guanyi Qin , Yunqiu Xu , Chang Han Low , Mingqi Gao , Lap Yan Lennon Chan , Yueming Jin

Building a unified model with a single set of parameters to efficiently handle diverse types of medical lesion segmentation has become a crucial objective for AI-assisted diagnosis. Existing unified segmentation approaches typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jiawei Xu , Qiangqiang Zhou , Dandan Zhu , Yong Chen , Yugen Yi , Xiaoqi Zhao

The realm of computer vision has witnessed a paradigm shift with the advent of foundational models, mirroring the transformative influence of large language models in the domain of natural language processing. This paper delves into the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Lv Tang , Peng-Tao Jiang , Hao-Ke Xiao , Bo Li

We propose UniSeg3D, a unified 3D scene understanding framework that achieves panoptic, semantic, instance, interactive, referring, and open-vocabulary segmentation tasks within a single model. Most previous 3D segmentation approaches are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Wei Xu , Chunsheng Shi , Sifan Tu , Xin Zhou , Dingkang Liang , Xiang Bai

The Segment Anything Model (SAM) has recently emerged as a groundbreaking foundation model for prompt-driven image segmentation tasks. However, both the original SAM and its medical variants require slice-by-slice manual prompting of target…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yichi Zhang , Shiyao Hu , Sijie Ren , Chen Jiang , Yuan Cheng , Yuan Qi

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model (SAM), have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Chen Gong , Dong Liang

Boosted by Multi-modal Large Language Models (MLLMs), text-guided universal segmentation models for the image and video domains have made rapid progress recently. However, these methods are often developed separately for specific domains,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Cong Wei , Yujie Zhong , Haoxian Tan , Yingsen Zeng , Yong Liu , Zheng Zhao , Yujiu Yang

Whole-body PET/CT is a cornerstone of oncological imaging, yet accurate lesion segmentation remains challenging due to tracer heterogeneity, physiological uptake, and multi-center variability. While fully automated methods have advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Maximilian Rokuss , Yannick Kirchhoff , Fabian Isensee , Klaus H. Maier-Hein

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

To address prevalent issues in medical imaging, such as data acquisition challenges and label availability, transfer learning from natural to medical image domains serves as a viable strategy to produce reliable segmentation results.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Medical image analysis is critical yet challenged by the need of jointly segmenting organs or tissues, and numerous instances for anatomical structures and tumor microenvironment analysis. Existing studies typically formulated different…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Qing Xu , Yuxiang Luo , Wenting Duan , Zhen Chen

In digital pathology, precise nuclei segmentation is pivotal yet challenged by the diversity of tissue types, staining protocols, and imaging conditions. Recently, the segment anything model (SAM) revealed overwhelming performance in…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhen Chen , Qing Xu , Xinyu Liu , Yixuan Yuan

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

End-to-end medical image segmentation is of great value for computer-aided diagnosis dominated by task-specific models, usually suffering from poor generalization. With recent breakthroughs brought by the segment anything model (SAM) for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xian Lin , Yangyang Xiang , Li Yu , Zengqiang Yan

Medical researchers and clinicians often need to perform novel segmentation tasks on a set of related images. Existing methods for segmenting a new dataset are either interactive, requiring substantial human effort for each image, or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hallee E. Wong , Jose Javier Gonzalez Ortiz , John Guttag , Adrian V. Dalca

In this paper, we present PRISM, a Promptable and Robust Interactive Segmentation Model, aiming for precise segmentation of 3D medical images. PRISM accepts various visual inputs, including points, boxes, and scribbles as sparse prompts, as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu