English
Related papers

Related papers: UniSeg: A Prompt-driven Universal Segmentation Mod…

200 papers

Segment anything model (SAM), a foundation model with superior versatility and generalization across diverse segmentation tasks, has attracted widespread attention in medical imaging. However, it has been proved that SAM would encounter…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Xian Lin , Yangyang Xiang , Zhehao Wang , Kwang-Ting Cheng , Zengqiang Yan , Li Yu

In the field of medical imaging, AI-assisted techniques such as object detection, segmentation, and classification are widely employed to alleviate the workload of physicians and doctors. However, single-task models are predominantly used,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Fan Li , Arun Iyengar , Lanyu Xu

While 3D foundational models have shown promise for promptable segmentation of medical volumes, their robustness to imprecise prompts remains under-explored. In this work, we aim to address this gap by systematically studying the effect of…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Soumitri Chattopadhyay , Basar Demir , Marc Niethammer

Holistic surgical scene segmentation in robot-assisted surgery (RAS) enables surgical residents to identify various anatomical tissues, articulated tools, and critical structures, such as veins and vessels. Given the firm intraoperative…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Fatimaelzahraa Ahmed , Muraam Abdel-Ghani , Muhammad Arsalan , Mahmoud Ali , Abdulaziz Al-Ali , Shidin Balakrishnan

Segmenting 3D objects into parts is a long-standing challenge in computer vision. To overcome taxonomy constraints and generalize to unseen 3D objects, recent works turn to open-world part segmentation. These approaches typically transfer…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zhe Zhu , Le Wan , Rui Xu , Yiheng Zhang , Honghua Chen , Zhiyang Dou , Cheng Lin , Yuan Liu , Mingqiang Wei

Medical image segmentation has greatly aided medical diagnosis, with U-Net based architectures and nnU-Net providing state-of-the-art performance. There have been numerous general promptable models and medical variations introduced in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Connor Ludwig , Khashayar Namdar , Farzad Khalvati

Despite the remarkable success of deep learning in medical imaging analysis, medical image segmentation remains challenging due to the scarcity of high-quality labeled images for supervision. Further, the significant domain gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Hedda Cohen Indelman , Elay Dahan , Angeles M. Perez-Agosto , Carmit Shiran , Doron Shaked , Nati Daniel

In-context prompting in large language models (LLMs) has become a prevalent approach to improve zero-shot capabilities, but this idea is less explored in the vision domain. Existing visual prompting methods focus on referring segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Feng Li , Qing Jiang , Hao Zhang , Tianhe Ren , Shilong Liu , Xueyan Zou , Huaizhe Xu , Hongyang Li , Chunyuan Li , Jianwei Yang , Lei Zhang , Jianfeng Gao

In this work, we present COSINE, a unified open-world segmentation model that consolidates open-vocabulary segmentation and in-context segmentation with multi-modal prompts (e.g., text and image). COSINE exploits foundation models to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yang Liu , Yufei Yin , Chenchen Jing , Muzhi Zhu , Hao Chen , Yuling Xi , Bo Feng , Hao Wang , Shiyu Li , Chunhua Shen

Prompt-based medical image segmentation has rapidly emerged, yet existing methods rely on explicit prompts like bounding boxes and struggle to reason about the spatial relationships essential for clinical diagnosis. While general-domain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Quoc-Huy Trinh , Minh-Van Nguyen , Jun Zeng , Debesh Jha , Ulas Bagci

We propose UniT, a Unified Transformer model to simultaneously learn the most prominent tasks across different domains, ranging from object detection to natural language understanding and multimodal reasoning. Based on the transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Ronghang Hu , Amanpreet Singh

The advancement of medical image segmentation techniques has been propelled by the adoption of deep learning techniques, particularly UNet-based approaches, which exploit semantic information to improve the accuracy of segmentations.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ranmin Wang , Limin Zhuang , Hongkun Chen , Boyan Xu , Ruichu Cai

In recent years Deep Learning has brought about a breakthrough in Medical Image Segmentation. U-Net is the most prominent deep network in this regard, which has been the most popular architecture in the medical imaging community. Despite…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Nabil Ibtehaz , M. Sohel Rahman

Medical image segmentation is crucial for the development of computer-aided diagnostic and therapeutic systems, but still faces numerous difficulties. In recent years, the commonly used encoder-decoder architecture based on CNNs has been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Davoud Saadati , Omid Nejati Manzari , Sattar Mirzakuchaki

Image processing is a fundamental task in computer vision, which aims at enhancing image quality and extracting essential features for subsequent vision applications. Traditionally, task-specific models are developed for individual tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Yihao Liu , Xiangyu Chen , Xianzheng Ma , Xintao Wang , Jiantao Zhou , Yu Qiao , Chao Dong

Segment Anything Model (SAM) has gained significant recognition in the field of semantic segmentation due to its versatile capabilities and impressive performance. Despite its success, SAM faces two primary limitations: (1) it relies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuchen Li , Li Zhang , Youwei Liang , Pengtao Xie

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen

Foundation models like the segment anything model require high-quality manual prompts for medical image segmentation, which is time-consuming and requires expertise. SAM and its variants often fail to segment structures in ultrasound (US)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Assefa Seyoum Wahd , Banafshe Felfeliyan , Yuyue Zhou , Shrimanti Ghosh , Adam McArthur , Jiechen Zhang , Jacob L. Jaremko , Abhilash Hareendranathan

Medical image segmentation is essential for clinical diagnosis, surgical planning, and treatment monitoring. Traditional approaches typically strive to tackle all medical image segmentation scenarios via one-time learning. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zhaori Liu , Mengyang Li , Hu Han , Enli Zhang , Shiguang Shan , Zhiming Zhao

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen