English
Related papers

Related papers: Text Promptable Surgical Instrument Segmentation w…

200 papers

Accurate segmentation of tissues and instruments in surgical scenes is annotation-intensive due to irregular shapes, thin structures, specularities, and frequent occlusions. While SAM models support point, box, and mask prompts, points are…

Image and Video Processing · Electrical Eng. & Systems 2026-03-20 Haonan Ping , Jian Jiang , Cheng Yuan , Qizhen Sun , Lv Wu , Yutong Ban

Instance segmentation of remote sensing images (RSIs) is an essential task for a wide range of applications such as land planning and intelligent transport. Instance segmentation of RSIs is constantly plagued by the unbalanced ratio of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Xuexue Li

Histopathology image analysis is critical yet challenged by the demand of segmenting tissue regions and nuclei instances for tumor microenvironment and cellular morphology analysis. Existing studies focused on tissue semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Qing Xu , Wenting Duan , Zhen Chen

Purpose: Endoscopic surgical environments present challenges for dissection zone segmentation due to unclear boundaries between tissue types, leading to segmentation errors where models misidentify or overlook edges. This study aims to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Mengya Xu , Wenjin Mo , Guankun Wang , Huxin Gao , An Wang , Zhen Li , Xiaoxiao Yang , Hongliang Ren

Recent advancements in multimodal vision models have highlighted limitations in late-stage feature fusion and suboptimal query selection for hybrid prompts open-world segmentation, alongside constraints from caption-derived vocabularies. To…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yuchen Guan , Chong Sun , Canmiao Fu , Zhipeng Huang , Chun Yuan , Chen Li

Due to low tissue contrast, irregular object appearance, and unpredictable location variation, segmenting the objects from different medical imaging modalities (e.g., CT, MR) is considered as an important yet challenging task. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Jinquan Sun , Yinghuan Shi , Yang Gao , Lei Wang , Luping Zhou , Wanqi Yang , Dinggang Shen

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

Segmentation is a fundamental task in computer vision, with prompt-driven methods gaining prominence due to their flexibility. The Segment Anything Model (SAM) excels at point-prompted segmentation, while text-based models, often leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Suzhe Xu , Jialin Peng , Chengyuan Zhang

Open-vocabulary semantic segmentation aims to segment images into distinct semantic regions for both seen and unseen categories at the pixel level. Current methods utilize text embeddings from pre-trained vision-language models like CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Ziyu Zhao , Xiaoguang Li , Linjia Shi , Nasrin Imanpour , Song Wang

Accurate segmentation of lesions in longitudinal whole-body CT is essential for monitoring disease progression and treatment response. While automated methods benefit from incorporating longitudinal information, they remain limited in their…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Yannick Kirchhoff , Maximilian Rokuss , Fabian Isensee , Klaus H. Maier-Hein

The objective of this work is to explore how to effectively and efficiently adapt pre-trained visual foundation models to various downstream tasks of semantic segmentation. Previous methods usually fine-tuned the entire networks for each…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Lingbo Liu , Jianlong Chang , Bruce X. B. Yu , Liang Lin , Qi Tian , Chang-Wen Chen

Segmenting objects with complex shapes, such as wires, bicycles, or structural grids, remains a significant challenge for current segmentation models, including the Segment Anything Model (SAM) and its high-quality variant SAM-HQ. These…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Luka Vetoshkin , Dmitry Yudin

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Despite the remarkable success of deep learning in medical imaging analysis, medical image segmentation remains challenging due to the scarcity of high-quality labeled images for supervision. Further, the significant domain gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Hedda Cohen Indelman , Elay Dahan , Angeles M. Perez-Agosto , Carmit Shiran , Doron Shaked , Nati Daniel

Accurate segmentation of lesions plays a critical role in medical image analysis and diagnosis. Traditional segmentation approaches that rely solely on visual features often struggle with the inherent uncertainty in lesion distribution and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-03 Dandan Shan , Zihan Li , Yunxiang Li , Qingde Li , Jie Tian , Qingqi Hong

Surgical video segmentation is fundamental to computer-assisted surgery. In practice, surgeons need to dynamically specify targets throughout extended procedures, using heterogeneous cues such as visual selections, textual expressions, or…

Image and Video Processing · Electrical Eng. & Systems 2026-04-07 Haofeng Liu , Ziyue Wang , Alex Y. W. Kong , Guanyi Qin , Yunqiu Xu , Chang Han Low , Mingqi Gao , Lap Yan Lennon Chan , Yueming Jin

Detection, tracking, and pose estimation of surgical instruments are crucial tasks for computer assistance during minimally invasive robotic surgery. In the majority of cases, the first step is the automatic segmentation of surgical tools.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Daniil Pakhomov , Vittal Premachandran , Max Allan , Mahdi Azizian , Nassir Navab

Pathology image segmentation is crucial in computational pathology for analyzing histological features relevant to cancer diagnosis and prognosis. However, current methods face major challenges in clinical applications due to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Zhixuan Chen , Junlin Hou , Liqi Lin , Yihui Wang , Yequan Bie , Xi Wang , Yanning Zhou , Ronald Cheong Kin Chan , Hao Chen

The universal model emerges as a promising trend for medical image segmentation, paving up the way to build medical imaging large model (MILM). One popular strategy to build universal models is to encode each task as a one-hot vector and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Yong Xia

Large foundation models, known for their strong zero-shot generalization, have excelled in visual and language applications. However, applying them to medical image segmentation, a domain with diverse imaging types and target labels,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Junde Wu , Jiayuan Zhu , Yueming Jin , Min Xu