English
Related papers

Related papers: VLM-Guided Iterative Refinement for Surgical Image…

200 papers

Semi-supervised learning (SSL) has emerged as an effective paradigm for medical image segmentation, reducing the reliance on extensive expert annotations. Meanwhile, vision-language models (VLMs) have demonstrated strong generalization and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Guo , Mingzhen Li , Hanyu Su , Santiago López , Lexiaozi Fan , Daniel Kim , Aggelos Katsaggelos

Medical image segmentation remains challenging due to the vast diversity of anatomical structures, imaging modalities, and segmentation tasks. While deep learning has made significant advances, current approaches struggle to generalize as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yunhe Gao , Di Liu , Zhuowei Li , Yunsheng Li , Dongdong Chen , Mu Zhou , Dimitris N. Metaxas

Semantic segmentation of robotic instruments is an important problem for the robot-assisted surgery. One of the main challenges is to correctly detect an instrument's position for the tracking and pose estimation in the vicinity of surgical…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Alexey Shvets , Alexander Rakhlin , Alexandr A. Kalinin , Vladimir Iglovikov

Referring image segmentation (RIS) aims to segment an object mentioned in natural language from an image. The main challenge is text-to-pixel fine-grained correlation. In the previous methods, the final results are obtained by convolutions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yichen Yan , Xingjian He , Wenxuan Wang , Sihan Chen , Jing Liu

Weakly Supervised Semantic Segmentation (WSSS) is a challenging task aiming to learn the segmentation labels from class-level labels. In the literature, exploiting the information obtained from Class Activation Maps (CAMs) is widely used…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Cenk Bircanoglu , Nafiz Arica

Synthetic aperture sonar (SAS) systems produce high-resolution images of the seabed environment. Moreover, deep learning has demonstrated superior ability in finding robust features for automating imagery analysis. However, the success of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Yung-Chen Sun , Isaac D. Gerg , Vishal Monga

The Reference Remote Sensing Image Segmentation (RRSIS) task generates segmentation masks for specified objects in images based on textual descriptions, which has attracted widespread attention and research interest. Current RRSIS methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyang Li , Shuang Wang , Zhuangzhuang Sun , Jing Xiao

Surgical tool segmentation in endoscopic images is the first step towards pose estimation and (sub-)task automation in challenging minimally invasive surgical operations. While many approaches in the literature have shown great results…

Robotics · Computer Science 2019-02-14 Cristian da Costa Rocha , Nicolas Padoy , Benoit Rosa

Instance segmentation of surgical instruments is a long-standing research problem, crucial for the development of many applications for computer-assisted surgery. This problem is commonly tackled via fully-supervised training of deep…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Given a language expression, referring remote sensing image segmentation (RRSIS) aims to identify ground objects and assign pixel-wise labels within the imagery. The one of key challenges for this task is to capture discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Lei , Xinyu Xiao , Tianlin Zhang , Heng-Chao Li , Zhenwei Shi , Qing Zhu

Crucial in disease analysis and surgical planning, manual segmentation of volumetric medical scans (e.g. MRI, CT) is laborious, error-prone, and challenging to master, while fully automatic algorithms can benefit from user feedback.…

Human-Computer Interaction · Computer Science 2025-05-27 Pascal Spiegler , Arash Harirpoush , Yiming Xiao

Iris segmentation is a critical component of an iris biometric system and it involves extracting the annular iris region from an ocular image. In this work, we develop a pixel-level iris segmentation model from a foundational model, viz.,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Parisa Farmanifard , Arun Ross

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

In clinical practice, segmenting specific lesions based on the needs of physicians can significantly enhance diagnostic accuracy and treatment efficiency. However, conventional lesion segmentation models lack the flexibility to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuyi Ouyang , Jinyang Zhang , Xiangye Lin , Xilai Wang , Qingqing Chen , Yen-Wei Chen , Lanfen Lin

Surgical tool segmentation in endoscopic images is an important problem: it is a crucial step towards full instrument pose estimation and it is used for integration of pre- and intra-operative images into the endoscopic view. While many…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Daniil Pakhomov , Wei Shen , Nassir Navab

Interactive image segmentation aims at segmenting a target region through a way of human-computer interaction. Recent works based on deep learning have achieved excellent performance, while most of them focus on improving the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Yuying Hao , Yi Liu , Juncai Peng , Haoyi Xiong , Guowei Chen , Shiyu Tang , Zeyu Chen , Baohua Lai

Image segmentation is a fundamental task in computer vision, aimed at partitioning an image into semantically meaningful regions. Referring image segmentation extends this task by using natural language expressions to localize specific…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Alaa Dalaq , Muzammil Behzad

Semantic segmentation is one of the basic, yet essential scene understanding tasks for an autonomous agent. The recent developments in supervised machine learning and neural networks have enjoyed great success in enhancing the performance…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 S. Ehsan Mirsadeghi , Ali Royat , Hamid Rezatofighi

Interactive segmentation is a promising strategy for building robust, generalisable algorithms for volumetric medical image segmentation. However, inconsistent and clinically unrealistic evaluation hinders fair comparison and misrepresents…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Parhom Esmaeili , Virginia Fernandez , Pedro Borges , Eli Gibson , Sebastien Ourselin , M. Jorge Cardoso

Semantic tool segmentation in surgical videos is important for surgical scene understanding and computer-assisted interventions as well as for the development of robotic automation. The problem is challenging because different illumination…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Emanuele Colleoni , Philip Edwards , Danail Stoyanov