English
Related papers

Related papers: SCISSR: Scribble-Conditioned Interactive Surgical …

200 papers

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Surgical automation can improve the accessibility and consistency of life saving procedures. Most surgeries require separating layers of tissue to access the surgical site, and suturing to reattach incisions. These tasks involve deformable…

Robotics · Computer Science 2024-05-17 Nikhil Uday Shinde , Xiao Liang , Fei Liu , Yutong Zhang , Florian Richter , Sylvia Herbert , Michael C. Yip

Surgical video segmentation is crucial for computer-assisted surgery, enabling precise localization and tracking of instruments and tissues. Interactive Video Object Segmentation (iVOS) models such as Segment Anything Model 2 (SAM2) provide…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Haofeng Liu , Ziyue Wang , Sudhanshu Mishra , Mingqi Gao , Guanyi Qin , Chang Han Low , Alex Y. W. Kong , Yueming Jin

Medical image segmentation is challenging due to overlapping anatomies with ambiguous boundaries and a severe imbalance between the foreground and background classes, which particularly affects the delineation of small lesions. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hao Shao , Qibin Hou

Weakly supervised semantic segmentation (WSSS) trains dense pixel-level segmentation models from partial or coarse annotations such as bounding boxes, scribbles, or image-level tags. While recent work leverages foundation models such as the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Stefano Colamonaco , Andrei-Bogdan Florea , Jaron Maene

We propose Semantic-Fast-SAM (SFS), a semantic segmentation framework that combines the Fast Segment Anything model with a semantic labeling pipeline to achieve real-time performance without sacrificing accuracy. FastSAM is an efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Byunghyun Kim

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zihang Liu , Zhenyu Zhang , Hao Tang

Medical image segmentation is vital for clinical diagnosis and quantitative analysis, yet remains challenging due to the heterogeneity of imaging modalities and the high cost of pixel-level annotations. Although general interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yujie Lu , Jingwen Li , Sibo Ju , Yanzhou Su , he yao , Yisong Liu , Min Zhu , Junlong Cheng

Weakly-supervised medical image segmentation is a challenging task that aims to reduce the annotation cost while keep the segmentation performance. In this paper, we present a novel framework, SimTxtSeg, that leverages simple text cues to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yuxin Xie , Tao Zhou , Yi Zhou , Geng Chen

Weakly supervised learning with scribble annotations uses sparse user-drawn strokes to indicate segmentation labels on a small subset of pixels. This annotation reduces the cost of dense pixel-wise labeling, but suffers inherently from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Yeva Gabrielyan , Varduhi Yeghiazaryan , Irina Voiculescu

Multi-modal human action segmentation is a critical and challenging task with a wide range of applications. Nowadays, the majority of approaches concentrate on the fusion of dense signals (i.e., RGB, optical flow, and depth maps). However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qi Liu , Xinchen Liu , Kun Liu , Xiaoyan Gu , Wu Liu

Surgical instrument segmentation is a key component in developing context-aware operating rooms. Existing works on this task heavily rely on the supervision of a large amount of labeled data, which involve laborious and expensive human…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Daochang Liu , Yuhui Wei , Tingting Jiang , Yizhou Wang , Rulin Miao , Fei Shan , Ziyu Li

The Segment Anything Model (SAM) has demonstrated strong and versatile segmentation capabilities, along with intuitive prompt-based interactions. However, customizing SAM for medical image segmentation requires massive amounts of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhonghao Yan , Zijin Yin , Tianyu Lin , Xiangzhu Zeng , Kongming Liang , Zhanyu Ma

Extracting small objects from remote sensing imagery plays a vital role in various applications, including urban planning, environmental monitoring, and disaster management. While current research primarily focuses on small object…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu

Most Camouflaged Object Detection (COD) methods heavily rely on mask annotations, which are time-consuming and labor-intensive to acquire. Existing weakly-supervised COD approaches exhibit significantly inferior performance compared to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Huafeng Chen , Pengxu Wei , Guangqian Guo , Shan Gao

The Reference Remote Sensing Image Segmentation (RRSIS) task generates segmentation masks for specified objects in images based on textual descriptions, which has attracted widespread attention and research interest. Current RRSIS methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyang Li , Shuang Wang , Zhuangzhuang Sun , Jing Xiao

MedSAM, a medical foundation model derived from the SAM architecture, has demonstrated notable success across diverse medical domains. However, its clinical application faces two major challenges: the dependency on labor-intensive manual…

Image and Video Processing · Electrical Eng. & Systems 2025-04-17 Peng Huang , Shu Hu , Bo Peng , Xun Gong , Penghang Yin , Hongtu Zhu , Xi Wu , Xin Wang

Accurate surgical instrument segmentation in endoscopy is crucial for computer-assisted interventions, yet remains challenging due to frequent occlusions, rapid motion, and long-term instrument re-entry. While SAM3 provides a powerful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Valay Bundele , Mehran Hosseinzadeh , Hendrik P. A. Lensch

From the simple measurement of tissue attributes in pathology workflow to designing an explainable diagnostic/prognostic AI tool, access to accurate semantic segmentation of tissue regions in histology images is a prerequisite. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Mostafa Jahanifar , Neda Zamani Tajeddin , Navid Alemi Koohbanani , Nasir Rajpoot

Data diversity and volume are crucial to the success of training deep learning models, while in the medical imaging field, the difficulty and cost of data collection and annotation are especially huge. Specifically in robotic surgery, data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 An Wang , Mobarakol Islam , Mengya Xu , Hongliang Ren