English
Related papers

Related papers: Recognizing Surgical Phases Anywhere: Few-Shot Tes…

200 papers

The recently released Segment Anything Model (SAM) has shown powerful zero-shot segmentation capabilities through a semi-automatic annotation setup in which the user can provide a prompt in the form of clicks or bounding boxes. There is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Benjamin Towle , Xin Chen , Ke Zhou

The ability to adapt medical image segmentation networks for a novel class such as an unseen anatomical or pathological structure, when only a few labelled examples of this class are available from local healthcare providers, is…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Yiwen Li , Yunguan Fu , Qianye Yang , Zhe Min , Wen Yan , Henkjan Huisman , Dean Barratt , Victor Adrian Prisacariu , Yipeng Hu

Adverse drug events are a significant source of preventable harm, which has led to the development of automated pill recognition systems to enhance medication safety. Real-world deployment of these systems is hindered by visually complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 W. I. Chu , G. Tarroni , L. Li

Despite the growing integration of deep models into mobile terminals, the accuracy of these models declines significantly due to various deployment interferences. Test-time adaptation (TTA) has emerged to improve the performance of deep…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Ke Ma , Jiaqi Tang , Bin Guo , Fan Dang , Sicong Liu , Zhui Zhu , Lei Wu , Cheng Fang , Ying-Cong Chen , Zhiwen Yu , Yunhao Liu

Accurate segmentation of thin structures is critical for microsurgical scene understanding but remains challenging due to resolution loss, low contrast, and class imbalance. We propose Microsurgery Instrument Segmentation for Robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tae Kyeong Jeong , Garam Kim , Juyoun Park

Segmentation is an essential step for remote sensing image processing. This study aims to advance the application of the Segment Anything Model (SAM), an innovative image segmentation model by Meta AI, in the field of remote sensing image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Lucas Prado Osco , Qiusheng Wu , Eduardo Lopes de Lemos , Wesley Nunes Gonçalves , Ana Paula Marques Ramos , Jonathan Li , José Marcato Junior

Surgical phase recognition is a basic component for different context-aware applications in computer- and robot-assisted surgery. In recent years, several methods for automatic surgical phase recognition have been proposed, showing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Isabel Funke , Dominik Rivoir , Stefanie Speidel

Minimally invasive surgery is highly operator dependant with a lengthy procedural time causing fatigue to surgeon and risks to patients such as injury to organs, infection, bleeding, and complications of anesthesia. To mitigate such risks,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Mansoor Ali , Rafael Martinez Garcia Pena , Gilberto Ochoa Ruiz , Sharib Ali

Surgical intelligence has the potential to improve the safety and consistency of surgical care, yet most existing surgical AI frameworks remain task-specific and struggle to generalize across procedures and institutions. Although multimodal…

Understanding the intricate workflows of cataract surgery requires modeling complex interactions between surgical tools, anatomical structures, and procedural techniques. Existing datasets primarily address isolated aspects of surgical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Felix Holm , Gözde Ünver , Ghazal Ghazaei , Nassir Navab

Integrating image and text data through multi-modal learning has emerged as a new approach in medical imaging research, following its successful deployment in computer vision. While considerable efforts have been dedicated to establishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Fereshteh Shakeri , Yunshi Huang , Julio Silva-Rodríguez , Houda Bahig , An Tang , Jose Dolz , Ismail Ben Ayed

An old-school recipe for training a classifier is to (i) learn a good feature extractor and (ii) optimize a linear layer atop. When only a handful of samples are available per category, as in Few-Shot Adaptation (FSA), data are insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Matteo Farina , Massimiliano Mancini , Giovanni Iacca , Elisa Ricci

Pre-trained vision-language models provide a robust foundation for efficient transfer learning across various downstream tasks. In the field of video action recognition, mainstream approaches often introduce additional modules to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Haoxing Chen , Zizheng Huang , Yan Hong , Yanshuo Wang , Zhongcai Lyu , Zhuoer Xu , Jun Lan , Zhangxuan Gu

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

The Segment Anything Model (SAM), a vision foundation model, exhibits impressive zero-shot capabilities in general tasks but struggles in specialized domains. Parameter-efficient fine-tuning (PEFT) is a promising approach to unleash the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yuanhong Zhang , Muyao Yuan , Weizhan Zhang , Tieliang Gong , Wen Wen , Jiangyong Ying , Weijie Shi

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

Endoscopic Submucosal Dissection (ESD) is a minimally invasive procedure initially developed for early gastric cancer treatment and has expanded to address diverse gastrointestinal lesions. While computer-assisted surgery (CAS) systems…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiangning Zhang , Qingwei Zhang , Jinnan Chen , Chengfeng Zhou , Yaqi Wang , Zhengjie Zhang , Xiaobo Li , Dahong Qian

Few-shot semantic segmentation (FSS) aims to segment novel classes in query images using only a small annotated support set. While prior research has mainly focused on improving decoders, the encoder's limited ability to extract meaningful…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Pasquale De Marinis , Gennaro Vessio , Giovanna Castellano

The recent Segment Anything Model (SAM) has demonstrated remarkable zero-shot capability and flexible geometric prompting in general image segmentation. However, SAM often struggles when handling various unconventional images, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Ruijie Ren , Xiaoqin Zhang , Ling Shao , Shijian Lu

Artificial intelligence, imaging, and large language models have the potential to transform surgical practice, training, and automation. Understanding and modeling of basic surgical actions (BSA), the fundamental unit of operation in any…