中文
相关论文

相关论文: Augmenting Efficient Real-time Surgical Instrument…

200 篇论文

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

图像与视频处理 · 电气工程与系统科学 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Segment Anything Models (SAM) achieve impressive universal segmentation performance but require massive datasets (e.g., 11M images) and rely solely on RGB inputs. Recent efficient variants reduce computation but still depend on large-scale…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Yiming Zhou , Xuenjie Xie , Panfeng Li , Albrecht Kunz , Ahmad Osman , Xavier Maldague

The Segment Anything Model (SAM) emerges as a powerful vision foundation model to generate high-quality 2D segmentation results. This paper aims to generalize SAM to segment 3D objects. Rather than replicating the data acquisition and…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Jiazhong Cen , Jiemin Fang , Zanwei Zhou , Chen Yang , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian

With the breakthrough of large models, Segment Anything Model (SAM) and its extensions have been attempted to apply in diverse tasks of computer vision. Underwater salient instance segmentation is a foundational and vital step for various…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Shijie Lian , Ziyi Zhang , Hua Li , Wenjie Li , Laurence Tianruo Yang , Sam Kwong , Runmin Cong

Accurate tracking of tissues and instruments in videos is crucial for Robotic-Assisted Minimally Invasive Surgery (RAMIS), as it enables the robot to comprehend the surgical scene with precise locations and interactions of tissues and…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Bohan Zhan , Wang Zhao , Yi Fang , Bo Du , Francisco Vasconcelos , Danail Stoyanov , Daniel S. Elson , Baoru Huang

Segmented light field images can serve as a powerful representation in many of computer vision tasks exploiting geometry and appearance of objects, such as object pose tracking. In the light field domain, segmentation presents an additional…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Nikolai Goncharov , Donald G. Dansereau

We propose a straightforward yet highly effective few-shot fine-tuning strategy for adapting the Segment Anything (SAM) to anatomical segmentation tasks in medical images. Our novel approach revolves around reformulating the mask decoder…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Weiyi Xie , Nathalie Willems , Shubham Patil , Yang Li , Mayank Kumar

The introduction of saliency map algorithms as an approach for assessing the interoperability of images has allowed for a deeper understanding of current black-box models with Artificial Intelligence. Their rise in popularity has led to…

图像与视频处理 · 电气工程与系统科学 2023-06-29 Evan Kellener , Ihina Nath , An Ngo , Thomas Nguyen , Joshua Schuman , Coen Adler , Arnav Kartikeya

Recently, the first foundation model developed specifically for image segmentation tasks was developed, termed the "Segment Anything Model" (SAM). SAM can segment objects in input imagery based on cheap input prompts, such as one (or more)…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Simiao Ren , Francesco Luzi , Saad Lahrichi , Kaleb Kassaw , Leslie M. Collins , Kyle Bradbury , Jordan M. Malof

The Segment Anything Model (SAM) marks a notable milestone in segmentation models, highlighted by its robust zero-shot capabilities and ability to handle diverse prompts. SAM follows a pipeline that separates interactive segmentation into…

计算机视觉与模式识别 · 计算机科学 2024-05-30 You Huang , Zongyu Lan , Liujuan Cao , Xianming Lin , Shengchuan Zhang , Guannan Jiang , Rongrong Ji

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies…

图像与视频处理 · 电气工程与系统科学 2025-04-07 Jun Ma , Zongxin Yang , Sumin Kim , Bihui Chen , Mohammed Baharoon , Adibvafa Fallahpour , Reza Asakereh , Hongwei Lyu , Bo Wang

Salient Object Detection (SOD) aims to identify and segment the most prominent objects in images. Advanced SOD methods often utilize various Convolutional Neural Networks (CNN) or Transformers for deep feature extraction. However, these…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Shixuan Gao , Pingping Zhang , Tianyu Yan , Huchuan Lu

We introduce SAM2Point, a preliminary exploration adapting Segment Anything Model 2 (SAM 2) for zero-shot and promptable 3D segmentation. SAM2Point interprets any 3D data as a series of multi-directional videos, and leverages SAM 2 for…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Chengzhuo Tong , Peng Gao , Chunyuan Li , Pheng-Ann Heng

The Segment Anything Model (SAM) exhibits impressive capabilities in zero-shot segmentation for natural images. Recently, SAM has gained a great deal of attention for its applications in medical image segmentation. However, to our best…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Pengfei Gu , Zihan Zhao , Hongxiao Wang , Yaopeng Peng , Yizhe Zhang , Nishchal Sapkota , Chaoli Wang , Danny Z. Chen

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su

Multi-class multi-instance segmentation is the task of identifying masks for multiple object classes and multiple instances of the same class within an image. The foundational Segment Anything Model (SAM) is designed for promptable…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Mariia Khan , Yue Qiu , Yuren Cong , Jumana Abu-Khalaf , David Suter , Bodo Rosenhahn

Surgical video segmentation is critical for AI to interpret spatial-temporal dynamics in surgery, yet model performance is constrained by limited annotated data. The SAM2 model, pretrained on natural videos, offers potential for zero-shot…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Cheng Yuan , Jian Jiang , Kunyi Yang , Lv Wu , Rui Wang , Zi Meng , Haonan Ping , Ziyu Xu , Yifan Zhou , Wanli Song , Hesheng Wang , Yueming Jin , Qi Dou , Yutong Ban

Embodied tasks require the agent to fully understand 3D scenes simultaneously with its exploration, so an online, real-time, fine-grained and highly-generalized 3D perception model is desperately needed. Since high-quality 3D data is…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Xiuwei Xu , Huangxing Chen , Linqing Zhao , Ziwei Wang , Jie Zhou , Jiwen Lu

Recently segment anything model (SAM) has attracted widespread concerns, and it is often treated as a vision foundation model for universal segmentation. Some researchers have attempted to directly apply the foundation model to the RGB-D…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Jia Lin , Xiaofei Zhou , Jiyuan Liu , Runmin Cong , Guodao Zhang , Zhi Liu , Jiyong Zhang

The recent Segment Anything Model (SAM) 2 has demonstrated remarkable foundational competence in semantic segmentation, with its memory mechanism and mask decoder further addressing challenges in video tracking and object occlusion, thereby…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Jieming Yu , An Wang , Wenzhen Dong , Mengya Xu , Mobarakol Islam , Jie Wang , Long Bai , Hongliang Ren