English
Related papers

Related papers: SAM2-UNet: Segment Anything 2 Makes Strong Encoder…

200 papers

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

Recently, Segment Anything Model (SAM) has become a research hotspot in the fields of multimedia and computer vision, which exhibits powerful yet versatile capabilities on various (un) conditional image segmentation tasks. Although SAM can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Xiaorui Huang , Gen Luo , Chaoyang Zhu , Bo Tong , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hong Liu , Haosen Yang , Paul J. van Diest , Josien P. W. Pluim , Mitko Veta

Segment Anything Model (SAM) has achieved impressive results for natural image segmentation with input prompts such as points and bounding boxes. Its success largely owes to massive labeled training data. However, directly applying SAM to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-21 Jin Ye , Junlong Cheng , Jianpin Chen , Zhongying Deng , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Min Zhu , Shaoting Zhang , Junjun He , Yu Qiao

Segmentation of indicated targets aids in the precise analysis of optical coherence tomography angiography (OCTA) samples. Existing segmentation methods typically perform on 2D projection targets, making it challenging to capture the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Xinrun Chen , Chengliang Wang , Haojian Ning , Mengzhan Zhang , Mei Shen , Shiying Li

Segmentation of cellular structures in electron microscopy (EM) images is fundamental to analyzing the morphology of neurons and glial cells in the healthy and diseased brain tissue. Current neuronal segmentation applications are based on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Zewen Zhuo , Ilya Belevich , Ville Leinonen , Eija Jokitalo , Tarja Malm , Alejandra Sierra , Jussi Tohka

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Medical image segmentation is crucial for the development of computer-aided diagnostic and therapeutic systems, but still faces numerous difficulties. In recent years, the commonly used encoder-decoder architecture based on CNNs has been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Davoud Saadati , Omid Nejati Manzari , Sattar Mirzakuchaki

Microscopic image segmentation is a challenging task, wherein the objective is to assign semantic labels to each pixel in a given microscopic image. While convolutional neural networks (CNNs) form the foundation of many existing frameworks,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Mustansar Fiaz , Moein Heidari , Rao Muhammad Anwer , Hisham Cholakkal

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

The Segment Anything Model (SAM) has gained significant attention in the field of image segmentation due to its impressive capabilities and prompt-based interface. While SAM has already been extensively evaluated in various domains, its…

Image and Video Processing · Electrical Eng. & Systems 2023-09-01 Botond Fazekas , José Morano , Dmitrii Lachinov , Guilherme Aresta , Hrvoje Bogunović

The Segment Anything Model 2 (SAM2) has recently demonstrated exceptional performance in zero-shot prompt segmentation for natural images and videos. However, when the propagation mechanism of SAM2 is applied to medical images, it often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yunhao Bai , Boxiang Yun , Zeli Chen , Qinji Yu , Yingda Xia , Yan Wang

Image segmentation is a fundamental task in both image analysis and medical applications. State-of-the-art methods predominantly rely on encoder-decoder architectures with a U-shaped design, commonly referred to as U-Net. Recent…

Image and Video Processing · Electrical Eng. & Systems 2026-03-05 Chun-Wun Cheng , Yining Zhao , Yanqi Cheng , Javier A. Montoya-Zegarra , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

In this paper, we introduce SAM3-UNet, a simplified variant of Segment Anything Model 3 (SAM3), designed to adapt SAM3 for downstream tasks at a low cost. Our SAM3-UNet consists of three components: a SAM3 image encoder, a simple adapter…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xinyu Xiong , Zihuang Wu , Lei Lu , Yufa Xia

Segmentation in medical imaging is a critical component for the diagnosis, monitoring, and treatment of various diseases and medical conditions. Presently, the medical segmentation landscape is dominated by numerous specialized deep…

The Segment Anything Model (SAM) has garnered significant attention for its versatile segmentation abilities and intuitive prompt-based interface. However, its application in medical imaging presents challenges, requiring either substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Zhiheng Cheng , Qingyue Wei , Hongru Zhu , Yan Wang , Liangqiong Qu , Wei Shao , Yuyin Zhou

Segment Anything Model 2 (SAM2) has emerged as a strong base model in various pinhole imaging segmentation tasks. However, when applying it to $360^\circ$ domain, the significant field-of-view (FoV) gap between pinhole ($70^\circ \times…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Ding Zhong , Xu Zheng , Chenfei Liao , Yuanhuiyi Lyu , Jialei Chen , Shengyang Wu , Linfeng Zhang , Xuming Hu

Moving object segmentation is a crucial task for achieving a high-level understanding of visual scenes and has numerous downstream applications. Humans can effortlessly segment moving objects in videos. Previous work has largely relied on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Nan Huang , Wenzhao Zheng , Chenfeng Xu , Kurt Keutzer , Shanghang Zhang , Angjoo Kanazawa , Qianqian Wang

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiang Gao , Kai Lu