English
Related papers

Related papers: Exploiting the Segment Anything Model (SAM) for Lu…

200 papers

Medical image segmentation plays a pivotal role in clinical diagnostics and treatment planning, yet existing models often face challenges in generalization and in handling both 2D and 3D data uniformly. In this paper, we introduce Medical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiayuan Zhu , Abdullah Hamdi , Yunli Qi , Yueming Jin , Junde Wu

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Robust and accurate segmentation of scenes has become one core functionality in various visual recognition and navigation tasks. This has inspired the recent development of Segment Anything Model (SAM), a foundation model for general mask…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Naoto Yokoya , Shijian Lu

Segment Anything Model (SAM) has recently achieved amazing results in the field of natural image segmentation. However, it is not effective for medical image segmentation, owing to the large domain gap between natural and medical images. In…

Image and Video Processing · Electrical Eng. & Systems 2024-04-24 Zhengzheng Tu , Le Gu , Xixi Wang , Bo Jiang

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect the largest video…

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Yichi Zhang , Rushi Jiao

The Segment Anything Model (SAM), a foundational model designed for promptable segmentation tasks, demonstrates exceptional generalization capabilities, making it highly promising for natural scene image segmentation. However, SAM's lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Linghao Zheng , Xinyang Pu , Feng Xu

SAM is a segmentation model recently released by Meta AI Research and has been gaining attention quickly due to its impressive performance in generic object segmentation. However, its ability to generalize to specific scenes such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Lv Tang , Haoke Xiao , Bo Li

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have shown strong performance in various vision tasks, particularly image segmentation, due to their impressive zero-shot segmentation capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Pengfei Gu , Haoteng Tang , Islam A. Ebeid , Jose A. Nunez , Fabian Vazquez , Diego Adame , Marcus Zhan , Huimin Li , Bin Fu , Danny Z. Chen

Segmentation is an important analysis task for biomedical images, enabling the study of individual organelles, cells or organs. Deep learning has massively improved segmentation methods, but challenges remain in generalization to new…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Carolin Teuber , Anwai Archit , Constantin Pape

Multi-class multi-instance segmentation is the task of identifying masks for multiple object classes and multiple instances of the same class within an image. The foundational Segment Anything Model (SAM) is designed for promptable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mariia Khan , Yue Qiu , Yuren Cong , Jumana Abu-Khalaf , David Suter , Bodo Rosenhahn

The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hong Liu , Haosen Yang , Paul J. van Diest , Josien P. W. Pluim , Mitko Veta

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Amodal instance segmentation, which aims to detect and segment both visible and invisible parts of objects in images, plays a crucial role in various applications including autonomous driving, robotic manipulation, and scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wei-En Tai , Yu-Lin Shih , Cheng Sun , Yu-Chiang Frank Wang , Hwann-Tzong Chen

Recently, developing unified medical image segmentation models gains increasing attention, especially with the advent of the Segment Anything Model (SAM). SAM has shown promising binary segmentation performance in natural domains, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shuangping Huang , Hao Liang , Qingfeng Wang , Chulong Zhong , Zijian Zhou , Miaojing Shi

The advent of large models, also known as foundation models, has significantly transformed the AI research landscape, with models like Segment Anything (SAM) achieving notable success in diverse image segmentation scenarios. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Tianrun Chen , Ankang Lu , Lanyun Zhu , Chaotao Ding , Chunan Yu , Deyi Ji , Zejian Li , Lingyun Sun , Papa Mao , Ying Zang

Segment Anything Model (SAM) has revolutionized the way of segmentation. However, SAM's performance may decline when applied to tasks involving domains that differ from natural images. Nonetheless, by employing fine-tuning techniques, SAM…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Lin Wang , Xiufen Ye , Liqiang Zhu , Weijie Wu , Jianguo Zhang , Huiming Xing , Chao Hu

Segment Anything Model (SAM) has achieved impressive results for natural image segmentation with input prompts such as points and bounding boxes. Its success largely owes to massive labeled training data. However, directly applying SAM to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-21 Jin Ye , Junlong Cheng , Jianpin Chen , Zhongying Deng , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Min Zhu , Shaoting Zhang , Junjun He , Yu Qiao

Bloodstain pattern analysis plays a crucial role in crime scene investigations by providing valuable information through the study of unique blood patterns. Conventional image analysis methods, like Thresholding and Contrast, impose…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zihan Dong , ZhengDong Zhang