English
Related papers

Related papers: Knowledge distillation with Segment Anything (SAM)…

200 papers

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su

Robust and accurate segmentation of scenes has become one core functionality in various visual recognition and navigation tasks. This has inspired the recent development of Segment Anything Model (SAM), a foundation model for general mask…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Naoto Yokoya , Shijian Lu

Segmented light field images can serve as a powerful representation in many of computer vision tasks exploiting geometry and appearance of objects, such as object pose tracking. In the light field domain, segmentation presents an additional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Nikolai Goncharov , Donald G. Dansereau

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

The Segment Anything Model (SAM) has revolutionized interactive segmentation through spatial prompting. While existing work primarily focuses on automating prompts in various settings, real-world annotation workflows involve iterative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Prithwijit Chowdhury , Mohit Prabhushankar , Ghassan AlRegib

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tyler Ward , Abdullah-Al-Zubaer Imran

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Advances in machine learning, especially the introduction of transformer architectures and vision transformers, have led to the development of highly capable computer vision foundation models. The segment anything model (known colloquially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kenneth Ball , Erin Taylor , Nirav Patel , Andrew Bartels , Gary Koplik , James Polly , Jay Hineman

Weakly supervised landslide extraction aims to identify landslide regions from remote sensing data using models trained with weak labels, particularly image-level labels. However, it is often challenged by the imprecise boundaries of the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jian Wang , Xiaokang Zhang , Xianping Ma , Weikang Yu , Pedram Ghamisi

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Medical image segmentation plays an important role in many image-guided clinical approaches. However, existing segmentation algorithms mostly rely on the availability of fully annotated images with pixel-wise annotations for training, which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuyan Shi , Jialu Ma , Jin Yang , Shasha Wang , Yichi Zhang

The Segment Anything Model (SAM) emerges as a powerful vision foundation model to generate high-quality 2D segmentation results. This paper aims to generalize SAM to segment 3D objects. Rather than replicating the data acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Jiazhong Cen , Jiemin Fang , Zanwei Zhou , Chen Yang , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian

Foundation models, such as OpenAI's GPT-3 and GPT-4, Meta's LLaMA, and Google's PaLM2, have revolutionized the field of artificial intelligence. A notable paradigm shift has been the advent of the Segment Anything Model (SAM), which has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruikai Cui , Siyuan He , Shi Qiu

Semi-supervised instance segmentation poses challenges due to limited labeled data, causing difficulties in accurately localizing distinct object instances. Current teacher-student frameworks still suffer from performance constraints due to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Heeji Yoon , Heeseong Shin , Eunbeen Hong , Hyunwook Choi , Hansang Cho , Daun Jeong , Seungryong Kim

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Segment Anything Model (SAM) has revolutionized the way of segmentation. However, SAM's performance may decline when applied to tasks involving domains that differ from natural images. Nonetheless, by employing fine-tuning techniques, SAM…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Lin Wang , Xiufen Ye , Liqiang Zhu , Weijie Wu , Jianguo Zhang , Huiming Xing , Chao Hu

Development of new materials in hard drive designs requires characterization of nanoscale materials through grain segmentation. The high-throughput quickly changing research environment makes zero-shot generalization an incredibly desirable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Kai Nichols , Matthew Hauwiller , Nicholas Propes , Shaowei Wu , Stephanie Hernandez , Mike Kautzky

This paper tackles a novel yet challenging problem: how to transfer knowledge from the emerging Segment Anything Model (SAM) -- which reveals impressive zero-shot instance segmentation capacity -- to learn a compact panoramic semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Weiming Zhang , Yexin Liu , Xu Zheng , Lin Wang

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang