English
Related papers

Related papers: Prompting Foundation Models for Zero-Shot Ship Ins…

200 papers

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

Segment Anything Model (SAM) has demonstrated powerful zero-shot segmentation performance in natural scenes. The recently released Segment Anything Model 2 (SAM2) has further heightened researchers' expectations towards image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Jialun Pei , Zhangjun Zhou , Tiantian Zhang

We introduce Grounded SAM, which uses Grounding DINO as an open-set object detector to combine with the segment anything model (SAM). This integration enables the detection and segmentation of any regions based on arbitrary text inputs and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Tianhe Ren , Shilong Liu , Ailing Zeng , Jing Lin , Kunchang Li , He Cao , Jiayu Chen , Xinyu Huang , Yukang Chen , Feng Yan , Zhaoyang Zeng , Hao Zhang , Feng Li , Jie Yang , Hongyang Li , Qing Jiang , Lei Zhang

Medical image processing usually requires a model trained with carefully crafted datasets due to unique image characteristics and domain-specific challenges, especially in pathology. Primitive detection and segmentation in digitized tissue…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Abu Bakor Hayat Arnob , Xiangxue Wang , Yiping Jiao , Xiao Gan , Wenlong Ming , Jun Xu

Grounding DINO and the Segment Anything Model (SAM) have achieved impressive performance in zero-shot object detection and image segmentation, respectively. Together, they have a great potential to revolutionize applications in zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Fuseini Mumuni , Alhassan Mumuni

The Segment-Anything Model (SAM) is a vision foundation model for segmentation with a prompt-driven framework. SAM generates class-agnostic masks based on user-specified instance-referring prompts. However, adapting SAM for automated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hussni Mohd Zakir , Eric Tatt Wei Ho

Current 3D scene segmentation methods are heavily dependent on manually annotated 3D training datasets. Such manual annotations are labor-intensive, and often lack fine-grained details. Importantly, models trained on this data typically…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Rui Huang , Songyou Peng , Ayca Takmaz , Federico Tombari , Marc Pollefeys , Shiji Song , Gao Huang , Francis Engelmann

In this paper, we address the problem of sim-to-real transfer for object segmentation when there is no access to real examples of an object of interest during training, i.e. zero-shot sim-to-real transfer for segmentation. We focus on the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Advaith Venkatramanan Sethuraman , Katherine A. Skinner

Pixel-level vision tasks, such as semantic segmentation, require extensive and high-quality annotated data, which is costly to obtain. Semi-supervised semantic segmentation (SSSS) has emerged as a solution to alleviate the labeling burden…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Danhui Chen , Ziquan Liu , Chuxi Yang , Dan Wang , Yan Yan , Yi Xu , Xiangyang Ji

With the rapid advancement of deep learning, synthetic aperture radar (SAR) imagery has become a key modality for ship detection. However, robust performance remains challenging in complex scenes, where clutter and speckle noise can induce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xiaojing Zhao , Shiyang Li , Zena Chu , Ying Zhang , Peinan Hao , Tianzi Yan , Jiajia Chen , Huicong Ning

The Segment Anything Model (SAM) is a recently proposed prompt-based segmentation model in a generic zero-shot segmentation approach. With the zero-shot segmentation capacity, SAM achieved impressive flexibility and precision on various…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Can Cui , Ruining Deng , Quan Liu , Tianyuan Yao , Shunxing Bao , Lucas W. Remedios , Yucheng Tang , Yuankai Huo

Zero-shot 4D segmentation and recognition of arbitrary objects in Lidar is crucial for embodied navigation, with applications ranging from streaming perception to semantic mapping and localization. However, the primary challenge in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yushan Zhang , Aljoša Ošep , Laura Leal-Taixé , Tim Meinhardt

Fundamental models, trained on large-scale datasets and adapted to new data using innovative learning methods, have revolutionized various fields. In materials science, microstructure image segmentation plays a pivotal role in understanding…

Materials Science · Physics 2024-07-09 Xudong Ma , Yuqi Zhang , Chenchong Wang , Wei Xu

Medical image segmentation plays an important role in many image-guided clinical approaches. However, existing segmentation algorithms mostly rely on the availability of fully annotated images with pixel-wise annotations for training, which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuyan Shi , Jialu Ma , Jin Yang , Shasha Wang , Yichi Zhang

The Segment Anything Model (SAM) exhibits remarkable versatility and zero-shot learning abilities, owing largely to its extensive training data (SA-1B). Recognizing SAM's dependency on manual guidance given its category-agnostic nature, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Xiyu Qi , Yifan Wu , Yongqiang Mao , Wenhui Zhang , Yidan Zhang

Deep learning methods have made significant progress in ship detection in synthetic aperture radar (SAR) images. The pretraining technique is usually adopted to support deep neural networks-based SAR ship detectors due to the scarce labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Wei Bao , Meiyu Huang , Yaqin Zhang , Yao Xu , Xuejiao Liu , Xueshuang Xiang

This paper presents an end-to-end instance segmentation framework, termed SOIT, that Segments Objects with Instance-aware Transformers. Inspired by DETR \cite{carion2020end}, our method views instance segmentation as a direct set prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Xiaodong Yu , Dahu Shi , Xing Wei , Ye Ren , Tingqun Ye , Wenming Tan

Recently, Segment Anything Model (SAM) shows exceptional performance in generating high-quality object masks and achieving zero-shot image segmentation. However, as a versatile vision model, SAM is primarily trained with large-scale natural…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Tianyu Yan , Zifu Wan , Xinhao Deng , Pingping Zhang , Yang Liu , Huchuan Lu

The Segment Anything Model (SAM) excels at generating precise object masks from input prompts but lacks semantic awareness, failing to associate its generated masks with specific object categories. To address this limitation, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Rohit Kundu , Sudipta Paul , Arindam Dutta , Amit K. Roy-Chowdhury

Medical image registration is a fundamental task in medical image analysis, aiming to establish spatial correspondences between paired images. However, existing unsupervised deformable registration methods rely solely on intensity-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Hao Xu , Tengfei Xue , Jianan Fan , Dongnan Liu , Yuqian Chen , Fan Zhang , Carl-Fredrik Westin , Ron Kikinis , Lauren J. O'Donnell , Weidong Cai