English
Related papers

Related papers: Semantic-Fast-SAM: Efficient Semantic Segmenter

200 papers

In computer vision, object detection is an important task that finds its application in many scenarios. However, obtaining extensive labels can be challenging, especially in crowded scenes. Recently, the Segment Anything Model (SAM) has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Zhi Cai , Yingjie Gao , Yaoyan Zheng , Nan Zhou , Di Huang

In image restoration (IR), leveraging semantic priors from segmentation models has been a common approach to improve performance. The recent segment anything model (SAM) has emerged as a powerful tool for extracting advanced semantic priors…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Quan Zhang , Xiaoyu Liu , Wei Li , Hanting Chen , Junchao Liu , Jie Hu , Zhiwei Xiong , Chun Yuan , Yunhe Wang

The performance of image segmentation models has historically been constrained by the high cost of collecting large-scale annotated data. The Segment Anything Model (SAM) alleviates this original problem through a promptable,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Miguel Espinosa , Chenhongyi Yang , Linus Ericsson , Steven McDonagh , Elliot J. Crowley

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Semantic segmentation is a significant perception task in autonomous driving. It suffers from the risks of adversarial examples. In the past few years, deep learning has gradually transitioned from convolutional neural network (CNN) models…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Jun Yan , Pengyu Wang , Danni Wang , Weiquan Huang , Daniel Watzenig , Huilin Yin

We present EfficientViT-SAM, a new family of accelerated segment anything models. We retain SAM's lightweight prompt encoder and mask decoder while replacing the heavy image encoder with EfficientViT. For the training, we begin with the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Zhuoyang Zhang , Han Cai , Song Han

Segment Anything Model (SAM) has attracted significant attention due to its impressive zero-shot transfer performance and high versatility for numerous vision applications (like image editing with fine-grained control). Many of such…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Chaoning Zhang , Dongshen Han , Yu Qiao , Jung Uk Kim , Sung-Ho Bae , Seungkyu Lee , Choong Seon Hong

This paper presents the Autonomous Driving Segment Anything Model (AD-SAM), a fine-tuned vision foundation model for semantic segmentation in autonomous driving (AD). AD-SAM extends the Segment Anything Model (SAM) with a dual-encoder and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Mario Camarena , Het Patel , Fatemeh Nazari , Evangelos Papalexakis , Mohamadhossein Noruzoliaee , Jia Chen

The Segment Anything Model (SAM) has set a new standard in interactive image segmentation, offering robust performance across various tasks. However, its significant computational requirements limit its deployment in real-time or…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Kunal Dasharath Patil , Gowthamaan Palani , Ganapathy Krishnamurthi

Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted. Interactivity is a key strength of SAMs, allowing users…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Yiqing Shen , Jingxing Li , Xinyuan Shao , Blanca Inigo Romillo , Ankush Jindal , David Dreizin , Mathias Unberath

Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), have shown promise as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yimu Pan , Sitao Zhang , Alison D. Gernand , Jeffery A. Goldstein , James Z. Wang

Segment anything model (SAM) has emerged as the leading approach for zero-shot learning in segmentation tasks, offering the advantage of avoiding pixel-wise annotations. It is particularly appealing in medical image segmentation, where the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-29 Ziyi Huang , Hongshan Liu , Haofeng Zhang , Xueshen Li , Haozhe Liu , Fuyong Xing , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Yizhe Zhang , Shuo Wang , Tao Zhou , Qi Dou , Danny Z. Chen

The Segment Anything Model (SAM) exhibits a capability to segment a wide array of objects in natural images, serving as a versatile perceptual tool for various downstream image segmentation tasks. In contrast, medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yizhe Zhang , Tao Zhou , Shuo Wang , Ye Wu , Pengfei Gu , Danny Z. Chen

Recently, Segment Anything Model (SAM) has demonstrated strong generalizability in various instance segmentation tasks. However, its performance is severely dependent on the quality of manual prompts. In addition, the RGB images that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yihan Shang , Wei Wang , Chao Huang , Xinghui Dong

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-trained SAM and achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Shu , Wenshuo Li , Yehui Tang , Yiman Zhang , Yihao Chen , Houqiang Li , Yunhe Wang , Xinghao Chen

Localization is an essential task for mobile autonomous robotic systems that want to use pre-existing maps or create new ones in the context of SLAM. Today, many robotic platforms are equipped with high-accuracy 3D LiDAR sensors, which…

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

The encoder-decoder framework is state-of-the-art for offline semantic image segmentation. Since the rise in autonomous systems, real-time computation is increasingly desirable. In this paper, we introduce fast segmentation convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Rudra P K Poudel , Stephan Liwicki , Roberto Cipolla