English
Related papers

Related papers: No time to train! Training-Free Reference-Based In…

200 papers

Foundation models have taken over natural language processing and image generation domains due to the flexibility of prompting. With the recent introduction of the Segment Anything Model (SAM), this prompt-driven paradigm has entered image…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Saikat Roy , Tassilo Wald , Gregor Koehler , Maximilian R. Rokuss , Nico Disch , Julius Holzschuh , David Zimmerer , Klaus H. Maier-Hein

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

The emerging scale segmentation model, Segment Anything (SAM), exhibits impressive capabilities in zero-shot segmentation for natural images. However, when applied to medical images, SAM suffers from noticeable performance drop. To make SAM…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Xinrong Hu , Xiaowei Xu , Yiyu Shi

Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunyang Xiong , Bala Varadarajan , Lemeng Wu , Xiaoyu Xiang , Fanyi Xiao , Chenchen Zhu , Xiaoliang Dai , Dilin Wang , Fei Sun , Forrest Iandola , Raghuraman Krishnamoorthi , Vikas Chandra

Semantic segmentation is an important topic in computer vision with many relevant application in Earth observation. While supervised methods exist, the constraints of limited annotated data has encouraged development of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Pratik Vora , Sudipan Saha

The recently proposed segment anything model (SAM) has made a significant influence in many computer vision tasks. It is becoming a foundation step for many high-level tasks, like image segmentation, image caption, and image editing.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Xu Zhao , Wenchao Ding , Yongqi An , Yinglong Du , Tao Yu , Min Li , Ming Tang , Jinqiao Wang

Semantic segmentation is a significant perception task in autonomous driving. It suffers from the risks of adversarial examples. In the past few years, deep learning has gradually transitioned from convolutional neural network (CNN) models…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Jun Yan , Pengyu Wang , Danni Wang , Weiquan Huang , Daniel Watzenig , Huilin Yin

Present-day deep neural networks for video semantic segmentation require a large number of fine-grained pixel-level annotations to achieve the best possible results. Obtaining such annotations, however, is very expensive. On the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Samik Some , Vinay P. Namboodiri

Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiaxing Huang , Kai Jiang , Jingyi Zhang , Han Qiu , Lewei Lu , Shijian Lu , Eric Xing

Due to the inherent flexibility of prompting, foundation models have emerged as the predominant force in the fields of natural language processing and computer vision. The recent introduction of the Segment Anything Model (SAM) signifies a…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Yichi Zhang , Zhenrong Shen , Rushi Jiao

Recently, the first foundation model developed specifically for image segmentation tasks was developed, termed the "Segment Anything Model" (SAM). SAM can segment objects in input imagery based on cheap input prompts, such as one (or more)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simiao Ren , Francesco Luzi , Saad Lahrichi , Kaleb Kassaw , Leslie M. Collins , Kyle Bradbury , Jordan M. Malof

Few-Shot Semantic Segmentation (FSS) focuses on segmenting novel object categories from only a handful of annotated examples. Most existing approaches rely on extensive episodic training to learn transferable representations, which is both…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yi-Jen Tsai , Yen-Yu Lin , Chien-Yao Wang

The segment anything model (SAM) was released as a foundation model for image segmentation. The promptable segmentation model was trained by over 1 billion masks on 11M licensed and privacy-respecting images. The model supports zero-shot…

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Yichi Zhang , Rushi Jiao

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Tyler Ward , Meredith K. Owen , O'Kira Coleman , Brian Noehren , Abdullah-Al-Zubaer Imran

The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. This paper proposes a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Haiyue Zu , Jun Ge , Heting Xiao , Jile Xie , Zhangzhe Zhou , Yifan Meng , Jiayi Ni , Junjie Niu , Linlin Zhang , Li Ni , Huilin Yang

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Training-free Camouflaged Object Segmentation (COS) seeks to segment camouflaged objects without task-specific training, by automatically generating visual prompts to guide the Segment Anything Model (SAM). However, existing pipelines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Chao Yin , Jide Li , Hang Yao , Xiaoqiang Li

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu