English
Related papers

Related papers: Prompting Foundation Models for Zero-Shot Ship Ins…

200 papers

We present a zero-shot segmentation approach for agricultural imagery that leverages Plantnet, a large-scale plant classification model, in conjunction with its DinoV2 backbone and the Segment Anything Model (SAM). Rather than collecting…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Simon Ravé , Jean-Christophe Lombardo , Pejman Rasti , Alexis Joly , David Rousseau

The robust association of the same objects across video frames in complex scenes is crucial for many applications, especially Multiple Object Tracking (MOT). Current methods predominantly rely on labeled domain-specific video datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Siyuan Li , Lei Ke , Martin Danelljan , Luigi Piccinelli , Mattia Segu , Luc Van Gool , Fisher Yu

Semantic mapping based on the supervised object detectors is sensitive to image distribution. In real-world environments, the object detection and segmentation performance can lead to a major drop, preventing the use of semantic mapping in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Chuhao Liu , Ke Wang , Jieqi Shi , Zhijian Qiao , Shaojie Shen

Methods for object detection and segmentation rely on large scale instance-level annotations for training, which are difficult and time-consuming to collect. Efforts to alleviate this look at varying degrees and quality of supervision.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Siddhesh Khandelwal , Raghav Goyal , Leonid Sigal

Medical image segmentation is vital for clinical diagnosis, yet current deep learning methods often demand extensive expert effort, i.e., either through annotating large training datasets or providing prompts at inference time for each new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xingjian Li , Qifeng Wu , Adithya S. Ubaradka , Yiran Ding , Colleen Que , Runmin Jiang , Jianhua Xing , Tianyang Wang , Min Xu

With the emergence of foundation model, this novel paradigm of deep learning has encouraged many powerful achievements in natural language processing and computer vision. There are many advantages of foundation model, such as excellent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Haoxuan Ding , Junyu Gao , Yuan Yuan , Qi Wang

Image segmentation is a critical enabler for tasks ranging from medical diagnostics to autonomous driving. However, the correct segmentation semantics - where are boundaries located? what segments are logically similar? - change depending…

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Unsupervised multimodal change detection is pivotal for time-sensitive tasks and comprehensive multi-temporal Earth monitoring. In this study, we explore unsupervised multimodal change detection between two key remote sensing data sources:…

Image and Video Processing · Electrical Eng. & Systems 2024-01-18 Hongruixuan Chen , Jian Song , Naoto Yokoya

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

Foundation segmentation models such as the Segment Anything Model (SAM) exhibit strong zero-shot generalization through large-scale pretraining, but adapting them to domain-specific semantic segmentation remains challenging, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Salim Khazem

Multi-class multi-instance segmentation is the task of identifying masks for multiple object classes and multiple instances of the same class within an image. The foundational Segment Anything Model (SAM) is designed for promptable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mariia Khan , Yue Qiu , Yuren Cong , Jumana Abu-Khalaf , David Suter , Bodo Rosenhahn

Single-point annotation in visual tasks, with the goal of minimizing labelling costs, is becoming increasingly prominent in research. Recently, visual foundation models, such as Segment Anything (SAM), have gained widespread usage due to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhaoyang Wei , Pengfei Chen , Xuehui Yu , Guorong Li , Jianbin Jiao , Zhenjun Han

Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhen Xu , Hongyu Zhou , Sida Peng , Haotong Lin , Haoyu Guo , Jiahao Shao , Peishan Yang , Qinglin Yang , Sheng Miao , Xingyi He , Yifan Wang , Yue Wang , Ruizhen Hu , Yiyi Liao , Xiaowei Zhou , Hujun Bao

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

The Segment Anything Model (SAM) has demonstrated remarkable capabilities of scaled-up segmentation models, enabling zero-shot generalization across a variety of domains. By leveraging large-scale foundational models as pre-trained models,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Weijia Feng , Lingting Zhu , Lequan Yu

The Segment Anything Model (SAM) serves as a fundamental model for semantic segmentation and demonstrates remarkable generalization capabilities across a wide range of downstream scenarios. In this empirical study, we examine SAM's…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 An Wang , Mobarakol Islam , Mengya Xu , Yang Zhang , Hongliang Ren

Foundation models have rapidly evolved and have achieved significant accomplishments in computer vision tasks. Specifically, the prompt mechanism conveniently allows users to integrate image prior information into the model, making it…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Handi Deng , Yucheng Zhou , Jiaxuan Xiang , Liujie Gu , Yan Luo , Hai Feng , Mingyuan Liu , Cheng Ma

The objective of Audio-Visual Segmentation (AVS) is to localise the sounding objects within visual scenes by accurately predicting pixel-wise segmentation masks. To tackle the task, it involves a comprehensive consideration of both the data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Jinxiang Liu , Yu Wang , Chen Ju , Chaofan Ma , Ya Zhang , Weidi Xie

Detecting unknown objects in semantic segmentation is crucial for safety-critical applications such as autonomous driving. Large vision foundation models, including DINOv2, InternImage, and CLIP, have advanced visual representation learning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Laith Nayal , Hadi Salloum , Ahmad Taha , Yaroslav Kholodov , Alexander Gasnikov