English
Related papers

Related papers: ProSAM: Enhancing the Robustness of SAM-based Visu…

200 papers

Segmenting objects with complex shapes, such as wires, bicycles, or structural grids, remains a significant challenge for current segmentation models, including the Segment Anything Model (SAM) and its high-quality variant SAM-HQ. These…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Luka Vetoshkin , Dmitry Yudin

Foundation models enable prompt-based classifiers for zero-shot and few-shot learning. Nonetheless, the conventional method of employing fixed prompts suffers from distributional shifts that negatively impact generalizability to unseen…

Machine Learning · Computer Science 2024-10-29 Yingjun Du , Gaowen Liu , Yuzhang Shang , Yuguang Yao , Ramana Kompella , Cees G. M. Snoek

This report presents a solution for the zero-shot referring expression comprehension task. Visual-language multimodal base models (such as CLIP, SAM) have gained significant attention in recent years as a cornerstone of mainstream research.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Longfei Huang , Feng Yu , Zhihao Guan , Zhonghua Wan , Yang Yang

Extracting small objects from remote sensing imagery plays a vital role in various applications, including urban planning, environmental monitoring, and disaster management. While current research primarily focuses on small object…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu

Prompt-conditioned foundation segmenters have emerged as a dominant paradigm for image segmentation, where explicit spatial prompts (e.g., points, boxes, masks) guide mask decoding. However, many real-world deployments require fully…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Huiyao Zhang , Jin Bai , Rui Guo , JianWen Tan , HongFei Wang , Ye Li

For more efficient generalization to unseen domains (classes), most Few-shot Segmentation (FSS) would directly exploit pre-trained encoders and only fine-tune the decoder, especially in the current era of large models. However, such fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Hanbo Bi , Yingchao Feng , Wenhui Diao , Peijin Wang , Yongqiang Mao , Kun Fu , Hongqi Wang , Xian Sun

This paper presents a simple and effective visual prompting method for adapting pre-trained models to downstream recognition tasks. Our method includes two key designs. First, rather than directly adding together the prompt and the image,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Junyang Wu , Xianhang Li , Chen Wei , Huiyu Wang , Alan Yuille , Yuyin Zhou , Cihang Xie

Remote sensing applications increasingly rely on deep learning for scene classification. However, their performance is often constrained by the scarcity of labeled data and the high cost of annotation across diverse geographic and sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Ivica Dimitrovski , Vlatko Spasev , Ivan Kitanovski

For downstream applications of vision-language pre-trained models, there has been significant interest in constructing effective prompts. Existing works on prompt engineering, which either require laborious manual designs or optimize the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Xinyang Liu , Dongsheng Wang , Bowei Fang , Miaoge Li , Zhibin Duan , Yishi Xu , Bo Chen , Mingyuan Zhou

In clinical procedures, precise localization of the target area is an essential step for clinical diagnosis and screening. For many diagnostic applications, lung segmentation of chest X-ray images is an essential first step that…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Mohamed Deriche , Mohammad Marufur

Semantic segmentation of microscopic cell images using deep learning is an important technique, however, it requires a large number of images and ground truth labels for training. To address the above problem, we consider an efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Sota Kato , Kazuhiro Hotta

We have witnessed remarkable progress in foundation models in vision tasks. Currently, several recent works have utilized the segmenting anything model (SAM) to boost the segmentation performance in medical images, where most of them focus…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Haoran Wang , Lian Huai , Wenbin Li , Lei Qi , Xingqun Jiang , Yinghuan Shi

Pixel-wise annotations are notoriously labourious and costly to obtain in the medical domain. To mitigate this burden, weakly supervised approaches based on bounding box annotations-much easier to acquire-offer a practical alternative.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Mélanie Gaillochet , Mehrdad Noori , Sahar Dastani , Christian Desrosiers , Hervé Lombaert

In digital pathology, precise nuclei segmentation is pivotal yet challenged by the diversity of tissue types, staining protocols, and imaging conditions. Recently, the segment anything model (SAM) revealed overwhelming performance in…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhen Chen , Qing Xu , Xinyu Liu , Yixuan Yuan

The adaptation of large-scale vision-language models (VLMs) to downstream tasks with limited labeled data remains a significant challenge. While parameter-efficient prompt learning methods offer a promising path, they often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Enming Zhang , Jiayang Li , Yanru Wu , Zhenyu Liu , Yang Li

Open-set image segmentation poses a significant challenge because existing methods often demand extensive training or fine-tuning and generally struggle to segment unified objects consistently across diverse text reference expressions.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zhihua Liu , Amrutha Saseendran , Lei Tong , Xilin He , Fariba Yousefi , Nikolay Burlutskiy , Dino Oglic , Tom Diethe , Philip Teare , Huiyu Zhou , Chen Jin

MedSAM, a medical foundation model derived from the SAM architecture, has demonstrated notable success across diverse medical domains. However, its clinical application faces two major challenges: the dependency on labor-intensive manual…

Image and Video Processing · Electrical Eng. & Systems 2025-04-17 Peng Huang , Shu Hu , Bo Peng , Xun Gong , Penghang Yin , Hongtu Zhu , Xi Wu , Xin Wang

The recently proposed Segment Anything Model (SAM) is a general tool for image segmentation, but it requires additional adaptation and careful fine-tuning for medical image segmentation, especially for small, irregularly-shaped, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Yaxi Chen , Aleksandra Ivanova , Shaheer U. Saeed , Rikin Hargunani , Jie Huang , Chaozong Liu , Yipeng Hu

Recently, the powerful generalization ability exhibited by foundation models has brought forth new solutions for zero-shot anomaly segmentation tasks. However, guiding these foundation models correctly to address downstream tasks remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yanning Hou , Ke Xu , Junfa Li , Yanran Ruan , Jianfeng Qiu

Weakly Supervised Object Localization (WSOL), which aims to localize objects by only using image-level labels, has attracted much attention because of its low annotation cost in real applications. Current studies focus on the Class…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xi Yang , Songsong Duan , Nannan Wang , Xinbo Gao