English
Related papers

Related papers: Prompt Group-Aware Training for Robust Text-Guided…

200 papers

Interactive 3D biomedical image segmentation requires efficient models that can iteratively refine predictions based on user prompts. Current foundation models either lack volumetric awareness or suffer from limited interactive…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Tidiane Camaret Ndir , Alexander Pfefferle , Robin Tibor Schirrmeister

Visual Foundation Models (VFMs) such as the Segment Anything Model (SAM) have significantly advanced broad use of image segmentation. However, SAM and its variants necessitate substantial manual effort for prompt generation and additional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Minjae Lee , Sungwoo Hur , Soojin Hwang , Won Hwa Kim

In digital pathology, precise nuclei segmentation is pivotal yet challenged by the diversity of tissue types, staining protocols, and imaging conditions. Recently, the segment anything model (SAM) revealed overwhelming performance in…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhen Chen , Qing Xu , Xinyu Liu , Yixuan Yuan

Open-vocabulary segmentation models such as SAM3 perform well across broad categories via text prompting, yet degrade when target classes are visually underrepresented in pretraining or depart from canonical depictions-limitations text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Abderrahmene Boudiaf , Irfan Hussain , Sajid Javed

Semantic segmentations of pathological entities have crucial clinical value in computational pathology workflows. Foundation models, such as the Segment Anything Model (SAM), have been recently proposed for universal use in segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-07-20 Jingwei Zhang , Ke Ma , Saarthak Kapse , Joel Saltz , Maria Vakalopoulou , Prateek Prasanna , Dimitris Samaras

We introduce segmentation-free guidance, a novel method designed for text-to-image diffusion models like Stable Diffusion. Our method does not require retraining of the diffusion model. At no additional compute cost, it uses the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Kambiz Azarian , Debasmit Das , Qiqi Hou , Fatih Porikli

In this work, we investigate performing semantic segmentation solely through the training on image-sentence pairs. Due to the lack of dense annotations, existing text-supervised methods can only learn to group an image into semantic regions…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yabo Zhang , Zihao Wang , Jun Hao Liew , Jingjia Huang , Manyu Zhu , Jiashi Feng , Wangmeng Zuo

The Segment Anything Model (SAM) can achieve satisfactory segmentation performance under high-quality box prompts. However, SAM's robustness is compromised by the decline in box quality, limiting its practicality in clinical reality. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Yuhao Huang , Xin Yang , Han Zhou , Yan Cao , Haoran Dou , Fajin Dong , Dong Ni

The development of machine learning models for CT imaging depends on the availability of large, high-quality, and diverse annotated datasets. Although large volumes of CT images and reports are readily available in clinical picture…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Samuel Church , Joshua D. Warner , Danyal Maqbool , Xin Tie , Junjie Hu , Meghan G. Lubner , Tyler J. Bradshaw

Nuclear instance segmentation and classification provide critical quantitative foundations for digital pathology diagnosis. With the advent of the foundational Segment Anything Model (SAM), the accuracy and efficiency of nuclear…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Liying Xu , Hongliang He , Wei Han , Hanbin Huang , Siwei Feng , Guohong Fu

Purpose: Recent developments in computational pathology have been driven by advances in Vision Foundation Models, particularly the Segment Anything Model (SAM). This model facilitates nuclei segmentation through two primary methods:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Xueyuan Li , Can Cui , Ruining Deng , Yucheng Tang , Quan Liu , Tianyuan Yao , Shunxing Bao , Naweed Chowdhury , Haichun Yang , Yuankai Huo

The Segment Anything Model (SAM) has recently emerged as a groundbreaking foundation model for prompt-driven image segmentation tasks. However, both the original SAM and its medical variants require slice-by-slice manual prompting of target…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yichi Zhang , Shiyao Hu , Sijie Ren , Chen Jiang , Yuan Cheng , Yuan Qi

In the rapidly evolving field of AI research, foundational models like BERT and GPT have significantly advanced language and vision tasks. The advent of pretrain-prompting models such as ChatGPT and Segmentation Anything Model (SAM) has…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Saiyang Na , Yuzhi Guo , Feng Jiang , Hehuan Ma , Junzhou Huang

The Segment Anything Model (SAM) achieves remarkable promptable segmentation given high-quality prompts which, however, often require good skills to specify. To make SAM robust to casual prompts, this paper presents the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Qi Fan , Xin Tao , Lei Ke , Mingqiao Ye , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu-Wing Tai , Chi-Keung Tang

Whole-body PET/CT is a cornerstone of oncological imaging, yet accurate lesion segmentation remains challenging due to tracer heterogeneity, physiological uptake, and multi-center variability. While fully automated methods have advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Maximilian Rokuss , Yannick Kirchhoff , Fabian Isensee , Klaus H. Maier-Hein

Purpose: To evaluate various Segmental Anything Model (SAM) prompt strategies across four lesions datasets and to subsequently develop a reinforcement learning (RL) agent to optimize SAM prompt placement. Materials and Methods: This…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Yuli Wang , Victoria Shi , Wen-Chi Hsu , Yuwei Dai , Sophie Yao , Zhusi Zhong , Zishu Zhang , Jing Wu , Aaron Maxwell , Scott Collins , Zhicheng Jiao , Harrison X. Bai

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have significantly impacted medical image segmentation, especially in retinal imaging, where precise segmentation is vital for diagnosis. Despite this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Shahrooz Faghihroohi , Kai Huang , Nassir Navab , M. Ali Nasseri

Existing promptable segmentation methods in the medical imaging field primarily consider either textual or visual prompts to segment relevant objects, yet they often fall short when addressing anomalies in medical images, like tumors, which…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhongzhen Huang , Yankai Jiang , Rongzhao Zhang , Shaoting Zhang , Xiaofan Zhang

Remote sensing (RS) image segmentation is constrained by the limited availability of annotated data and a gap between overhead imagery and natural images used to train foundational models. This motivates effective adaptation under limited…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Roni Blushtein-Livnon , Osher Rafaeli , David Ioffe , Amir Boger , Karen Sandberg Esquenazi , Tal Svoray

Promptable segmentation models (e.g., the Segment Anything Models) enable generalizable, zero-shot segmentation across diverse domains. Although predictions are deterministic for a fixed image-prompt pair, the robustness of these models to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Elodie Germani , Krystel Nyangoh-Timoh , Pierre Jannin , John S H Baxter