English
Related papers

Related papers: IP-SAM: Prompt-Space Conditioning for Prompt-Absen…

200 papers

Existing co-salient object detection (CoSOD) methods generally employ a three-stage architecture (i.e., encoding, consensus extraction & dispersion, and prediction) along with a typical full fine-tuning paradigm. Although they yield certain…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jie Wang , Nana Yu , Zihao Zhang , Yahong Han

While promptable segmentation (\textit{e.g.}, SAM) has shown promise for various segmentation tasks, it still requires manual visual prompts for each object to be segmented. In contrast, task-generic promptable segmentation aims to reduce…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Chao Yin , Hao Li , Kequan Yang , Jide Li , Pinpin Zhu , Xiaoqiang Li

In the realm of image synthesis, achieving fidelity to a reference image while adhering to conditional prompts remains a significant challenge. This paper proposes a novel approach that integrates a diffusion model with latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Kshitij Pathania

We present a unified, promptable model capable of simultaneously segmenting, recognizing, and captioning anything. Unlike SAM, we aim to build a versatile region representation in the wild via visual prompting. To achieve this, we train a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Ting Pan , Lulu Tang , Xinlong Wang , Shiguang Shan

Text-to-Image Diffusion models excel at generating images from text prompts but often exhibit suboptimal alignment with content semantics, aesthetics, and human preferences. To address these limitations, this study proposes a novel…

Machine Learning · Computer Science 2025-05-19 Jianping Ye , Michel Wedel , Kunpeng Zhang

Accurate myocardium segmentation across all phases in one cardiac cycle in cine cardiac magnetic resonance (CMR) scans is crucial for comprehensively cardiac function analysis. Despite advancements in deep learning (DL) for automatic cine…

Image and Video Processing · Electrical Eng. & Systems 2024-07-17 Zhennong Chen , Sekeun Kim , Hui Ren , Quanzheng Li , Xiang Li

The Segment Anything Model (SAM) demonstrates impressive zero-shot segmentation ability on natural images but encounters difficulties in medical imaging due to domain shifts, anatomical variability, and its reliance on user-provided…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yingzhen Hu , Yiheng Zhong , Ruobing Li , Yingxue Su , Jiabao An , Feilong Tang , Jionglong Su , Imran Razzak

Promptable foundation models, particularly Segment Anything Model (SAM), have emerged as a promising alternative to the traditional task-specific supervised learning for image segmentation. However, many evaluation studies have found that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Rachana Sathish , Rahul Venkataramani , K S Shriram , Prasad Sudhakar

Open-vocabulary segmentation models such as SAM3 perform well across broad categories via text prompting, yet degrade when target classes are visually underrepresented in pretraining or depart from canonical depictions-limitations text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Abderrahmene Boudiaf , Irfan Hussain , Sajid Javed

Although most existing multi-modal salient object detection (SOD) methods demonstrate effectiveness through training models from scratch, the limited multi-modal data hinders these methods from reaching optimality. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Kunpeng Wang , Danying Lin , Chenglong Li , Zhengzheng Tu , Bin Luo

The objective of this work is to explore how to effectively and efficiently adapt pre-trained visual foundation models to various downstream tasks of semantic segmentation. Previous methods usually fine-tuned the entire networks for each…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Lingbo Liu , Jianlong Chang , Bruce X. B. Yu , Liang Lin , Qi Tian , Chang-Wen Chen

Motivated by the success of the Segment Anything Model (SAM) in promptable segmentation, recent studies leverage SAM to develop training-free solutions for few-shot segmentation, which aims to predict object masks in the target image based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jiahao Nie , Yun Xing , Wenbin An , Qingsong Zhao , Jiawei Shao , Yap-Peng Tan , Alex C. Kot , Shijian Lu , Xuelong Li

Existing video segmenter and grounder approaches, exemplified by Sa2VA, directly fuse features within segmentation models. This often results in an undesirable entanglement of dynamic visual information and static semantics, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dang Jisheng , Wu Xudong , Wang Bimei , Lv Ning , Chen Jiayu , Jingwen Zhao , Yichu liu , Jizhao Liu , Juncheng Li , Teng Wang

Promptable segmentation has emerged as a powerful paradigm in computer vision, enabling users to guide models in parsing complex scenes with prompts such as clicks, boxes, or textual cues. Recent advances, exemplified by the Segment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yoonwoo Jeong , Cheng Sun , Yu-Chiang Frank Wang , Minsu Cho , Jaesung Choe

Medical image segmentation has immense clinical applicability but remains a challenge despite advancements in deep learning. The Segment Anything Model (SAM) exhibits potential in this field, yet the requirement for expertise intervention…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Yinsong Xu , Jiaqi Tang , Aidong Men , Qingchao Chen

The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challenging for existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Qin Liu , Jaemin Cho , Mohit Bansal , Marc Niethammer

The development of high-resolution remote sensing satellites has provided great convenience for research work related to remote sensing. Segmentation and extraction of specific targets are essential tasks when facing the vast and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Jie Zhang , Xubing Yang , Rui Jiang , Wei Shao , Li Zhang

Foundation models like the segment anything model require high-quality manual prompts for medical image segmentation, which is time-consuming and requires expertise. SAM and its variants often fail to segment structures in ultrasound (US)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Assefa Seyoum Wahd , Banafshe Felfeliyan , Yuyue Zhou , Shrimanti Ghosh , Adam McArthur , Jiechen Zhang , Jacob L. Jaremko , Abhilash Hareendranathan

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

The deployment of automated pavement defect detection is often hindered by poor cross-domain generalization. Supervised detectors achieve strong in-domain accuracy but require costly re-annotation for new environments, while standard…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xi Xiao , Zhuxuanzi Wang , Mingqiao Mo , Chen Liu , Chenrui Ma , Yanshu Li , Smita Krishnaswamy , Xiao Wang , Tianyang Wang