English
Related papers

Related papers: Visual and Text Prompt Segmentation: A Novel Multi…

200 papers

Recently, the powerful generalization ability exhibited by foundation models has brought forth new solutions for zero-shot anomaly segmentation tasks. However, guiding these foundation models correctly to address downstream tasks remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yanning Hou , Ke Xu , Junfa Li , Yanran Ruan , Jianfeng Qiu

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Segment Anything Model (SAM) represents a large-scale segmentation model that enables powerful zero-shot capabilities with flexible prompts. While SAM can segment any object in zero-shot, it requires user-provided prompts for each target…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Kosuke Sakurai , Ryotaro Shimizu , Masayuki Goto

Foundation models have exhibited unprecedented capabilities in tackling many domains and tasks. Models such as CLIP are currently widely used to bridge cross-modal representations, and text-to-image diffusion models are arguably the leading…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Barbara Toniella Corradini , Mustafa Shukor , Paul Couairon , Guillaume Couairon , Franco Scarselli , Matthieu Cord

Recent advancements in multimodal vision models have highlighted limitations in late-stage feature fusion and suboptimal query selection for hybrid prompts open-world segmentation, alongside constraints from caption-derived vocabularies. To…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yuchen Guan , Chong Sun , Canmiao Fu , Zhipeng Huang , Chun Yuan , Chen Li

CLIP (Contrastive Language-Image Pretraining) is well-developed for open-vocabulary zero-shot image-level recognition, while its applications in pixel-level tasks are less investigated, where most efforts directly adopt CLIP features…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jie Guo , Qimeng Wang , Yan Gao , Xiaolong Jiang , Xu Tang , Yao Hu , Baochang Zhang

Open-vocabulary segmentation poses significant challenges, as it requires segmenting and recognizing objects across an open set of categories in unconstrained environments. Building on the success of powerful vision-language (ViL)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Xi Chen , Haosen Yang , Sheng Jin , Xiatian Zhu , Hongxun Yao

Open-vocabulary semantic segmentation in the remote sensing (RS) field requires both language-aligned recognition and fine-grained spatial delineation. Although CLIP offers robust semantic generalization, its global-aligned visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jie Feng , Fengze Li , Junpeng Zhang , Siyu Chen , Yuping Liang , Junying Chen , Ronghua Shang

General-purpose foundation models have led to recent breakthroughs in artificial intelligence. In remote sensing, self-supervised learning (SSL) and Masked Image Modeling (MIM) have been adopted to build foundation models. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Fan Liu , Delong Chen , Zhangqingyun Guan , Xiaocong Zhou , Jiale Zhu , Qiaolin Ye , Liyong Fu , Jun Zhou

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

Recently, foundational models such as CLIP and SAM have shown promising performance for the task of Zero-Shot Anomaly Segmentation (ZSAS). However, either CLIP-based or SAM-based ZSAS methods still suffer from non-negligible key drawbacks:…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Shengze Li , Jianjian Cao , Peng Ye , Yuhan Ding , Chongjun Tu , Tao Chen

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

Bird image segmentation remains a challenging task in computer vision due to extreme pose diversity, complex plumage patterns, and variable lighting conditions. This paper presents a dual-pipeline framework for binary bird image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Abhinav Munagala

Open-vocabulary segmentation aims to identify and segment specific regions and objects based on text-based descriptions. A common solution is to leverage powerful vision-language models (VLMs), such as CLIP, to bridge the gap between vision…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Bingyu Li , Da Zhang , Zhiyuan Zhao , Junyu Gao , Xuelong Li

Adapting vision-language models to remote sensing imagery presents a fundamental challenge: both the visual and linguistic distributions of satellite data lie far outside natural image pretraining corpora. Despite this, prompting remains…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Harshith Kethavath , Weiming Hu

Segmenting objects with complex shapes, such as wires, bicycles, or structural grids, remains a significant challenge for current segmentation models, including the Segment Anything Model (SAM) and its high-quality variant SAM-HQ. These…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Luka Vetoshkin , Dmitry Yudin

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen

In this work, we address the task of few-shot part segmentation, which aims to segment the different parts of an unseen object using very few labeled examples. It is found that leveraging the textual space of a powerful pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Mengya Han , Heliang Zheng , Chaoyue Wang , Yong Luo , Han Hu , Jing Zhang , Yonggang Wen

Vision Foundation Model (VFM) such as the Segment Anything Model (SAM) and Contrastive Language-Image Pre-training Model (CLIP) has shown promising performance for segmentation and detection tasks. However, although SAM excels in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Kunliang Liu , Jianming Wang , Rize Jin , Wonjun Hwang , Tae-Sun Chung

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert