English
Related papers

Related papers: V$^{2}$-SAM: Marrying SAM2 with Multi-Prompt Exper…

200 papers

Recent progress in medical vision-language models (VLMs) has achieved strong performance on image-level text-centric tasks such as report generation and visual question answering (VQA). However, achieving fine-grained visual grounding and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yang Xing , Jiong Wu , Savas Ozdemir , Ying Zhang , Yang Yang , Wei Shao , Kuang Gong

Promptable segmentation has emerged as a powerful paradigm in computer vision, enabling users to guide models in parsing complex scenes with prompts such as clicks, boxes, or textual cues. Recent advances, exemplified by the Segment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yoonwoo Jeong , Cheng Sun , Yu-Chiang Frank Wang , Minsu Cho , Jaesung Choe

State-of-the-art Video Scene Graph Generation (VSGG) systems provide structured visual understanding but operate as closed, feed-forward pipelines with no ability to incorporate human guidance. In contrast, promptable segmentation models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Raphael Ruschel , Hardikkumar Prajapati , Awsafur Rahman , B. S. Manjunath

Open-world object detection aims to localize and recognize objects beyond a fixed closed-set label space. It is commonly divided into two categories, i.e., open-vocabulary detection, which assumes a predefined category list at test time,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chih-Chung Liu , Zhiwei Lin , Yongtao Wang

The notable gap between user-provided and model-preferred prompts poses a significant challenge for generating high-quality images with text-to-image models, compelling the need for prompt engineering. Current studies on prompt engineering…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shiyu Wu , Mingzhen Sun , Weining Wang , Yequan Wang , Jing Liu

Segment Anything Model 2 (SAM2) exhibits strong generalisation for promptable segmentation in video clips; however, its integration with the audio modality remains underexplored. Existing approaches either convert audio into visual prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yuyuan Liu , Yuanhong Chen , Chong Wang , Junlin Han , Junde Wu , Can Peng , Jingkun Chen , Yu Tian , Gustavo Carneiro

We present T-Rex2, a highly practical model for open-set object detection. Previous open-set object detection methods relying on text prompts effectively encapsulate the abstract concept of common objects, but struggle with rare or complex…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Qing Jiang , Feng Li , Zhaoyang Zeng , Tianhe Ren , Shilong Liu , Lei Zhang

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen

Existing perception models achieve great success by learning from large amounts of labeled data, but they still struggle with open-world scenarios. To alleviate this issue, researchers introduce open-set perception tasks to detect or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Zhiwei Lin , Yongtao Wang , Zhi Tang

Vision foundation models trained with self-supervised objectives achieve strong performance across diverse tasks and exhibit emergent object segmentation properties. However, their alignment with human object perception remains poorly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Hossein Adeli , Seoyoung Ahn , Andrew Luo , Mengmi Zhang , Nikolaus Kriegeskorte , Gregory Zelinsky

Segment Anything Model 2 (SAM 2), a prompt-driven foundation model extending SAM to both image and video domains, has shown superior zero-shot performance compared to its predecessor. Building on SAM's success in medical image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Bin Xie , Hao Tang , Yan Yan , Gady Agam

In the domain of large foundation models, the Segment Anything Model (SAM) has gained notable recognition for its exceptional performance in image segmentation. However, tackling the video camouflage object detection (VCOD) task presents a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Muhammad Nawfal Meeran , Gokul Adethya T , Bhanu Pratyush Mantha

Cross-view Referring Multi-Object Tracking (CRMOT) aims to track multiple objects specified by natural language across multiple camera views, with globally consistent identities. Despite recent progress, existing methods rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jiawei Ge , Xintian Zhang , Jiuxin Cao , Bo Liu , Fabian Deuser , Chang Liu , Gong Wenkang , Siyou Li , Juexi Shao , Wenqing Wu , Chen Feng , Ioannis Patras

Despite the significant advancements in general image segmentation achieved by large-scale pre-trained foundation models (such as Meta's Segment Any-thing Model (SAM) series and DINOv2), their performance in specialized fields remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yimin Xu , Fan Yang , Bin Xu

Open-Set Object Detection (OSOD) enables recognition of novel categories beyond fixed classes but faces challenges in aligning text representations with complex visual concepts and the scarcity of image-text pairs for rare categories. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Weifu Fu , Jinyang Li , Bin-Bin Gao , Jialin Li , Yuhuan Lin , Hanqiu Deng , Wenbing Tao , Yong Liu , Chengjie Wang

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang

Autonomous-driving perception systems require robust Multi-Object Tracking (MOT) to operate reliably in dynamic environments. MOT maintains consistent object identities across frames while preserving spatial accuracy. Recent foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Diogo Mendonça , Tiago Barros , Cristiano Premebida , Urbano J. Nunes

This technical report explores the MOSEv2 track of the PVUW 2026 Challenge, which targets complex semi-supervised video object segmentation. Built on SAM~3, we develop an automatic re-prompting framework to improve robustness under target…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mingqi Gao , Sijie Li , Jungong Han

Segment Anything Model 2 (SAM2) shows excellent performance in video object segmentation tasks; however, the heavy computational burden hinders its application in real-time video processing. Although there have been efforts to improve the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jing Zhang , Zhikai Li , Xuewen Liu , Qingyi Gu

Object detection is an important task in computer vision, which aims to detect the objects of interest. through the given category list or query images. In this work, we propose a new problem of language-visual-complementary open-set object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yupeng Zhang , Ruize Han , Wei Feng , Song Wang , Liang Wan