English
Related papers

Related papers: CoCo-SAM3: Harnessing Concept Conflict in Open-Voc…

200 papers

Is Segment Anything Model 3 (SAM3) capable in segmenting Any Pathology Images? Digital pathology segmentation spans tissue-level and nuclei-level scales, where traditional methods often suffer from high annotation costs and poor…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qiuyu Kong , Shakiba Sharifi , Yiming Wang , Marco Cristani , Zanxi Ruan

Referring Expression Segmentation (RES) aims to segment image regions described by natural-language expressions, serving as a bridge between vision and language understanding. Existing RES methods, however, rely heavily on large annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Weiming Zhang , Dingwen Xiao , Songyue Guo , Guangyu Xiang , Shiqi Wen , Minwei Zhao , Lei Chen , Lin Wang

Open-Vocabulary Semantic Segmentation (OVSS) assigns pixel-level labels from an open set of text-defined categories, demanding reliable generalization to unseen classes at inference. Although modern vision-language models (VLMs) support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Saikat Dutta , Biplab Banerjee , Hamid Rezatofighi

Vision-language segmentation models such as SAM3 enable flexible, prompt-driven visual grounding, but inherit large, general-purpose text encoders originally designed for open-ended language understanding. In practice, segmentation prompts…

Artificial Intelligence · Computer Science 2026-02-13 Chengxi Zeng , Yuxuan Jiang , Ge Gao , Shuai Wang , Duolikun Danier , Bin Zhu , Stevan Rudinac , David Bull , Fan Zhang

We present COD3S, a novel method for generating semantically diverse sentences using neural sequence-to-sequence (seq2seq) models. Conditioned on an input, seq2seq models typically produce semantically and syntactically homogeneous sets of…

Computation and Language · Computer Science 2020-10-07 Nathaniel Weir , João Sedoc , Benjamin Van Durme

Open-vocabulary semantic segmentation (OVSS) aims to segment and recognize objects universally. Trained on extensive high-quality segmentation data, the segment anything model (SAM) has demonstrated remarkable universal segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Lin Chen , Yingjian Zhu , Qi Yang , Xin Niu , Kun Ding , Shiming Xiang

Open-vocabulary semantic segmentation aims to segment an image into semantic regions according to text descriptions, which may not have been seen during training. Recent two-stage methods first generate class-agnostic mask proposals and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Feng Liang , Bichen Wu , Xiaoliang Dai , Kunpeng Li , Yinan Zhao , Hang Zhang , Peizhao Zhang , Peter Vajda , Diana Marculescu

Open-world object detection aims to localize and recognize objects beyond a fixed closed-set label space. It is commonly divided into two categories, i.e., open-vocabulary detection, which assumes a predefined category list at test time,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chih-Chung Liu , Zhiwei Lin , Yongtao Wang

The recent SAM 3 and SAM 3D have introduced significant advancements over the predecessor, SAM 2, particularly with the integration of language-based segmentation and enhanced 3D perception capabilities. SAM 3 supports zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Wenzhen Dong , Jieming Yu , Yiming Huang , Hongqiu Wang , Lei Zhu , Albert C. S. Chung , Hongliang Ren , Long Bai

3D semantic segmentation provides high-level scene understanding for applications in robotics, autonomous systems, \textit{etc}. Traditional methods adapt exclusively to either task-specific goals (open-vocabulary segmentation) or scene…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Doriand Petit , Steve Bourgeois , Vincent Gay-Bellile , Florian Chabot , Loïc Barthe

We propose to improve multi-concept prompt fidelity in text-to-image diffusion models. We begin with common failure cases - prompts like "a cat and a dog" that sometimes yields images where one concept is missing, faint, or colliding…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Debottam Dutta , Jianchong Chen , Rajalaxmi Rajagopalan , Yu-Lin Wei , Romit Roy Choudhury

Open-vocabulary semantic segmentation aims to assign semantic labels to each pixel without being constrained by a predefined set of categories. While Contrastive Language-Image Pre-training (CLIP) excels in zero-shot classification, it…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Dengke Zhang , Fagui Liu , Quan Tang

Hallucination detection is a critical step toward understanding the trustworthiness of modern language models (LMs). To achieve this goal, we re-examine existing detection approaches based on the self-consistency of LMs and uncover two…

Computation and Language · Computer Science 2024-02-20 Jiaxin Zhang , Zhuohang Li , Kamalika Das , Bradley A. Malin , Sricharan Kumar

Change Detection (CD) is a fundamental task in remote sensing. It monitors the evolution of land cover over time. Based on this, Open-Vocabulary Change Detection (OVCD) introduces a new requirement. It aims to reduce the reliance on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Xu Zhang , Danyang Li , Yingjie Xia , Xiaohang Dong , Hualong Yu , Jianye Wang , Qicheng Li

Single-point annotation in visual tasks, with the goal of minimizing labelling costs, is becoming increasingly prominent in research. Recently, visual foundation models, such as Segment Anything (SAM), have gained widespread usage due to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhaoyang Wei , Pengfei Chen , Xuehui Yu , Guorong Li , Jianbin Jiao , Zhenjun Han

Branching and merging are common practices in collaborative software development, increasing developer's productivity. Despite such benefits, developers need to merge software and resolve merge conflicts. While modern merge techniques can…

Software Engineering · Computer Science 2025-07-10 Léuson Da Silva , Paulo Borba , Toni Maciel , Wardah Mahmood , Thorsten Berger , João Moisakis , Aldiberg Gomes , Vinícius Leite

In this work, we present COSINE, a unified open-world segmentation model that consolidates open-vocabulary segmentation and in-context segmentation with multi-modal prompts (e.g., text and image). COSINE exploits foundation models to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yang Liu , Yufei Yin , Chenchen Jing , Muzhi Zhu , Hao Chen , Yuling Xi , Bo Feng , Hao Wang , Shiyu Li , Chunhua Shen

As large-scale foundation models trained on billions of image--mask pairs covering a vast diversity of scenes, objects, and contexts, SAM and its upgraded version, SAM~2, have significantly influenced multiple fields within computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiaoqi Zhao , Youwei Pang , Shijie Chang , Yuan Zhao , Lihe Zhang , Chenyang Yu , Hanqi Liu , Jiaming Zuo , Jinsong Ouyang , Weisi Lin , Georges El Fakhri , Huchuan Lu , Xiaofeng Liu

Fine-grained semantic segmentation requires both precise localization and discrimination between visually similar classes. In FungiTastic, this problem is further complicated by a long-tailed distribution and strong variation in image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Sebastian Cavada , Francesco Pelosin , Lapo Faggi

In-context segmentation (ICS) aims to segment arbitrary concepts, e.g., objects, parts, or personalized instances, given one annotated visual examples. Existing work relies on (i) fine-tuning vision foundation models (VFMs), which improves…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Claudia Cuttano , Gabriele Trivigno , Christoph Reich , Daniel Cremers , Carlo Masone , Stefan Roth