English
Related papers

Related papers: Uncovering Prototypical Knowledge for Weakly Open-…

200 papers

Weakly-supervised semantic segmentation is a challenging task as no pixel-wise label information is provided for training. Recent methods have exploited classification networks to localize objects by selecting regions with strong response.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Xiang Wang , Sifei Liu , Huimin Ma , Ming-Hsuan Yang

We propose to model complex visual scenes using a non-parametric Bayesian model learned from weakly labelled images abundant on media sharing sites such as Flickr. Given weak image-level annotations of objects and attributes without…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Zhiyuan Shi , Yongxin Yang , Timothy M. Hospedales , Tao Xiang

This paper proposes a novel transformer-based framework that aims to enhance weakly supervised semantic segmentation (WSSS) by generating accurate class-specific object localization maps as pseudo labels. Building upon the observation that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lian Xu , Mohammed Bennamoun , Farid Boussaid , Hamid Laga , Wanli Ouyang , Dan Xu

Text segmentation (TS) aims at dividing long text into coherent segments which reflect the subtopic structure of the text. It is beneficial to many natural language processing tasks, such as Information Retrieval (IR) and document…

Computation and Language · Computer Science 2015-11-30 Mostafa Bayomi , Killian Levacher , M. Rami Ghorab , Séamus Lawless

Compared to conventional semantic segmentation with pixel-level supervision, Weakly Supervised Semantic Segmentation (WSSS) with image-level labels poses the challenge that it always focuses on the most discriminative regions, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jingxuan He , Lechao Cheng , Chaowei Fang , Zunlei Feng , Tingting Mu , Mingli Song

Weakly-supervised semantic segmentation (WSSS) performs pixel-wise classification given only image-level labels for training. Despite the difficulty of this task, the research community has achieved promising results over the last five…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Cheolhyun Mun , Sanghuk Lee , Youngjung Uh , Junsuk Choe , Hyeran Byun

Open-vocabulary segmentation is the task of segmenting anything that can be named in an image. Recently, large-scale vision-language modelling has led to significant advances in open-vocabulary segmentation, but at the cost of gargantuan…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Laurynas Karazija , Iro Laina , Andrea Vedaldi , Christian Rupprecht

Image segmentation beyond predefined categories is a key challenge in remote sensing, where novel and unseen classes often emerge during inference. Open-vocabulary image Segmentation addresses these generalization issues in traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Saikat Dutta , Akhil Vasim , Siddhant Gole , Hamid Rezatofighi , Biplab Banerjee

Zero-shot classification capabilities naturally arise in models trained within a vision-language contrastive framework. Despite their classification prowess, these models struggle in dense tasks like zero-shot open-vocabulary segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Thomas Stegmüller , Tim Lebailly , Nikola Dukic , Behzad Bozorgtabar , Tinne Tuytelaars , Jean-Philippe Thiran

In the field of visual scene understanding, deep neural networks have made impressive advancements in various core tasks like segmentation, tracking, and detection. However, most approaches operate on the close-set assumption, meaning that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Jianzong Wu , Xiangtai Li , Shilin Xu , Haobo Yuan , Henghui Ding , Yibo Yang , Xia Li , Jiangning Zhang , Yunhai Tong , Xudong Jiang , Bernard Ghanem , Dacheng Tao

Training-free open-vocabulary semantic segmentation (OVS) aims to segment images given a set of arbitrary textual categories without costly model fine-tuning. Existing solutions often explore attention mechanisms of pre-trained models, such…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Xiwei Xuan , Ziquan Deng , Kwan-Liu Ma

Domain Generalization in Semantic Segmentation (DG-SS) aims to enable segmentation models to perform robustly in unseen environments. However, conventional DG-SS methods are restricted to a fixed set of known categories, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Dong Zhao , Qi Zang , Nan Pu , Wenjing Li , Nicu Sebe , Zhun Zhong

Weakly Supervised Semantic Segmentation (WSSS) with image-level labels aims to achieve pixel-level predictions using Class Activation Maps (CAMs). Recently, Contrastive Language-Image Pre-training (CLIP) has been introduced in WSSS.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Zhiwei Yang , Yucong Meng , Kexue Fu , Feilong Tang , Shuo Wang , Zhijian Song

This work aims to leverage pre-trained foundation models, such as contrastive language-image pre-training (CLIP) and segment anything model (SAM), to address weakly supervised semantic segmentation (WSSS) using image-level labels. To this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xiaobo Yang , Xiaojin Gong

Weakly supervised semantic segmentation (WSSS), which aims to mine the object regions by merely using class-level labels, is a challenging task in computer vision. The current state-of-the-art CNN-based methods usually adopt…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Dongjian Huo , Yukun Su , Qingyao Wu

We tackle open-world semantic segmentation, which aims at learning to segment arbitrary visual concepts in images, by using only image-text pairs without dense annotations. Existing open-world segmentation methods have shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Junbum Cha , Jonghwan Mun , Byungseok Roh

Training convolutional networks for semantic segmentation requires per-pixel ground truth labels, which are very time consuming and hence costly to obtain. Therefore, in this work, we research and develop a hierarchical deep network…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Panagiotis Meletis , Gijs Dubbelman

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. In this paper, a hierarchical attention network is proposed to solve a weakly labelled speaker identification problem. The use of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

In this paper, we study weakly-supervised laparoscopic image segmentation with sparse annotations. We introduce a novel Bayesian deep learning approach designed to enhance both the accuracy and interpretability of the model's segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zhou Zheng , Yuichiro Hayashi , Masahiro Oda , Takayuki Kitasaka , Kensaku Mori

Audio-visual segmentation aims to separate sounding objects from videos by predicting pixel-level masks based on audio signals. Existing methods primarily concentrate on closed-set scenarios and direct audio-visual alignment and fusion,…

Machine Learning · Computer Science 2026-03-31 Shengkai Chen , Yifang Yin , Jinming Cao , Shili Xiang , Zhenguang Liu , Roger Zimmermann