English
Related papers

Related papers: Semi-Supervised Panoptic Narrative Grounding

200 papers

Panoptic Narrative Grounding (PNG) is an emerging cross-modal grounding task, which locates the target regions of an image corresponding to the text description. Existing approaches for PNG are mainly based on a two-stage paradigm, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Haowei Wang , Jiayi Ji , Yiyi Zhou , Yongjian Wu , Xiaoshuai Sun

Panoptic Narrative Grounding (PNG) is an emerging task whose goal is to segment visual objects of things and stuff categories described by dense narrative captions of a still image. The previous two-stage approach first extracts…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Zihan Ding , Zi-han Ding , Tianrui Hui , Junshi Huang , Xiaoming Wei , Xiaolin Wei , Si Liu

Panoptic narrative grounding (PNG) aims to segment things and stuff objects in an image described by noun phrases of a narrative caption. As a multimodal task, an essential aspect of PNG is the visual-linguistic interaction between image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Tianrui Hui , Zihan Ding , Junshi Huang , Xiaoming Wei , Xiaolin Wei , Jiao Dai , Jizhong Han , Si Liu

Recently, diffusion models have increasingly demonstrated their capabilities in vision understanding. By leveraging prompt-based learning to construct sentences, these models have shown proficiency in classification and visual grounding…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Danni Yang , Ruohan Dong , Jiayi Ji , Yiwei Ma , Haowei Wang , Xiaoshuai Sun , Rongrong Ji

Lesion segmentation on nasal endoscopic images is challenging due to its complex lesion features. Fully-supervised deep learning methods achieve promising performance with pixel-level annotations but impose a significant annotation burden…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Pengyu Jie , Wanquan Liu , Chenqiang Gao , Yihui Wen , Rui He , Weiping Wen , Pengcheng Li , Jintao Zhang , Deyu Meng

Panoptic narrative grounding (PNG), whose core target is fine-grained image-text alignment, requires a panoptic segmentation of referred objects given a narrative caption. Previous discriminative methods achieve only weak or coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Hongyu Li , Tianrui Hui , Zihan Ding , Jing Zhang , Bin Ma , Xiaoming Wei , Jizhong Han , Si Liu

Panoramic Narrative Grounding (PNG) is an emerging visual grounding task that aims to segment visual objects in images based on dense narrative captions. The current state-of-the-art methods first refine the representation of phrase by…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Yiming Lin , Xiao-Bo Jin , Qiufeng Wang , Kaizhu Huang

Semi-supervised semantic segmentation (SSS) is an important task that utilizes both labeled and unlabeled data to reduce expenses on labeling training examples. However, the effectiveness of SSS algorithms is limited by the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhibo Tain , Xiaolin Zhang , Peng Zhang , Kun Zhan

Semantic segmentation with limited annotations, such as weakly supervised semantic segmentation (WSSS) and semi-supervised semantic segmentation (SSSS), is a challenging task that has attracted much attention recently. Most leading WSSS…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Junwen Pan , Pengfei Zhu , Kaihua Zhang , Bing Cao , Yu Wang , Dingwen Zhang , Junwei Han , Qinghua Hu

Semi- and weakly-supervised learning have recently attracted considerable attention in the object detection literature since they can alleviate the cost of annotation needed to successfully train deep learning models. State-of-art…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Akhil Meethal , Marco Pedersoli , Zhongwen Zhu , Francisco Perdigon Romero , Eric Granger

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

We present a novel confidence refinement scheme that enhances pseudo labels in semi-supervised semantic segmentation. Unlike existing methods, which filter pixels with low-confidence predictions in isolation, our approach leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Moshe Kimhi , Shai Kimhi , Evgenii Zheltonozhskii , Or Litany , Chaim Baskin

We propose Point-PNG, a novel self-supervised learning framework that generates conditional pseudo-negatives in the latent space to learn point cloud representations that are both discriminative and transformation-sensitive. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Sutharsan Mahendren , Saimunur Rahman , Piotr Koniusz , Tharindu Fernando , Sridha Sridharan , Clinton Fookes , Peyman Moghadam

Semi-supervised (SS) semantic segmentation exploits both labeled and unlabeled images to overcome tedious and costly pixel-level annotation problems. Pseudolabel supervision is one of the core approaches of training networks with both…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Rini Smita Thakur , Vinod K. Kurmi

We present a novel data-efficient semi-supervised framework to improve the generalization of image captioning models. Constructing a large-scale labeled image captioning dataset is an expensive task in terms of labor, time, and cost. In…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Dong-Jin Kim , Tae-Hyun Oh , Jinsoo Choi , In So Kweon

Panoptic Narrative Detection (PND) and Segmentation (PNS) are two challenging tasks that involve identifying and locating multiple targets in an image according to a long narrative description. In this paper, we propose a unified and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Haowei Wang , Jiayi Ji , Tianyu Guo , Yilong Yang , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

Semi-weakly supervised semantic segmentation (SWSSS) aims to train a model to identify objects in images based on a small number of images with pixel-level labels, and many more images with only image-level labels. Most existing SWSSS…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Wonho Bae , Junhyug Noh , Milad Jalali Asadabadi , Danica J. Sutherland

Natural language understanding (NLU) converts sentences into structured semantic forms. The paucity of annotated training samples is still a fundamental challenge of NLU. To solve this data sparsity problem, previous work based on…

Computation and Language · Computer Science 2021-04-02 Su Zhu , Ruisheng Cao , Kai Yu

The ability to understand visual information from limited labeled data is an important aspect of machine learning. While image-level classification has been extensively studied in a semi-supervised setting, dense pixel-level classification…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Sudhanshu Mittal , Maxim Tatarchenko , Thomas Brox

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jianfeng Wang , Xiaolin Hu , Thomas Lukasiewicz
‹ Prev 1 2 3 10 Next ›