English
Related papers

Related papers: Image-Text Co-Decomposition for Text-Supervised Se…

200 papers

Text segmentation tasks have a very wide range of application values, such as image editing, style transfer, watermark removal, etc.However, existing public datasets are of poor quality of pixel-level labels that have been shown to be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Yibo Wang , Yunhu Ye , Yuanpeng Mao , Yanwei Yu , Yuanping Song

Vision-Language Pre-training has demonstrated its remarkable zero-shot recognition ability and potential to learn generalizable visual representations from language supervision. Taking a step ahead, language-supervised semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Yun Xing , Jian Kang , Aoran Xiao , Jiahao Nie , Ling Shao , Shijian Lu

Recent work shows that documents from encyclopedias serve as helpful auxiliary information for zero-shot learning. Existing methods align the entire semantics of a document with corresponding images to transfer knowledge. However, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Xiangyan Qu , Jing Yu , Keke Gai , Jiamin Zhuang , Yuanmin Tang , Gang Xiong , Gaopeng Gou , Qi Wu

Referring image segmentation aims to segment a referent via a natural linguistic expression.Due to the distinct data properties between text and image, it is challenging for a network to well align text and pixel-level features. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Zhaoqing Wang , Yu Lu , Qiang Li , Xunqiang Tao , Yandong Guo , Mingming Gong , Tongliang Liu

Semantic segmentation, which refers to pixel-wise classification of an image, is a fundamental topic in computer vision owing to its growing importance in robot vision and autonomous driving industries. It provides rich information about…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Khwaja Monib Sediqi , Hyo Jong Lee

In this paper, we aim to improve the performance of semantic image segmentation in a semi-supervised setting in which training is effectuated with a reduced set of annotated images and additional non-annotated images. We present a method…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Jizong Peng , Guillermo Estrada , Marco Pedersoli , Christian Desrosiers

This work presents a novel approach for semi-supervised semantic segmentation. The key element of this approach is our contrastive learning module that enforces the segmentation network to yield similar pixel-level feature representations…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Inigo Alonso , Alberto Sabater , David Ferstl , Luis Montesano , Ana C. Murillo

Combining high-level and low-level visual tasks is a common technique in the field of computer vision. This work integrates the technique of image super resolution to semantic segmentation for document image binarization. It demonstrates…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Chih-Chia Chen , Wei-Han Chen , Jen-Shiun Chiang , Chun-Tse Chien , Tingkai Chang

We introduce a new multi-modal task for computer systems, posed as a combined vision-language comprehension challenge: identifying the most suitable text describing a scene, given several similar options. Accomplishing the task entails…

Computation and Language · Computer Science 2016-12-26 Nan Ding , Sebastian Goodman , Fei Sha , Radu Soricut

Dense correspondence across semantically related images has been extensively studied, but still faces two challenges: 1) large variations in appearance, scale and pose exist even for objects from the same category, and 2) labeling…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Taihong Xiao , Sifei Liu , Shalini De Mello , Zhiding Yu , Jan Kautz , Ming-Hsuan Yang

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Traditional semantic image search methods aim to retrieve images that match the meaning of the text query. However, these methods typically search for objects on the whole image, without considering the localization of objects within the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Silvan Ferreira , Allan Martins , Ivanovitch Silva

Recently, contrastive learning-based image translation methods have been proposed, which contrasts different spatial locations to enhance the spatial correspondence. However, the methods often ignore the diverse semantic relation within the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Chanyong Jung , Gihyun Kwon , Jong Chul Ye

Context is essential for semantic segmentation. Due to the diverse shapes of objects and their complex layout in various scene images, the spatial scales and shapes of contexts for different objects have very large variation. It is thus…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Henghui Ding , Xudong Jiang , Bing Shuai , Ai Qun Liu , Gang Wang

Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask. To increase the ability of encoder-decoder neural networks to perform this task across large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Ho Hin Lee , Yucheng Tang , Qi Yang , Xin Yu , Shunxing Bao , Leon Y. Cai , Lucas W. Remedios , Bennett A. Landman , Yuankai Huo

Two modalities are often used to convey information in a complementary and beneficial manner, e.g., in online news, videos, educational resources, or scientific publications. The automatic understanding of semantic correlations between text…

Multimedia · Computer Science 2019-06-21 Christian Otto , Matthias Springstein , Avishek Anand , Ralph Ewerth

Most state-of-the-art semantic segmentation approaches only achieve high accuracy in good conditions. In practically-common but less-discussed adverse environmental conditions, their performance can decrease enormously. Existing studies…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Weihao Xia , Zhanglin Cheng , Yujiu Yang , Jing-Hao Xue

This paper describes a fast and accurate semantic image segmentation approach that encodes not only the discriminative features from deep neural networks, but also the high-order context compatibility among adjacent objects as well as low…

Computer Vision and Pattern Recognition · Computer Science 2016-05-16 Falong Shen , Gang Zeng

Recent advances in self-supervised contrastive learning yield good image-level representation, which favors classification tasks but usually neglects pixel-level detailed information, leading to unsatisfactory transfer performance to dense…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Feng Wang , Huiyu Wang , Chen Wei , Alan Yuille , Wei Shen

Traditionally, training neural networks to perform semantic segmentation required expensive human-made annotations. But more recently, advances in the field of unsupervised learning have made significant progress on this issue and towards…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Leon Sick , Dominik Engel , Pedro Hermosilla , Timo Ropinski