English
Related papers

Related papers: Selective Masking based Self-Supervised Learning f…

200 papers

Masked autoencoding has achieved great success for self-supervised learning in the image and language domains. However, mask based pretraining has yet to show benefits for point cloud understanding, likely due to standard backbones like…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Haotian Liu , Mu Cai , Yong Jae Lee

Image segmentation methods are usually trained with pixel-level annotations, which require significant human effort to collect. The most common solution to address this constraint is to implement weakly-supervised pipelines trained with…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Miriam Bellver , Amaia Salvador , Jordi Torres , Xavier Giro-i-Nieto

Small sample instance segmentation is a very challenging task, and many existing methods follow the training strategy of meta-learning which pre-train models on support set and fine-tune on query set. The pre-training phase, which is highly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ruting Chi , Zhiyi Huang , Yuexing Han

Thanks to breakthroughs in AI and Deep learning methodology, Computer vision techniques are rapidly improving. Most computer vision applications require sophisticated image segmentation to comprehend what is image and to make an analysis of…

Machine Learning · Computer Science 2023-02-07 Lichun Gao , Chinmaya Khamesra , Uday Kumbhar , Ashay Aglawe

In this paper, we propose to employ semantic segmentation to improve person-related attribute prediction. The core idea lies in the fact that the probability of an attribute to appear in an image is far from being uniform in the spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Mahdi M. Kalayeh , Mubarak Shah

Finetuning a pretrained backbone in the encoder part of an image transformer network has been the traditional approach for the semantic segmentation task. However, such an approach leaves out the semantic context that an image provides…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Jitesh Jain , Anukriti Singh , Nikita Orlov , Zilong Huang , Jiachen Li , Steven Walton , Humphrey Shi

Building a large image dataset with high-quality object masks for semantic segmentation is costly and time consuming. In this paper, we introduce a principled semi-supervised framework that only uses a small set of fully supervised images…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Mostafa S. Ibrahim , Arash Vahdat , Mani Ranjbar , William G. Macready

Predicting masked from visible parts of an image is a powerful self-supervised approach for visual representation learning. However, the common practice of masking random patches of pixels exhibits certain failure modes, which can prevent…

Machine Learning · Computer Science 2025-02-12 Alice Bizeul , Thomas Sutter , Alain Ryser , Bernhard Schölkopf , Julius von Kügelgen , Julia E. Vogt

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

This paper shows that Masking the Deep hierarchical features is an efficient self-supervised method, denoted as MaskDeep. MaskDeep treats each patch in the representation space as an independent instance. We mask part of patches in the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Fenggang Liu , Yangguang Li , Feng Liang , Jilan Xu , Bin Huang , Jing Shao

Supervised fine-tuning methods (SFT) perform great efficiency on artificial intelligence interpretation in SAR images, leveraging the powerful representation knowledge from pre-training models. Due to the lack of domain-specific pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xinyang Pu , Feng Xu

Learning semantic segmentation models under image-level supervision is far more challenging than under fully supervised setting. Without knowing the exact pixel-label correspondence, most weakly-supervised methods rely on external models to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Zi-Yi Ke , Chiou-Ting Hsu

We develop and approach to unsupervised semantic medical image segmentation that extends previous work with generative adversarial networks. We use existing edge detection methods to construct simple edge diagrams, train a generative model…

Image and Video Processing · Electrical Eng. & Systems 2019-11-14 Umaseh Sivanesan , Luis H. Braga , Ranil R. Sonnadara , Kiret Dhindsa

Transformer-based models attain excellent results and generalize well when trained on sufficient amounts of data. However, constrained by the limited data available in the audio domain, most transformer-based models for audio tasks are…

Sound · Computer Science 2022-04-28 Dading Chong , Helin Wang , Peilin Zhou , Qingcheng Zeng

In recent years, instance segmentation has garnered significant attention across various applications. However, training a fully-supervised instance segmentation model requires costly both instance-level and pixel-level annotations. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuchen Shen , Dong Zhang , Zhao Zhang , Liyong Fu , Qiaolin Ye

We frame the task of predicting a semantic labeling as a sparse reconstruction procedure that applies a target-specific learned transfer function to a generic deep sparse code representation of an image. This strategy partitions training…

Computer Vision and Pattern Recognition · Computer Science 2014-10-17 Michael Maire , Stella X. Yu , Pietro Perona

Prompt tuning and adapter tuning have shown great potential in transferring pre-trained vision-language models (VLMs) to various downstream tasks. In this work, we design a new type of tuning method, termed as regularized mask tuning, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Kecheng Zheng , Wei Wu , Ruili Feng , Kai Zhu , Jiawei Liu , Deli Zhao , Zheng-Jun Zha , Wei Chen , Yujun Shen

In this paper, we present a new data-efficient voxel-based self-supervised learning method for event cameras. Our pre-training overcomes the limitations of previous methods, which either sacrifice temporal information by converting event…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Zhenpeng Huang , Chao Li , Hao Chen , Yongjian Deng , Yifeng Geng , Limin Wang

Recently, several weakly supervised learning methods have been devoted to utilize bounding box supervision for training deep semantic segmentation models. Most existing methods usually leverage the generic proposal generators (e.g., dense…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Chaohao Xie , Dongwei Ren , Lei Wang , Wangmeng Zuo

Training a Fully Convolutional Network (FCN) for semantic segmentation requires a large number of masks with pixel level labelling, which involves a large amount of human labour and time for annotation. In contrast, web images and their…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Tong Shen , Guosheng Lin , Lingqiao Liu , Chunhua Shen , Ian Reid