English
Related papers

Related papers: Masked Gamma-SSL: Learning Uncertainty Estimation …

200 papers

Most existing text recognition methods are trained on large-scale synthetic datasets due to the scarcity of labeled real-world datasets. Synthetic images, however, cannot faithfully reproduce real-world scenarios, such as uneven…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Zhengmi Tang , Yuto Mitsui , Tomo Miyazaki , Shinichiro Omachi

Quality of deep convolutional neural network predictions strongly depends on the size of the training dataset and the quality of the annotations. Creating annotations, especially for 3D medical image segmentation, is time-consuming and…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Matin Hosseinzadeh , Anindo Saha , Joeran Bosma , Henkjan Huisman

Trained using only image class label, deep weakly supervised methods allow image classification and ROI segmentation for interpretability. Despite their success on natural images, they face several challenges over histology data where ROI…

Image and Video Processing · Electrical Eng. & Systems 2022-05-13 Soufiane Belharbi , Jérôme Rony , Jose Dolz , Ismail Ben Ayed , Luke McCaffrey , Eric Granger

Denoising diffusion probabilistic models have recently received much research attention since they outperform alternative approaches, such as GANs, and currently provide state-of-the-art generative performance. The superior performance of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Dmitry Baranchuk , Ivan Rubachev , Andrey Voynov , Valentin Khrulkov , Artem Babenko

For navigation of robots, image segmentation is an important component to determining a terrain's traversability. For safe and efficient navigation, it is key to assess the uncertainty of the predicted segments. Current uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Judith Dijk , Gertjan Burghouts , Kapil D. Katyal , Bryanna Y. Yeh , Craig T. Knuth , Ella Fokkinga , Tejaswi Kasarla , Pascal Mettes

In the realm of self-supervised learning (SSL), masked image modeling (MIM) has gained popularity alongside contrastive learning methods. MIM involves reconstructing masked regions of input images using their unmasked portions. A notable…

Machine Learning · Computer Science 2024-07-15 Tianqi Du , Yifei Wang , Yisen Wang

A significant challenge in sound event detection (SED) is the effective utilization of unlabeled data, given the limited availability of labeled data due to high annotation costs. Semi-supervised algorithms rely on labeled data to learn…

Sound · Computer Science 2024-09-27 Pengfei Cai , Yan Song , Nan Jiang , Qing Gu , Ian McLoughlin

The success of language Transformers is primarily attributed to the pretext task of masked language modeling (MLM), where texts are first tokenized into semantically meaningful pieces. In this work, we study masked image modeling (MIM) and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Jinghao Zhou , Chen Wei , Huiyu Wang , Wei Shen , Cihang Xie , Alan Yuille , Tao Kong

The Vision Transformer (ViT) has demonstrated remarkable performance in Self-Supervised Learning (SSL) for 3D medical image analysis. Masked AutoEncoder (MAE) for feature pre-training can further unleash the potential of ViT on various…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Jiaxin Zhuang , Linshan Wu , Qiong Wang , Peng Fei , Varut Vardhanabhuti , Lin Luo , Hao Chen

The ability to estimate epistemic uncertainty is often crucial when deploying machine learning in the real world, but modern methods often produce overconfident, uncalibrated uncertainty predictions. A common approach to quantify epistemic…

Weakly supervised semantic segmentation is a challenging task as it only takes image-level information as supervision for training but produces pixel-level predictions for testing. To address such a challenging task, most recent…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Bingfeng Zhang , Jimin Xiao , Yunchao Wei , Mingjie Sun , Kaizhu Huang

Masked image modeling (MIM) has become a leading self-supervised learning strategy. MIMs such as Masked Autoencoder (MAE) learn strong representations by randomly masking input tokens for the encoder to process, with the decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taekyung Kim , Sanghyuk Chun , Byeongho Heo , Dongyoon Han

Automatic histopathology image segmentation is crucial to disease analysis. Limited available labeled data hinders the generalizability of trained models under the fully supervised setting. Semi-supervised learning (SSL) based on generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Hongxiao Wang , Hao Zheng , Jianxu Chen , Lin Yang , Yizhe Zhang , Danny Z. Chen

Medical Image Foundation Models have proven to be powerful tools for mask prediction across various datasets. However, accurately assessing the uncertainty of their predictions remains a significant challenge. To address this, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-01-20 Xin Wang , Xiaoyu Liu , Peng Huang , Pu Huang , Shu Hu , Hongtu Zhu

The performance of supervised deep learning methods for medical image segmentation is often limited by the scarcity of labeled data. As a promising research direction, semi-supervised learning addresses this dilemma by leveraging unlabeled…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Zihang Liu , Chunhui Zhao

We present a new method for uncertainty estimation and out-of-distribution detection in neural networks with softmax output. We extend softmax layer with an additional constant input. The corresponding additional output is able to represent…

Machine Learning · Computer Science 2019-04-09 Marcin Możejko , Mateusz Susik , Rafał Karczewski

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, different downstream tasks…

Machine Learning · Computer Science 2023-03-08 Chen Huang , Hanlin Goh , Jiatao Gu , Josh Susskind

The past year has witnessed a rapid development of masked image modeling (MIM). MIM is mostly built upon the vision transformers, which suggests that self-supervised visual representations can be done by masking input image parts while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yunjie Tian , Lingxi Xie , Jiemin Fang , Mengnan Shi , Junran Peng , Xiaopeng Zhang , Jianbin Jiao , Qi Tian , Qixiang Ye

Self-supervised learning excels in learning representations from large amounts of unlabeled data, demonstrating success across multiple data modalities. Yet, extending self-supervised learning to new modalities is non-trivial because the…

Machine Learning · Computer Science 2024-02-23 Johnathan Xie , Yoonho Lee , Annie S. Chen , Chelsea Finn

Moving objects can greatly jeopardize the performance of a visual simultaneous localization and mapping (vSLAM) system which relies on the static-world assumption. Motion removal have seen successful on solving this problem. Two main…

Robotics · Computer Science 2019-08-01 Ting Sun , Yuxiang Sun , Ming Liu , Dit-Yan Yeung