English
Related papers

Related papers: Adaptive Mix for Semi-Supervised Medical Image Seg…

200 papers

While deep neural networks show great performance on fitting to the training distribution, improving the networks' generalization performance to the test distribution and robustness to the sensitivity to input perturbations still remain as…

Machine Learning · Computer Science 2021-02-08 Jang-Hyun Kim , Wonho Choo , Hosan Jeong , Hyun Oh Song

Semi-supervised learning has emerged as a widely adopted technique in the field of medical image segmentation. The existing works either focuses on the construction of consistency constraints or the generation of pseudo labels to provide…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Ning Gao , Sanping Zhou , Le Wang , Nanning Zheng

Semi-supervised learning has the potential to improve the data-efficiency of training data-hungry deep neural networks, which is especially important for medical image analysis tasks where labeled data is scarce. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Boon Peng Yap , Beng Koon Ng

Consistency regularization and pseudo labeling-based semi-supervised methods perform co-training using the pseudo labels from multi-view inputs. However, such co-training models tend to converge early to a consensus, degenerating to the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Zhiqiang Shen , Peng Cao , Hua Yang , Xiaoli Liu , Jinzhu Yang , Osmar R. Zaiane

The scarcity of labeled data often impedes the application of deep learning to the segmentation of medical images. Semi-supervised learning seeks to overcome this limitation by exploiting unlabeled examples in the learning process. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Jizong Peng , Marco Pedersoli , Christian Desrosiers

A well-calibrated neural model produces confidence (probability outputs) closely approximated by the expected accuracy. While prior studies have shown that mixup training as a data augmentation technique can improve model calibration on…

Computation and Language · Computer Science 2022-03-16 Seo Yeon Park , Cornelia Caragea

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth

Due to the high cost of annotation or the rarity of some diseases, medical image segmentation is often limited by data scarcity and the resulting overfitting problem. Self-supervised learning and semi-supervised learning can mitigate the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Danyang Sun , Fadi Dornaika , Nagore Barrena

Data augmentation plays a crucial role in enhancing the robustness and performance of machine learning models across various domains. In this study, we introduce a novel mixed-sample data augmentation method called RandoMix. RandoMix is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

Multimodal Image Fusion (MMIF) aims to integrate complementary information from different imaging modalities to overcome the limitations of individual sensors. It enhances image quality and facilitates downstream applications such as remote…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Mengyu Wang , Zhenyu Liu , Kun Li , Yu Wang , Yuwei Wang , Yanyan Wei , Fei Wang

We improve the recently-proposed "MixMatch" semi-supervised learning algorithm by introducing two new techniques: distribution alignment and augmentation anchoring. Distribution alignment encourages the marginal distribution of predictions…

Machine Learning · Computer Science 2020-02-17 David Berthelot , Nicholas Carlini , Ekin D. Cubuk , Alex Kurakin , Kihyuk Sohn , Han Zhang , Colin Raffel

Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost…

Computation and Language · Computer Science 2022-11-03 Yaqing Wang , Sahaj Agarwal , Subhabrata Mukherjee , Xiaodong Liu , Jing Gao , Ahmed Hassan Awadallah , Jianfeng Gao

Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost…

Computation and Language · Computer Science 2022-11-07 Yaqing Wang , Sahaj Agarwal , Subhabrata Mukherjee , Xiaodong Liu , Jing Gao , Ahmed Hassan Awadallah , Jianfeng Gao

We consider X-ray coherent scatter imaging, where the goal is to reconstruct momentum transfer profiles (spectral distributions) at each spatial location from multiplexed measurements of scatter. Each material is characterized by a unique…

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Modern deep networks can be better generalized when trained with noisy samples and regularization techniques. Mixup and CutMix have been proven to be effective for data augmentation to help avoid overfitting. Previous Mixup-based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Shuyang Sun , Jie-Neng Chen , Ruifei He , Alan Yuille , Philip Torr , Song Bai

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Yangbin Chen , Yun Ma , Tom Ko , Jianping Wang , Qing Li

We propose MisMatch, a novel consistency-driven semi-supervised segmentation framework which produces predictions that are invariant to learnt feature perturbations. MisMatch consists of an encoder and a two-head decoders. One decoder…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Mou-Cheng Xu , Yu-Kun Zhou , Chen Jin , Stefano B Blumberg , Frederick J Wilson , Marius deGroot , Daniel C. Alexander , Neil P. Oxtoby , Joseph Jacob

We propose a new stochastic dual coordinate ascent technique that can be applied to a wide range of regularized learning problems. Our method is based on Alternating Direction Multiplier Method (ADMM) to deal with complex regularization…

Machine Learning · Statistics 2013-11-05 Taiji Suzuki

Convolutional neural networks (CNN) are capable of learning robust representation with different regularization methods and activations as convolutional layers are spatially correlated. Based on this property, a large variety of regional…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Devesh Walawalkar , Zhiqiang Shen , Zechun Liu , Marios Savvides