English
Related papers

Related papers: CutMix: Regularization Strategy to Train Strong Cl…

200 papers

Brain lesion segmentation provides a valuable tool for clinical diagnosis, and convolutional neural networks (CNNs) have achieved unprecedented success in the task. Data augmentation is a widely used strategy that improves the training of…

Image and Video Processing · Electrical Eng. & Systems 2021-09-29 Xinru Zhang , Chenghao Liu , Ni Ou , Xiangzhu Zeng , Xiaoliang Xiong , Yizhou Yu , Zhiwen Liu , Chuyang Ye

Data augmentation has become a standard component of vision pre-trained models to capture the invariance between augmented views. In practice, augmentation techniques that mask regions of a sample with zero/mean values or patches from other…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shentong Mo , Zhun Sun , Chao Li

This paper presents a supervised mixing augmentation method termed SuperMix, which exploits the salient regions within input images to construct mixed training samples. SuperMix is designed to obtain mixed images rich in visual features and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Ali Dabouei , Sobhan Soleymani , Fariborz Taherkhani , Nasser M. Nasrabadi

While modern convolutional neural networks achieve outstanding accuracy on many image classification tasks, they are, compared to humans, much more sensitive to image degradation. Here, we describe a variant of Batch Normalization,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Bojian Yin , Siebren Schaafsma , Henk Corporaal , H. Steven Scholte , Sander M. Bohte

Deep learning models have demonstrated remarkable performance across various computer vision tasks, yet their vulnerability to distribution shifts remains a critical challenge. Despite sophisticated neural network architectures, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Hafiz Mughees Ahmad , Dario Morle , Afshin Rahimi

Image-mixing augmentations (e.g., Mixup and CutMix), which typically involve mixing two images, have become the de-facto training techniques for image classification. Despite their huge success in image classification, the number of images…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Joonhyun Jeong , Sungmin Cha , Youngjoon Yoo , Sangdoo Yun , Taesup Moon , Jongwon Choi

While deep neural networks have achieved remarkable performance, data augmentation has emerged as a crucial strategy to mitigate overfitting and enhance network performance. These techniques hold particular significance in industrial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Hyungmin Kim , Donghun Kim , Pyunghwan Ahn , Sungho Suh , Hansang Cho , Junmo Kim

The clinical explainability of convolutional neural networks (CNN) heavily relies on the joint interpretation of a model's predicted diagnostic label and associated confidence. A highly certain or uncertain model can significantly impact…

Image and Video Processing · Electrical Eng. & Systems 2023-08-24 Adrit Rao , Joon-Young Lee , Oliver Aalami

Deep neural networks often consist of a great number of trainable parameters for extracting powerful features from given datasets. On one hand, massive trainable parameters significantly enhance the performance of these deep networks. On…

Machine Learning · Computer Science 2020-02-26 Yehui Tang , Yunhe Wang , Yixing Xu , Boxin Shi , Chao Xu , Chunjing Xu , Chang Xu

Certifiably robust defenses against adversarial patches for image classifiers ensure correct prediction against any changes to a constrained neighborhood of pixels. PatchCleanser arXiv:2108.09135 [cs.CV], the state-of-the-art certified…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Aniruddha Saha , Shuhua Yu , Arash Norouzzadeh , Wan-Yi Lin , Chaithanya Kumar Mummadi

Data augmentation is a key technique for improving the robustness of image classification models. However, many recent approaches rely on diffusion-based synthesis or complex feature mixing strategies, which introduce substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuto Matsuo , Yoshihiro Fukuhara , Yuki M. Asano , Rintaro Yanagi , Hirokatsu Kataoka , Akio Nakamura

Large neural networks are often overparameterised and prone to overfitting, Dropout is a widely used regularization technique to combat overfitting and improve model generalization. However, unstructured Dropout is not always effective for…

Machine Learning · Computer Science 2022-10-07 Yiren Zhao , Oluwatomisin Dada , Xitong Gao , Robert D Mullins

Deep convolutional neural networks (CNNs) have achieved remarkable results in image processing tasks. However, their high expression ability risks overfitting. Consequently, data augmentation techniques have been proposed to prevent…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Ryo Takahashi , Takashi Matsubara , Kuniaki Uehara

This paper proposes a novel regularization approach to bias Convolutional Neural Networks (CNNs) toward utilizing edge and line features in their hidden layers. Rather than learning arbitrary kernels, we constrain the convolution layers to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Christoph Linse , Beatrice Brückner , Thomas Martinetz

Techniques combining multiple images as input/output have proven to be effective data augmentations for training convolutional neural networks. In this paper, we present StackMix: Each input is presented as a concatenation of two images,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 John Chen , Samarth Sinha , Anastasios Kyrillidis

Data mixing augmentation has proved effective in training deep models. Recent methods mix labels mainly based on the mixture proportion of image pixels. As the main discriminative information of a fine-grained image usually resides in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Shaoli Huang , Xinchao Wang , Dacheng Tao

Detection Transformer (DETR) is a Transformer architecture based object detection model. In this paper, we demonstrate that it can also be used as a data augmenter. We term our approach as DETR assisted CutMix, or DeMix for short. DeMix…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Luping Wang , Bin Liu

Dropout regularization has been widely used in deep learning but performs less effective for convolutional neural networks since the spatially correlated features allow dropped information to still flow through the networks. Some structured…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Hui Zhu , Xiaofang Zhao

Deep learning has made significant advances in computer vision, particularly in image classification tasks. Despite their high accuracy on training data, deep learning models often face challenges related to complexity and overfitting. One…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Minsoo Kang , Minkoo Kang , Suhyun Kim

Mitigating bias in machine learning models is a critical endeavor for ensuring fairness and equity. In this paper, we propose a novel approach to address bias by leveraging pixel image attributions to identify and regularize regions of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Sander De Coninck , Sam Leroux , Pieter Simoens