English
Related papers

Related papers: IPMix: Label-Preserving Data Augmentation Method f…

200 papers

Data augmentation is becoming essential for improving regression performance in critical applications including manufacturing, climate prediction, and finance. Existing techniques for data augmentation largely focus on classification tasks…

Machine Learning · Computer Science 2022-08-18 Seong-Hyeon Hwang , Steven Euijong Whang

Deep neural networks are powerful, but they also have shortcomings such as their sensitivity to adversarial examples, noise, blur, occlusion, etc. Moreover, ensuring the reliability and robustness of deep neural network models is crucial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

Mix-based augmentation has been proven fundamental to the generalization of deep vision models. However, current augmentations only mix samples at the current data batch during training, which ignores the possible knowledge accumulated in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Lingfeng Yang , Xiang Li , Borui Zhao , Renjie Song , Jian Yang

Image quality assessment (IQA) has long been a fundamental challenge in image understanding. In recent years, deep learning-based IQA methods have shown promising performance. However, the lack of large amounts of labeled data in the IQA…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Jinsong Shi , Pan Gao , Xiaojiang Peng , Jie Qin

Underlying data structures, such as symmetries or invariances to transformations, are often exploited to improve the solution of learning tasks. However, embedding these properties in models or learning algorithms can be challenging and…

Machine Learning · Computer Science 2023-09-19 Ignacio Hounie , Luiz F. O. Chamon , Alejandro Ribeiro

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

Machine Learning · Statistics 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh

The recently proposed data augmentation TransMix employs attention labels to help visual transformers (ViT) achieve better robustness and performance. However, TransMix is deficient in two aspects: 1) The image cropping method of TransMix…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Qihao Zhao , Yangyu Huang , Wei Hu , Fan Zhang , Jun Liu

Deep neural networks (DNNs) are vulnerable to adversarial noises. Adversarial training is a general and effective strategy to improve DNN robustness (i.e., accuracy on noisy data) against adversarial noises. However, DNN models trained by…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Linhai Ma , Liang Liang

Mixup is a commonly adopted data augmentation technique for image classification. Recent advances in mixup methods primarily focus on mixing based on saliency. However, many saliency detectors require intense computation and are especially…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Hyeong Kyu Choi , Joonmyung Choi , Hyunwoo J. Kim

Deep architecture have proven capable of solving many tasks provided a sufficient amount of labeled data. In fact, the amount of available labeled data has become the principal bottleneck in low label settings such as Semi-Supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Rémy Sun , Clément Masson , Gilles Hénaff , Nicolas Thome , Matthieu Cord

We improve the recently-proposed "MixMatch" semi-supervised learning algorithm by introducing two new techniques: distribution alignment and augmentation anchoring. Distribution alignment encourages the marginal distribution of predictions…

Machine Learning · Computer Science 2020-02-17 David Berthelot , Nicholas Carlini , Ekin D. Cubuk , Alex Kurakin , Kihyuk Sohn , Han Zhang , Colin Raffel

With the rapid development of deep learning, automatic modulation recognition (AMR), as an important task in cognitive radio, has gradually transformed from traditional feature extraction and classification to automatic classification by…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Xinjie Xu , Zhuangzhi Chen , Dongwei Xu , Huaji Zhou , Shanqing Yu , Shilian Zheng , Qi Xuan , Xiaoniu Yang

The performance of machine learning models can significantly degrade under distribution shifts of the data. We propose a new method for classification which can improve robustness to distribution shifts, by combining expert knowledge about…

Machine Learning · Computer Science 2022-08-31 Souradeep Dutta , Yahan Yang , Elena Bernardis , Edgar Dobriban , Insup Lee

Data augmentation has become a de facto component of deep learning-based medical image segmentation methods. Most data augmentation techniques used in medical imaging focus on spatial and intensity transformations to improve the diversity…

Image and Video Processing · Electrical Eng. & Systems 2023-08-21 Berke Doga Basaran , Weitong Zhang , Mengyun Qiao , Bernhard Kainz , Paul M. Matthews , Wenjia Bai

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

The development of medical image segmentation using deep learning can significantly support doctors' diagnoses. Deep learning needs large amounts of data for training, which also requires data augmentation to extend diversity for preventing…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xiaoqing Liu , Kenji Ono , Ryoma Bise

Different modalities hold considerable gaps in optimization trajectories, including speeds and paths, which lead to modality laziness and modality clash when jointly training multimodal models, resulting in insufficient and imbalanced…

Machine Learning · Computer Science 2025-06-17 Xiaoyu Ma , Hao Chen , Yongjian Deng

We propose Dataset Reinforcement, a strategy to improve a dataset once such that the accuracy of any model architecture trained on the reinforced dataset is improved at no additional training cost for users. We propose a Dataset…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Fartash Faghri , Hadi Pouransari , Sachin Mehta , Mehrdad Farajtabar , Ali Farhadi , Mohammad Rastegari , Oncel Tuzel

Data augmentation is a common practice to help generalization in the procedure of deep model training. In the context of physiological time series classification, previous research has primarily focused on label-invariant data augmentation…

Machine Learning · Computer Science 2023-09-19 Peikun Guo , Huiyuan Yang , Akane Sano

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein