English
Related papers

Related papers: MixBoost: Improving the Robustness of Deep Neural …

200 papers

Efforts to leverage deep learning models in low-resource regimes have led to numerous augmentation studies. However, the direct application of methods such as mixup and cutout to text data, is limited due to their discrete characteristics.…

Computation and Language · Computer Science 2024-03-26 Kyohoon Jin , Junho Lee , Juhwan Choi , Sangmin Song , Youngbin Kim

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

Robustness of deep neural networks (DNNs) to malicious perturbations is a hot topic in trustworthy AI. Existing techniques obtain robust models given fixed datasets, either by modifying model structures, or by optimizing the process of…

Machine Learning · Computer Science 2022-03-11 Yiqi Zhong , Lei Wu , Xianming Liu , Junjun Jiang

Deep learning performs remarkably well on many time series analysis tasks recently. The superior performance of deep neural networks relies heavily on a large number of training data to avoid overfitting. However, the labeled data of many…

Machine Learning · Computer Science 2022-04-04 Qingsong Wen , Liang Sun , Fan Yang , Xiaomin Song , Jingkun Gao , Xue Wang , Huan Xu

In the dynamic landscape of machine learning, where datasets vary widely in size and complexity, selecting the most effective model poses a significant challenge. Rather than fixating on a single model, our research propels the field…

Machine Learning · Computer Science 2024-05-01 Syed Tahir Abbas Hasani

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

AI fairness seeks to improve the transparency and explainability of AI systems by ensuring that their outcomes genuinely reflect the best interests of users. Data augmentation, which involves generating synthetic data from existing…

Machine Learning · Computer Science 2024-10-22 Christina Hastings Blow , Lijun Qian , Camille Gibson , Pamela Obiomon , Xishuang Dong

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across…

Machine Learning · Computer Science 2020-09-18 Dong Yin , Raphael Gontijo Lopes , Jonathon Shlens , Ekin D. Cubuk , Justin Gilmer

Deep networks for visual recognition are known to leverage "easy to recognise" portions of objects such as faces and distinctive texture patterns. The lack of a holistic understanding of objects may increase fragility and overfitting. In…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Ruth Fong , Andrea Vedaldi

Recently, a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques, two or more randomly selected natural images are mixed together to generate an…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar

Model compression techniques allow to significantly reduce the computational cost associated with data processing by deep neural networks with only a minor decrease in average accuracy. Simultaneously, reducing the model size may have a…

Machine Learning · Computer Science 2021-09-28 Sebastian Cygert , Andrzej Czyżewski

Optimization of image transformation functions for the purpose of data augmentation has been intensively studied. In particular, adversarial data augmentation strategies, which search augmentation maximizing task loss, show significant…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Teppei Suzuki

Mixed Sample Data Augmentation (MSDA) has received increasing attention in recent years, with many successful variants such as MixUp and CutMix. By studying the mutual information between the function learned by a VAE on the original data…

Machine Learning · Computer Science 2021-03-02 Ethan Harris , Antonia Marcu , Matthew Painter , Mahesan Niranjan , Adam Prügel-Bennett , Jonathon Hare

XGBoost, a scalable tree boosting algorithm, has proven effective for many prediction tasks of practical interest, especially using tabular datasets. Hyperparameter tuning can further improve the predictive performance, but unlike neural…

Machine Learning · Computer Science 2021-11-16 Sanyam Kapoor , Valerio Perrone

Data augmentation serves as a popular regularization technique to combat overfitting challenges in neural networks. While automatic augmentation has demonstrated success in image classification tasks, its application to time-series…

Machine Learning · Computer Science 2025-06-19 Liran Nochumsohn , Omri Azencot

Data augmentation is essential when applying Machine Learning in small-data regimes. It generates new samples following the observed data distribution while increasing their diversity and variability to help researchers and practitioners…

Machine Learning · Computer Science 2023-04-10 Audrey Poinsot , Alessandro Leite

Deep learning models have demonstrated remarkable performance across various computer vision tasks, yet their vulnerability to distribution shifts remains a critical challenge. Despite sophisticated neural network architectures, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Hafiz Mughees Ahmad , Dario Morle , Afshin Rahimi

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

Artificial Intelligence · Computer Science 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

Data augmentation is a technique to improve the generalization ability of machine learning methods by increasing the size of the dataset. However, since every augmentation method is not equally effective for every dataset, you need to…

Machine Learning · Computer Science 2022-05-31 Daisuke Oba , Shinnosuke Matsuo , Brian Kenji Iwana

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino