English
Related papers

Related papers: Enhancing Output Diversity Improves Conjugate Grad…

200 papers

Adversarial distillation (AD) is a knowledge distillation technique that facilitates the transfer of robustness from teacher deep neural network (DNN) models to lightweight target (student) DNN models, enabling the target models to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Zhenyu Liu , Huizhi Liang , Xinrun Li , Vaclav Snasel , Varun Ojha

In adversarial learning, discriminator often fails to guide the generator successfully since it distinguishes between real and generated images using silly or non-robust features. To alleviate this problem, this brief presents a simple but…

Machine Learning · Computer Science 2021-01-20 Yong-Goo Shin , Yoon-Jae Yeo , Sung-Jea Ko

Large-batch training has become a commonly used technique when training neural networks with a large number of GPU/TPU processors. As batch size increases, stochastic optimizers tend to converge to sharp local minima, leading to degraded…

Machine Learning · Computer Science 2022-01-25 Yong Liu , Xiangning Chen , Minhao Cheng , Cho-Jui Hsieh , Yang You

Compared with traditional machine learning models, deep neural networks perform better, especially in image classification tasks. However, they are vulnerable to adversarial examples. Adding small perturbations on examples causes a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Zifei Zhang , Kai Qiao , Lingyun Jiang , Linyuan Wang , Bin Yan

Due to its powerful capability of self-supervised representation learning and clustering, contrastive attributed graph clustering (CAGC) has achieved great success, which mainly depends on effective data augmentation and contrastive…

Machine Learning · Computer Science 2025-10-06 Tianxiang Zhao , Youqing Wang , Jinlu Wang , Jiapu Wang , Mingliang Cui , Junbin Gao , Jipeng Guo

Recent research has revealed that the security of deep neural networks that directly process 3D point clouds to classify objects can be threatened by adversarial samples. Although existing adversarial attack methods achieve high success…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Atrin Arya , Hanieh Naderi , Shohreh Kasaei

To defend deep neural networks from adversarial attacks, adversarial training has been drawing increasing attention for its effectiveness. However, the accuracy and robustness resulting from the adversarial training are limited by the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yuwei Ou , Yuqi Feng , Yanan Sun

We propose a distributed approach to train deep convolutional generative adversarial neural network (DC-CGANs) models. Our method reduces the imbalance between generator and discriminator by partitioning the training data according to data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Massimiliano Lupo Pasini , Vittorio Gabbi , Junqi Yin , Simona Perotto , Nouamane Laanait

Deep Neural Networks (DNNs) are often criticized for being susceptible to adversarial attacks. Most successful defense strategies adopt adversarial training or random input transformations that typically require retraining or fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Lokender Tiwari , Anish Madan , Saket Anand , Subhashis Banerjee

The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Shengyu Zhao , Zhijian Liu , Ji Lin , Jun-Yan Zhu , Song Han

Deep neural networks are susceptible to \emph{adversarial} attacks. In computer vision, well-crafted perturbations to images can cause neural networks to make mistakes such as confusing a cat with a computer. Previous adversarial attacks…

Machine Learning · Computer Science 2019-09-12 Gamaleldin F. Elsayed , Ian Goodfellow , Jascha Sohl-Dickstein

Deep neural networks have achieved remarkable success in a wide range of classification tasks. However, they remain highly susceptible to adversarial examples - inputs that are subtly perturbed to induce misclassification while appearing…

Machine Learning · Computer Science 2025-10-20 Virendra Nishad , Bhaskar Mukhoty , Hilal AlQuabeh , Sandeep K. Shukla , Sayak Ray Chowdhury

Deep neural networks have exhibited impressive performance in image classification tasks but remain vulnerable to adversarial examples. Standard adversarial training enhances robustness but typically fails to explicitly address inter-class…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Himanshu Singh , A. V. Subramanyam , Shivank Rajput , Mohan Kankanhalli

The emergence of deep learning led to the broad usage of neural networks in the time series domain for various applications, including finance and medicine. While powerful, these models are prone to adversarial attacks: a benign targeted…

Machine Learning · Computer Science 2025-03-03 Petr Sokerin , Dmitry Anikin , Sofia Krehova , Alexey Zaytsev

Electrocardiogram (ECG) acquisition requires an automated system and analysis pipeline for understanding specific rhythm irregularities. Deep neural networks have become a popular technique for tracing ECG signals, outperforming human…

State-of-the-art deep neural networks suffer from a fundamental problem - they misclassify adversarial examples formed by applying small perturbations to inputs. In this paper, we present a new psychometric perceptual adversarial similarity…

Computer Vision and Pattern Recognition · Computer Science 2016-05-18 Andras Rozsa , Ethan M. Rudd , Terrance E. Boult

Retrieval-augmented generation (RAG) systems are increasingly deployed in sensitive domains such as healthcare and law, where they rely on private, domain-specific knowledge. This capability introduces significant security risks, including…

Cryptography and Security · Computer Science 2026-04-24 Pranav Pallerla , Wilson Naik Bhukya , Bharath Vemula , Charan Ramtej Kodi

Data augmentation (DA) has been widely utilized to improve generalization in training deep neural networks. Recently, human-designed data augmentation has been gradually replaced by automatically learned augmentation policy. Through finding…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Xinyu Zhang , Qiang Wang , Jian Zhang , Zhao Zhong

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

Loss spikes remain a persistent obstacle in large-scale language model pretraining. While previous research has attempted to identify the root cause of loss spikes by investigating individual factors, we observe that, in practice, such…

Machine Learning · Computer Science 2026-02-24 Guoxia Wang , Shuai Li , Congliang Chen , Jinle Zeng , Jiabin Yang , Dianhai Yu , Yanjun Ma , Li Shen