English
Related papers

Related papers: Manifold-Constrained Adversarial Training for Long…

200 papers

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

Neural networks are getting deeper and more computation-intensive nowadays. Quantization is a useful technique in deploying neural networks on hardware platforms and saving computation costs with negligible performance loss. However, recent…

Machine Learning · Computer Science 2021-01-26 Chang Song , Elias Fallon , Hai Li

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

Machine Learning · Computer Science 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Adversarial training (AT) is a widely recognized defense mechanism to gain the robustness of deep neural networks against adversarial attacks. It is built on min-max optimization (MMO), where the minimizer (i.e., defender) seeks a robust…

Machine Learning · Computer Science 2022-10-06 Yihua Zhang , Guanhua Zhang , Prashant Khanduri , Mingyi Hong , Shiyu Chang , Sijia Liu

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

We propose a principled framework that combines adversarial training and provable robustness verification for training certifiably robust neural networks. We formulate the training problem as a joint optimization problem with both empirical…

Machine Learning · Computer Science 2021-06-08 Jiameng Fan , Wenchao Li

The goal in extreme multi-label classification is to learn a classifier which can assign a small subset of relevant labels to an instance from an extremely large set of target labels. Datasets in extreme classification exhibit a long tail…

Machine Learning · Statistics 2018-03-06 Rohit Babbar , Bernhard Schölkopf

Deep neural network models degrade significantly in the long-tailed data distribution, with the overall training data dominated by a small set of classes in the head, and the tail classes obtaining less training examples. Addressing the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Brainard Philemon Jagati , Jitendra Tembhurne , Harsh Goud , Rudra Pratap Singh , Chandrashekhar Meshram

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

We augment adversarial training (AT) with worst case adversarial training (WCAT) which improves adversarial robustness by 11% over the current state-of-the-art result in the $\ell_2$ norm on CIFAR-10. We obtain verifiable average case and…

Machine Learning · Computer Science 2019-09-16 Chris Finlay , Adam Oberman , Bilal Abbasi

Class imbalance has been extensively studied in single-view scenarios; however, addressing this challenge in multi-view contexts remains an open problem, with even scarcer research focusing on trustworthy solutions. In this paper, we tackle…

Machine Learning · Computer Science 2025-11-13 Chuanqing Tang , Yifei Shi , Guanghao Lin , Lei Xing , Long Shi

Previous adversarial training raises model robustness under the compromise of accuracy on natural data. In this paper, we reduce natural accuracy degradation. We use the model logits from one clean model to guide learning of another one…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jiequan Cui , Shu Liu , Liwei Wang , Jiaya Jia

In the field of adversarial robustness, there is a common practice that adopts the single-step adversarial training for quickly developing adversarially robust models. However, the single-step adversarial training is most likely to cause…

Machine Learning · Computer Science 2021-06-30 Xiaosen Wang , Chuanbiao Song , Liwei Wang , Kun He

Point cloud classifiers with rotation robustness have been widely discussed in the 3D deep learning community. Most proposed methods either use rotation invariant descriptors as inputs or try to design rotation equivariant networks.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Robin Wang , Yibo Yang , Dacheng Tao

Federated learning (FL) is a distributed training technology that enhances data privacy in mobile edge networks by allowing data owners to collaborate without transmitting raw data to the edge server. However, data heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yu Qiao , Apurba Adhikary , Kitae Kim , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Adversarial samples are perturbed inputs crafted to mislead the machine learning systems. A training mechanism, called adversarial training, which presents adversarial samples along with clean samples has been introduced to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Vivek B. S. , Konda Reddy Mopuri , R. Venkatesh Babu

Deep classifiers have achieved great success in visual recognition. However, real-world data is long-tailed by nature, leading to the mismatch between training and testing distributions. In this paper, we show that the Softmax function,…

Machine Learning · Computer Science 2020-11-24 Jiawei Ren , Cunjun Yu , Shunan Sheng , Xiao Ma , Haiyu Zhao , Shuai Yi , Hongsheng Li

Learning robust models under adversarial settings is widely recognized as requiring a considerably large number of training samples. Recent work proposes semi-supervised adversarial training (SSAT), which utilizes external unlabeled or…

Machine Learning · Computer Science 2026-03-10 Somrita Ghosh , Yuelin Xu , Xiao Zhang

Multi-domain text classification (MDTC) aims to leverage all available resources from multiple domains to learn a predictive model that can generalize well on these domains. Recently, many MDTC methods adopt adversarial learning,…

Machine Learning · Computer Science 2022-02-01 Yuan Wu , Diana Inkpen , Ahmed El-Roby

Robust training methods typically defend against specific attack types, such as Lp attacks with fixed budgets, and rarely account for the fact that defenders may encounter new attacks over time. A natural solution is to adapt the defended…

Machine Learning · Computer Science 2025-02-07 Sihui Dai , Christian Cianfarani , Arjun Bhagoji , Vikash Sehwag , Prateek Mittal