English
Related papers

Related papers: Adversarial Training Helps Transfer Learning via B…

200 papers

Existing adversarial domain adaptation methods mainly consider the marginal distribution and these methods may lead to either under transfer or negative transfer. To address this problem, we present a self-adaptive re-weighted adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Shanshan Wang , Lei Zhang

In this paper, we propose a new approach called MemLoss to improve the adversarial training of machine learning models. MemLoss leverages previously generated adversarial examples, referred to as 'Memory Adversarial Examples,' to enhance…

Machine Learning · Computer Science 2025-10-13 Soroush Mahdi , Maryam Amirmazlaghani , Saeed Saravani , Zahra Dehghanian

Representations of data that are invariant to changes in specified factors are useful for a wide range of problems: removing potential biases in prediction problems, controlling the effects of covariates, and disentangling meaningful…

Machine Learning · Computer Science 2019-12-03 Daniel Moyer , Shuyang Gao , Rob Brekelmans , Greg Ver Steeg , Aram Galstyan

Adversarial Training has proved to be an effective training paradigm to enforce robustness against adversarial examples in modern neural network architectures. Despite many efforts, explanations of the foundational principles underpinning…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Mattia Carletti , Matteo Terzi , Gian Antonio Susto

Unsupervised domain adaption aims to learn a powerful classifier for the target domain given a labeled source data set and an unlabeled target data set. To alleviate the effect of `domain shift', the major challenge in domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Yexun Zhang , Ya Zhang , Yanfeng Wang , Qi Tian

In inductive transfer learning, fine-tuning pre-trained convolutional networks substantially outperforms training from scratch. When using fine-tuning, the underlying assumption is that the pre-trained model extracts generic features, which…

Machine Learning · Computer Science 2018-06-07 Xuhong Li , Yves Grandvalet , Franck Davoine

Domain adaptation seeks to mitigate the shift between training on the \emph{source} domain and testing on the \emph{target} domain. Most adaptation methods rely on the source data by joint optimization over source data and target data.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Dequan Wang , Shaoteng Liu , Sayna Ebrahimi , Evan Shelhamer , Trevor Darrell

In this work, we evaluate adversarial robustness in the context of transfer learning from a source trained on CIFAR 100 to a target network trained on CIFAR 10. Specifically, we study the effects of using robust optimisation in the source…

Machine Learning · Statistics 2019-06-11 Todor Davchev , Timos Korres , Stathi Fotiadis , Nick Antonopoulos , Subramanian Ramamoorthy

We propose a framework for adversarial training that relies on a sample rather than a single sample point as the fundamental unit of discrimination. Inspired by discrepancy measures and two-sample tests between probability distributions, we…

Machine Learning · Computer Science 2017-07-11 Chengtao Li , David Alvarez-Melis , Keyulu Xu , Stefanie Jegelka , Suvrit Sra

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches to training robust models against…

Machine Learning · Computer Science 2023-08-09 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Transfer learning is an important approach for addressing the challenges posed by limited data availability in various applications. It accomplishes this by transferring knowledge from well-established source domains to a less familiar…

Machine Learning · Statistics 2025-03-03 Yeheng Ge , Xueyu Zhou , Jian Huang

Domain adaptation is widely used in learning problems lacking labels. Recent studies show that deep adversarial domain adaptation models can make markable improvements in performance, which include symmetric and asymmetric architectures.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Guanyu Cai , Yuqin Wang , Mengchu Zhou , Lianghua He

Although many fields have witnessed the superior performance brought about by deep learning, the robustness of neural networks remains an open issue. Specifically, a small adversarial perturbation on the input may cause the model to produce…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Binxiao Huang , Chaofan Tao , Rui Lin , Ngai Wong

The use of pretrained models from general computer vision tasks is widespread in remote sensing, significantly reducing training costs and improving performance. However, this practice also introduces vulnerabilities to downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Tao Bai , Xingjian Tian , Yonghao Xu , Bihan Wen

How can we learn a classifier that is "fair" for a protected or sensitive group, when we do not know if the input to the classifier belongs to the protected group? How can we train such a classifier when data on the protected group is…

Machine Learning · Computer Science 2017-07-10 Alex Beutel , Jilin Chen , Zhe Zhao , Ed H. Chi

We study cross-lingual sequence tagging with little or no labeled data in the target language. Adversarial training has previously been shown to be effective for training cross-lingual sentence classifiers. However, it is not clear if…

Computation and Language · Computer Science 2018-08-15 Heike Adel , Anton Bryl , David Weiss , Aliaksei Severyn

Data shift is a phenomenon present in many real-world applications, and while there are multiple methods attempting to detect shifts, the task of localizing and correcting the features originating such shifts has not been studied in depth.…

Machine Learning · Computer Science 2023-12-08 Miriam Barrabes , Daniel Mas Montserrat , Margarita Geleta , Xavier Giro-i-Nieto , Alexander G. Ioannidis

Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets,…

Machine Learning · Computer Science 2021-07-30 Wentao Wang , Han Xu , Xiaorui Liu , Yaxin Li , Bhavani Thuraisingham , Jiliang Tang

Transfer learning has become a central paradigm in modern machine learning, yet it suffers from the long-standing problem of negative transfer, where leveraging source representations can harm rather than help performance on the target…

Machine Learning · Computer Science 2026-04-28 Yichen Xu , Ryumei Nakada , Linjun Zhang , Lexin Li

Nowadays, Deep Neural Networks (DNNs) report state-of-the-art results in many machine learning areas, including intrusion detection. Nevertheless, recent studies in computer vision have shown that DNNs can be vulnerable to adversarial…

Cryptography and Security · Computer Science 2021-04-21 Islam Debicha , Thibault Debatty , Jean-Michel Dricot , Wim Mees