English
Related papers

Related papers: Cross-language Learning with Adversarial Neural Ne…

200 papers

Adversarial training enhances neural network robustness but suffers from a tendency to overfit and increased generalization errors on clean data. This work introduces CLAT, an innovative approach that mitigates adversarial overfitting by…

Machine Learning · Computer Science 2024-12-25 Bhavna Gopal , Huanrui Yang , Jingyang Zhang , Mark Horton , Yiran Chen

The major paradigm of applying a pre-trained language model to downstream tasks is to fine-tune it on labeled task data, which often suffers instability and low performance when the labeled examples are scarce.~One way to alleviate this…

Computation and Language · Computer Science 2021-06-07 Ruikun Luo , Guanhuan Huang , Xiaojun Quan

This paper presents a new semantic frame parsing model, based on Berkeley FrameNet, adapted to process spoken documents in order to perform information extraction from broadcast contents. Building upon previous work that had shown the…

Computation and Language · Computer Science 2019-10-08 Gabriel Marzinotto , Geraldine Damnati , Frédéric Béchet

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

Machine Learning · Computer Science 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

Adversarial training (AT) as a regularization method has proved its effectiveness in various tasks, such as image classification and text classification. Though there are successful applications of AT in many tasks of natural language…

Computation and Language · Computer Science 2019-11-12 Ziqing Yang , Yiming Cui , Wanxiang Che , Ting Liu , Shijin Wang , Guoping Hu

Most real world language problems require learning from heterogenous corpora, raising the problem of learning robust models which generalise well to both similar (in domain) and dissimilar (out of domain) instances to those seen in…

Computation and Language · Computer Science 2018-05-17 Yitong Li , Timothy Baldwin , Trevor Cohn

Adversarial training has shown impressive success in learning bilingual dictionary without any parallel data by mapping monolingual embeddings to a shared space. However, recent work has shown superior performance for non-adversarial…

Computation and Language · Computer Science 2019-04-09 Tasnim Mohiuddin , Shafiq Joty

We introduce a neural method for transfer learning between two (source and target) classification tasks or aspects over the same domain. Rather than training on target labels, we use a few keywords pertaining to source and target aspects…

Computation and Language · Computer Science 2017-09-26 Yuan Zhang , Regina Barzilay , Tommi Jaakkola

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

Machine Learning · Computer Science 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

In practical applications for emotion recognition, users do not always exist in the training corpus. The mismatch between training speakers and testing speakers affects the performance of the trained model. To deal with this problem, we…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-31 Zheng Lian , Jianhua Tao , Bin Liu , Jian Huang

Adversarial training is a method for enhancing neural networks to improve the robustness against adversarial examples. Besides the security concerns of potential adversarial examples, adversarial training can also improve the generalization…

Machine Learning · Computer Science 2022-12-21 Zhiyuan Zhang , Wei Li , Ruihan Bao , Keiko Harimoto , Yunfang Wu , Xu Sun

Adversarial training (AT) refers to integrating adversarial examples -- inputs altered with imperceptible perturbations that can significantly impact model predictions -- into the training process. Recent studies have demonstrated the…

Machine Learning · Computer Science 2024-10-22 Mengnan Zhao , Lihe Zhang , Jingwen Ye , Huchuan Lu , Baocai Yin , Xinchao Wang

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Unsupervised Domain Adaptation (UDA), which aims to explore the transferrable features from a well-labeled source domain to a related unlabeled target domain, has been widely progressed. Nevertheless, as one of the mainstream, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Yumin Zhang , Yajun Gao , Hongliu Li , Ating Yin , Duzhen Zhang , Xiuyi Chen

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

We present a simple yet effective Targeted Adversarial Training (TAT) algorithm to improve adversarial training for natural language understanding. The key idea is to introspect current mistakes and prioritize adversarial training steps to…

Computation and Language · Computer Science 2021-04-14 Lis Pereira , Xiaodong Liu , Hao Cheng , Hoifung Poon , Jianfeng Gao , Ichiro Kobayashi

Deep Neural Networks (DNNs) have often supplied state-of-the-art results in pattern recognition tasks. Despite their advances, however, the existence of adversarial examples have caught the attention of the community. Many existing works…

Machine Learning · Computer Science 2021-01-25 Jay Morgan , Adeline Paiement , Arno Pauly , Monika Seisenberger

Adversarial reprogramming allows repurposing a machine-learning model to perform a different task. For example, a model trained to recognize animals can be reprogrammed to recognize digits by embedding an adversarial program in the digit…

Machine Learning · Computer Science 2023-03-14 Yang Zheng , Xiaoyi Feng , Zhaoqiang Xia , Xiaoyue Jiang , Ambra Demontis , Maura Pintor , Battista Biggio , Fabio Roli

Recent advancements in transfer learning have made it a promising approach for domain adaptation via transfer of learned representations. This is especially when relevant when alternate tasks have limited samples of well-defined and labeled…

Machine Learning · Computer Science 2021-01-07 Ria Vinod , Pin-Yu Chen , Payel Das

The use of unsupervised data in addition to supervised data in training discriminative neural networks has improved the performance of this clas- sification scheme. However, the best results were achieved with a training process that is…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Juan Maroñas Molano , Alberto Albiol Colomer , Roberto Paredes Palacios