English
Related papers

Related papers: Cross-language Learning with Adversarial Neural Ne…

200 papers

Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent…

Computation and Language · Computer Science 2017-12-22 Ofir Press , Amir Bar , Ben Bogin , Jonathan Berant , Lior Wolf

Domain adaptation (DA) aims to transfer the knowledge of a well-labeled source domain to facilitate unlabeled target learning. When turning to specific tasks such as indoor (Wi-Fi) localization, it is essential to learn a cross-domain…

Human-Computer Interaction · Computer Science 2024-07-19 Haifeng Xia , Pu Perry Wang , Toshiaki Koike-Akino , Ye Wang , Philip Orlik , Zhengming Ding

Different flavors of transfer learning have shown tremendous impact in advancing research and applications of machine learning. In this work we study the use of a specific family of transfer learning, where the target domain is mapped to…

Computation and Language · Computer Science 2020-11-06 Mahdi Namazifar , Alexandros Papangelis , Gokhan Tur , Dilek Hakkani-Tür

To advance the understanding of robust deep learning, we delve into the effects of adversarial training on self-supervised and supervised contrastive learning alongside supervised learning. Our analysis uncovers significant disparities…

Machine Learning · Computer Science 2023-06-08 Fatemeh Ghofrani , Mehdi Yaghouti , Pooyan Jamshidi

This paper examines the applicability in realistic scenarios of two deep learning based solutions to the overlapping speaker separation problem. Firstly, we present experiments that show that these methods are applicable for a broad range…

Machine Learning · Computer Science 2019-12-20 Pieter Appeltans , Jeroen Zegers , Hugo Van hamme

Convolutional neural network-based approaches for semantic segmentation rely on supervision with pixel-level ground truth, but may not generalize well to unseen image domains. As the labeling process is tedious and labor intensive,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Yi-Hsuan Tsai , Wei-Chih Hung , Samuel Schulter , Kihyuk Sohn , Ming-Hsuan Yang , Manmohan Chandraker

This paper introduces Adversarial Resilience Learning (ARL), a concept to model, train, and analyze artificial neural networks as representations of competitive agents in highly complex systems. In our examples, the agents normally take the…

Artificial Intelligence · Computer Science 2018-11-16 Lars Fischer , Jan-Menno Memmen , Eric MSP Veith , Martin Tröschel

Deep neural networks (DNNs) are vulnerable to adversarial noise. Their adversarial robustness can be improved by exploiting adversarial examples. However, given the continuously evolving attacks, models trained on seen types of adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Dawei Zhou , Tongliang Liu , Bo Han , Nannan Wang , Chunlei Peng , Xinbo Gao

In real world systems, the predictions of deployed Machine Learned models affect the training data available to build subsequent models. This introduces a bias in the training data that needs to be addressed. Existing solutions to this…

Machine Learning · Computer Science 2018-04-20 John Moore , Joel Pfeiffer , Kai Wei , Rishabh Iyer , Denis Charles , Ran Gilad-Bachrach , Levi Boyles , Eren Manavoglu

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Neural network models have shown their promising opportunities for multi-task learning, which focus on learning the shared layers to extract the common and task-invariant features. However, in most existing approaches, the extracted shared…

Computation and Language · Computer Science 2017-04-20 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Meta Reinforcement Learning (MRL) enables an agent to learn from a limited number of past trajectories and extrapolate to a new task. In this paper, we attempt to improve the robustness of MRL. We build upon model-agnostic meta-learning…

Machine Learning · Computer Science 2021-04-28 Shiqi Chen , Zhengyu Chen , Donglin Wang

Pre-trained language models have proven their unique powers in capturing implicit language features. However, most pre-training approaches focus on the word-level training objective, while sentence-level objectives are rarely studied. In…

Computation and Language · Computer Science 2021-01-01 Zhuofeng Wu , Sinong Wang , Jiatao Gu , Madian Khabsa , Fei Sun , Hao Ma

In real-life applications, the performance of speaker recognition systems always degrades when there is a mismatch between training and evaluation data. Many domain adaptation methods have been successfully used for eliminating the domain…

Sound · Computer Science 2020-11-18 Qing Wang , Wei Rao , Pengcheng Guo , Lei Xie

Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem.…

Machine Learning · Computer Science 2022-09-07 Tanmoy Dam , Mahardhika Pratama , MD Meftahul Ferdaus , Sreenatha Anavatti , Hussein Abbas

Cross-lingual text classification aims at training a classifier on the source language and transferring the knowledge to target languages, which is very useful for low-resource languages. Recent multilingual pretrained language models…

Computation and Language · Computer Science 2021-05-25 Ziyun Wang , Xuan Liu , Peiji Yang , Shixing Liu , Zhisheng Wang

Ideally, what confuses neural network should be confusing to humans. However, recent experiments have shown that small, imperceptible perturbations can change the network prediction. To address this gap in perception, we propose a novel…

Machine Learning · Computer Science 2018-10-31 Alexander Matyasko , Lap-Pui Chau

We have recently seen great progress in image classification due to the success of deep convolutional neural networks and the availability of large-scale datasets. Most of the existing work focuses on single-label image classification.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Erik Quintanilla , Yogesh Rawat , Andrey Sakryukin , Mubarak Shah , Mohan Kankanhalli

Meta learning with auxiliary languages has demonstrated promising improvements for cross-lingual natural language processing. However, previous studies sample the meta-training and meta-testing data from the same language, which limits the…

Computation and Language · Computer Science 2021-11-11 Qianying Liu , Fei Cheng , Sadao Kurohashi