English
Related papers

Related papers: Weakly-Supervised Concept-based Adversarial Learni…

200 papers

We study cross-lingual sequence tagging with little or no labeled data in the target language. Adversarial training has previously been shown to be effective for training cross-lingual sentence classifiers. However, it is not clear if…

Computation and Language · Computer Science 2018-08-15 Heike Adel , Anton Bryl , David Weiss , Aliaksei Severyn

This paper presents a new technique for creating monolingual and cross-lingual meta-embeddings. Our method integrates multiple word embeddings created from complementary techniques, textual sources, knowledge bases and languages. Existing…

Computation and Language · Computer Science 2021-09-09 Iker García-Ferrero , Rodrigo Agerri , German Rigau

Word translation is a problem in machine translation that seeks to build models that recover word level correspondence between languages. Recent approaches to this problem have shown that word translation models can learned with very small…

Computation and Language · Computer Science 2019-12-24 Blaine Cole

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Cross-lingual word vectors are typically obtained by fitting an orthogonal matrix that maps the entries of a bilingual dictionary from a source to a target vector space. Word vectors, however, are most commonly used for sentence or…

Computation and Language · Computer Science 2019-04-02 Hanan Aldarmaki , Mona Diab

Building computers able to answer questions on any subject is a long standing goal of artificial intelligence. Promising progress has recently been achieved by methods that learn to map questions to logical forms or database queries. Such…

Computation and Language · Computer Science 2014-04-17 Antoine Bordes , Jason Weston , Nicolas Usunier

It is very challenging to work with low-resource languages due to the inadequate availability of data. Using a dictionary to map independently trained word embeddings into a shared vector space has proved to be very useful in learning…

Computation and Language · Computer Science 2019-10-16 Sourav Dutta

Weakly supervised vision-and-language pre-training (WVLP), which learns cross-modal representations with limited cross-modal supervision, has been shown to effectively reduce the data cost of pre-training while maintaining decent…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Chi Chen , Peng Li , Maosong Sun , Yang Liu

The recent tremendous success of unsupervised word embeddings in a multitude of applications raises the obvious question if similar methods could be derived to improve embeddings (i.e. semantic representations) of word sequences as well. We…

Computation and Language · Computer Science 2018-12-31 Matteo Pagliardini , Prakhar Gupta , Martin Jaggi

A number of cross-lingual transfer learning approaches based on neural networks have been proposed for the case when large amounts of parallel text are at our disposal. However, in many real-world settings, the size of parallel annotated…

Computation and Language · Computer Science 2020-01-31 Zuohui Fu , Yikun Xian , Shijie Geng , Yingqiang Ge , Yuting Wang , Xin Dong , Guang Wang , Gerard de Melo

The field of cross-lingual sentence embeddings has recently experienced significant advancements, but research concerning low-resource languages has lagged due to the scarcity of parallel corpora. This paper shows that cross-lingual word…

Computation and Language · Computer Science 2024-04-04 Zhongtao Miao , Qiyu Wu , Kaiyan Zhao , Zilong Wu , Yoshimasa Tsuruoka

Making decent multi-lingual sentence representations is critical to achieve high performances in cross-lingual downstream tasks. In this work, we propose a novel method to align multi-lingual embeddings based on the similarity of sentences…

Computation and Language · Computer Science 2024-05-29 Minsu Park , Seyeon Choi , Chanyeol Choi , Jun-Seong Kim , Jy-yong Sohn

Cross-domain alignment play a key roles in tasks ranging from machine translation to transfer learning. Recently, purely unsupervised methods operating on monolingual embeddings have successfully been used to infer a bilingual lexicon…

Computation and Language · Computer Science 2022-09-22 Aissatou Diallo , Johannes Fürnkranz

In this paper, we present a method for adversarial decomposition of text representation. This method can be used to decompose a representation of an input sentence into several independent vectors, each of them responsible for a specific…

Computation and Language · Computer Science 2019-04-11 Alexey Romanov , Anna Rumshisky , Anna Rogers , David Donahue

Joint extraction of aspects and sentiments can be effectively formulated as a sequence labeling problem. However, such formulation hinders the effectiveness of supervised methods due to the lack of annotated sequence data in many domains.…

Computation and Language · Computer Science 2019-11-01 Zheng Li , Xin Li , Ying Wei , Lidong Bing , Yu Zhang , Qiang Yang

Constructing an organized dataset comprised of a large number of images and several captions for each image is a laborious task, which requires vast human effort. On the other hand, collecting a large number of images and sentences…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Dong-Jin Kim , Jinsoo Choi , Tae-Hyun Oh , In So Kweon

Pre-trained word embeddings are widely used for transfer learning in natural language processing. The embeddings are continuous and distributed representations of the words that preserve their similarities in compact Euclidean spaces.…

Computation and Language · Computer Science 2020-06-25 Halid Ziya Yerebakan , Parmeet Bhatia , Yoshihisa Shinagawa

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

Machine Learning · Computer Science 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

Unsupervised learning of cross-lingual word embedding offers elegant matching of words across languages, but has fundamental limitations in translating sentences. In this paper, we propose simple yet effective methods to improve…

Computation and Language · Computer Science 2019-01-08 Yunsu Kim , Jiahui Geng , Hermann Ney

This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Saeid Motiian , Quinn Jones , Seyed Mehdi Iranmanesh , Gianfranco Doretto