English
Related papers

Related papers: Learning Crosslingual Word Embeddings without Bili…

200 papers

Recent approaches to cross-lingual word embedding have generally been based on linear transformations between the sets of embedding vectors in the two languages. In this paper, we propose an approach that instead expresses the two…

Computation and Language · Computer Science 2019-10-08 Chunting Zhou , Xuezhe Ma , Di Wang , Graham Neubig

Multilingual topic models enable crosslingual tasks by extracting consistent topics from multilingual corpora. Most models require parallel or comparable training corpora, which limits their ability to generalize. In this paper, we first…

Computation and Language · Computer Science 2018-06-13 Shudong Hao , Michael J. Paul

Distributed word embeddings have yielded state-of-the-art performance in many NLP tasks, mainly due to their success in capturing useful semantic information. These representations assign only a single vector to each word whereas a large…

Machine Learning · Computer Science 2020-02-04 Shobhit Jain , Sravan Babu Bodapati , Ramesh Nallapati , Anima Anandkumar

Cross-lingual transfer learning is an important property of multilingual large language models (LLMs). But how do LLMs represent relationships between languages? Every language model has an input layer that maps tokens to vectors. This…

Computation and Language · Computer Science 2023-12-19 Andrea W Wen-Yi , David Mimno

Unsupervised learning of cross-lingual word embedding offers elegant matching of words across languages, but has fundamental limitations in translating sentences. In this paper, we propose simple yet effective methods to improve…

Computation and Language · Computer Science 2019-01-08 Yunsu Kim , Jiahui Geng , Hermann Ney

A significant roadblock in multilingual neural language modeling is the lack of labeled non-English data. One potential method for overcoming this issue is learning cross-lingual text representations that can be used to transfer the…

Computation and Language · Computer Science 2019-08-02 Muthuraman Chidambaram , Yinfei Yang , Daniel Cer , Steve Yuan , Yun-Hsuan Sung , Brian Strope , Ray Kurzweil

Recent work has managed to learn cross-lingual word embeddings without parallel data by mapping monolingual embeddings to a shared space through adversarial training. However, their evaluation has focused on favorable conditions, using…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Cross-lingual embeddings aim to represent words in multiple languages in a shared vector space by capturing semantic similarities across languages. They are a crucial component for scaling tasks to multiple languages by transferring…

Computation and Language · Computer Science 2019-07-10 Lena Shakurova , Beata Nyari , Chao Li , Mihai Rotaru

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

We present a new method for estimating vector space representations of words: embedding learning by concept induction. We test this method on a highly parallel corpus and learn semantic representations of words in 1259 different languages…

Computation and Language · Computer Science 2018-06-28 Philipp Dufter , Mengjie Zhao , Martin Schmitt , Alexander Fraser , Hinrich Schütze

Recent work in cross-lingual contextual word embedding learning cannot handle multi-sense words well. In this work, we explore the characteristics of contextual word embeddings and show the link between contextual word embeddings and word…

Computation and Language · Computer Science 2019-09-20 Zheng Zhang , Ruiqing Yin , Jun Zhu , Pierre Zweigenbaum

We study the problem of multilingual masked language modeling, i.e. the training of a single model on concatenated text from multiple languages, and present a detailed study of several factors that influence why these models are so…

Computation and Language · Computer Science 2020-05-11 Shijie Wu , Alexis Conneau , Haoran Li , Luke Zettlemoyer , Veselin Stoyanov

Cross-lingual embeddings represent the meaning of words from different languages in the same vector space. Recent work has shown that it is possible to construct such representations by aligning independently learned monolingual embedding…

Cross-language learning allows us to use training data from one language to build models for a different language. Many approaches to bilingual learning require that we have word-level alignment of sentences from parallel corpora. In this…

Computation and Language · Computer Science 2014-02-07 Sarath Chandar A P , Stanislas Lauly , Hugo Larochelle , Mitesh M. Khapra , Balaraman Ravindran , Vikas Raykar , Amrita Saha

Multilingual representations embed words from many languages into a single semantic space such that words with similar meanings are close to each other regardless of the language. These embeddings have been widely used in various settings,…

Computation and Language · Computer Science 2020-05-05 Jieyu Zhao , Subhabrata Mukherjee , Saghar Hosseini , Kai-Wei Chang , Ahmed Hassan Awadallah

Multilingual Word Embeddings (MWEs) represent words from multiple languages in a single distributional vector space. Unsupervised MWE (UMWE) methods acquire multilingual embeddings without cross-lingual supervision, which is a significant…

Computation and Language · Computer Science 2018-09-07 Xilun Chen , Claire Cardie

There have been some works that learn a lexicon together with the corpus to improve the word embeddings. However, they either model the lexicon separately but update the neural networks for both the corpus and the lexicon by the same…

Computation and Language · Computer Science 2017-07-25 Yuanzhi Ke , Masafumi Hagiwara

Most of the successful and predominant methods for bilingual lexicon induction (BLI) are mapping-based, where a linear mapping function is learned with the assumption that the word embedding spaces of different languages exhibit similar…

Computation and Language · Computer Science 2020-10-23 Tasnim Mohiuddin , M Saiful Bari , Shafiq Joty

Code-switching (CS) is a widespread phenomenon among bilingual and multilingual societies. The lack of CS resources hinders the performance of many NLP tasks. In this work, we explore the potential use of bilingual word embeddings for…

Computation and Language · Computer Science 2019-09-25 Injy Hamed , Moritz Zhu , Mohamed Elmahdy , Slim Abdennadher , Ngoc Thang Vu

Cross-lingual word embeddings (CLEs) enable multilingual modeling of meaning and facilitate cross-lingual transfer of NLP models. Despite their ubiquitous usage in downstream tasks, recent increasingly popular projection-based CLE models…

Computation and Language · Computer Science 2019-06-07 Goran Glavas , Robert Litschko , Sebastian Ruder , Ivan Vulic