English
Related papers

Related papers: Effective Parallel Corpus Mining using Bilingual S…

200 papers

The effectiveness of a statistical machine translation system (SMT) is very dependent upon the amount of parallel corpus used in the training phase. For low-resource language pairs there are not enough parallel corpora to build an accurate…

Computation and Language · Computer Science 2017-01-31 Ebrahim Ansari , M. H. Sadreddini , Mostafa Sheikhalishahi , Richard Wallace , Fatemeh Alimardani

To solve deep metric learning problems and producing feature embeddings, current methodologies will commonly use a triplet model to minimise the relative distance between samples from the same class and maximise the relative distance…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Ben Harwood , Vijay Kumar B G , Gustavo Carneiro , Ian Reid , Tom Drummond

Recent approaches to cross-lingual word embedding have generally been based on linear transformations between the sets of embedding vectors in the two languages. In this paper, we propose an approach that instead expresses the two…

Computation and Language · Computer Science 2019-10-08 Chunting Zhou , Xuezhe Ma , Di Wang , Graham Neubig

Words have been represented in a high-dimensional vector space that encodes their semantic similarities, enabling downstream applications such as retrieving synonyms, antonyms, and relevant contexts. However, despite recent advances in…

Computation and Language · Computer Science 2024-09-25 Genta Indra Winata , Ruochen Zhang , David Ifeoluwa Adelani

In spite of the recent success of neural machine translation (NMT) in standard benchmarks, the lack of large parallel corpora poses a major practical problem for many language pairs. There have been several proposals to alleviate this issue…

Computation and Language · Computer Science 2018-02-27 Mikel Artetxe , Gorka Labaka , Eneko Agirre , Kyunghyun Cho

Parallel corpus is a critical resource in machine learning-based translation. The task of collecting, extracting, and aligning texts in order to build an acceptable corpus for doing the translation is very tedious most especially for…

Computation and Language · Computer Science 2021-11-01 Kristine Mae Adlaon , Nelson Marcos

Multilingual sentence representations from large models encode semantic information from two or more languages and can be used for different cross-lingual information retrieval and matching tasks. In this paper, we integrate contrastive…

Computation and Language · Computer Science 2023-05-02 Weiting Tan , Kevin Heffernan , Holger Schwenk , Philipp Koehn

Resources for the non-English languages are scarce and this paper addresses this problem in the context of machine translation, by automatically extracting parallel sentence pairs from the multilingual articles available on the Internet. In…

Computation and Language · Computer Science 2018-06-27 Sree Harsha Ramesh , Krishna Prasad Sankaranarayanan

Ensembling word embeddings to improve distributed word representations has shown good success for natural language processing tasks in recent years. These approaches either carry out straightforward mathematical operations over a set of…

Computation and Language · Computer Science 2018-08-14 James O' Neill , Danushka Bollegala

In this paper, we explore a simple solution to "Multi-Source Neural Machine Translation" (MSNMT) which only relies on preprocessing a N-way multilingual corpus without modifying the Neural Machine Translation (NMT) architecture or training…

Computation and Language · Computer Science 2019-03-05 Raj Dabre , Fabien Cromieres , Sadao Kurohashi

Neural machine translation (NMT) has arguably achieved human level parity when trained and evaluated at the sentence-level. Document-level neural machine translation has received less attention and lags behind its sentence-level…

Computation and Language · Computer Science 2020-03-12 Elman Mansimov , Gábor Melis , Lei Yu

Embeddings play an important role in end-to-end solutions for multi-modal language processing problems. Although there has been some effort to understand the properties of single-modality embedding spaces, particularly that of text, their…

Computation and Language · Computer Science 2023-01-20 Muhammad Huzaifah , Ivan Kukanov

Universal multimodal embedding models are foundational to various tasks. Existing approaches typically employ in-batch negative mining by measuring the similarity of query-candidate pairs. However, these methods often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Tiancheng Gu , Kaicheng Yang , Kaichen Zhang , Xiang An , Ziyong Feng , Yueyi Zhang , Weidong Cai , Jiankang Deng , Lidong Bing

Cross-lingual word vectors are typically obtained by fitting an orthogonal matrix that maps the entries of a bilingual dictionary from a source to a target vector space. Word vectors, however, are most commonly used for sentence or…

Computation and Language · Computer Science 2019-04-02 Hanan Aldarmaki , Mona Diab

We present a novel technique for zero-shot paraphrase generation. The key contribution is an end-to-end multilingual paraphrasing model that is trained using translated parallel corpora to generate paraphrases into "meaning spaces" --…

Computation and Language · Computer Science 2021-10-27 Monisha Jegadeesan , Sachin Kumar , John Wieting , Yulia Tsvetkov

Translation Quality Estimation is critical to reducing post-editing efforts in machine translation and to cross-lingual corpus cleaning. As a research problem, quality estimation (QE) aims to directly estimate the quality of translation in…

Computation and Language · Computer Science 2021-09-06 Mingjun Zhao , Haijiang Wu , Di Niu , Zixuan Wang , Xiaoli Wang

While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings have yet to be explored.…

Computation and Language · Computer Science 2022-03-09 Fangxiaoyu Feng , Yinfei Yang , Daniel Cer , Naveen Arivazhagan , Wei Wang

Text alignment and text quality are critical to the accuracy of Machine Translation (MT) systems, some NLP tools, and any other text processing tasks requiring bilingual data. This research proposes a language independent bi-sentence…

Computation and Language · Computer Science 2015-10-16 Krzysztof Wołk

Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-resource languages.…

Computation and Language · Computer Science 2021-04-20 Seiichiro Kondo , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

We test similarity-based word alignment models (SimAlign and awesome-align) in combination with word embeddings from mBERT and XLM-R on parallel sentences in German and Romansh. Since Romansh is an unseen language, we are dealing with a…

Computation and Language · Computer Science 2024-05-01 Eyal Liron Dolev