English
Related papers

Related papers: Automatic Discovery of Non-Compositional Compounds…

200 papers

Neural Machine Translation (NMT) has been proven to achieve impressive results. The NMT system translation results depend strongly on the size and quality of parallel corpora. Nevertheless, for many language pairs, no rich-resource parallel…

Computation and Language · Computer Science 2019-05-23 Jinyi Zhang , Tadahiro Matsumoto

Parallel sentence extraction is a task addressing the data sparsity problem found in multilingual natural language processing applications. We propose an end-to-end deep neural network approach to detect translational equivalence between…

Computation and Language · Computer Science 2017-09-29 Francis Grégoire , Philippe Langlais

Recognizing that even correct translations are not always semantically equivalent, we automatically detect meaning divergences in parallel sentence pairs with a deep neural model of bilingual semantic similarity which can be trained for any…

Computation and Language · Computer Science 2018-03-30 Yogarshi Vyas , Xing Niu , Marine Carpuat

Conventional neural machine translation (NMT) models typically use subwords and words as the basic units for model input and comprehension. However, complete words and phrases composed of several tokens are often the fundamental units for…

Computation and Language · Computer Science 2023-10-18 Langlin Huang , Shuhao Gu , Zhuocheng Zhang , Yang Feng

Neural Machine Translation (NMT) has become the new state-of-the-art in several language pairs. However, it remains a challenging problem how to integrate NMT with a bilingual dictionary which mainly contains words rarely or never seen in…

Computation and Language · Computer Science 2016-10-25 Jiajun Zhang , Chengqing Zong

Dictionaries and phrase tables are the basis of modern statistical machine translation systems. This paper develops a method that can automate the process of generating and extending dictionaries and phrase tables. Our method can translate…

Computation and Language · Computer Science 2013-09-18 Tomas Mikolov , Quoc V. Le , Ilya Sutskever

Thai is a low-resource language, so it is often the case that data is not available in sufficient quantities to train an Neural Machine Translation (NMT) model which perform to a high level of quality. In addition, the Thai script does not…

Computation and Language · Computer Science 2020-04-27 Alberto Poncelas , Wichaya Pidchamook , Chao-Hong Liu , James Hadley , Andy Way

Neural machine translation (NMT) often makes mistakes in translating low-frequency content words that are essential to understanding the meaning of the sentence. We propose a method to alleviate this problem by augmenting NMT systems with…

Computation and Language · Computer Science 2016-10-06 Philip Arthur , Graham Neubig , Satoshi Nakamura

Recognizing semantically similar sentences or paragraphs across languages is beneficial for many tasks, ranging from cross-lingual information retrieval and plagiarism detection to machine translation. Recently proposed methods for…

Computation and Language · Computer Science 2018-01-22 Goran Glavaš , Marc Franco-Salvador , Simone Paolo Ponzetto , Paolo Rosso

End-to-end neural machine translation has overtaken statistical machine translation in terms of translation quality for some language pairs, specially those with large amounts of parallel data. Besides this palpable improvement, neural…

Computation and Language · Computer Science 2017-11-16 Cristina España-Bonet , Ádám Csaba Varga , Alberto Barrón-Cedeño , Josef van Genabith

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

Computation and Language · Computer Science 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

Recent Large Language Models (LLMs) have demonstrated remarkable capabilities in generating text that closely resembles human writing across wide range of styles and genres. However, such capabilities are prone to potential abuse, such as…

Computation and Language · Computer Science 2023-11-09 Harika Abburi , Kalyani Roy , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

Word alignments are useful for tasks like statistical and neural machine translation (NMT) and cross-lingual annotation projection. Statistical word aligners perform well, as do methods that extract alignments jointly with translations in…

Computation and Language · Computer Science 2021-04-19 Masoud Jalili Sabet , Philipp Dufter , François Yvon , Hinrich Schütze

We learn a joint multilingual sentence embedding and use the distance between sentences in different languages to filter noisy parallel data and to mine for parallel data in large news collections. We are able to improve a competitive…

Computation and Language · Computer Science 2018-05-28 Holger Schwenk

We propose a segmental neural language model that combines the generalization power of neural networks with the ability to discover word-like units that are latent in unsegmented character sequences. In contrast to previous segmentation…

Computation and Language · Computer Science 2019-06-19 Kazuya Kawakami , Chris Dyer , Phil Blunsom

Objective: Today's neural machine translation (NMT) can achieve near human-level translation quality and greatly facilitates international communications, but the lack of parallel corpora poses a key problem to the development of…

Computation and Language · Computer Science 2022-02-08 Shengxuan Luo , Huaiyuan Ying , Jiao Li , Sheng Yu

The goal of universal machine translation is to learn to translate between any pair of languages, given a corpus of paired translated documents for \emph{a small subset} of all pairs of languages. Despite impressive empirical results and an…

Machine Learning · Computer Science 2020-08-12 Han Zhao , Junjie Hu , Andrej Risteski

Texts and their translations are a rich linguistic resource that can be used to train and test statistics-based Machine Translation systems and many other applications. In this paper, we present a working system that can identify…

Computation and Language · Computer Science 2007-05-23 Bruno Pouliquen , Ralf Steinberger , Camelia Ignat

An approximate textual retrieval algorithm for searching sources with high levels of defects is presented. It considers splitting the words in a query into two overlapping segments and subsequently building composite regular expressions…

Information Retrieval · Computer Science 2007-05-23 Pere Constans