English
Related papers

Related papers: Morphology Generation for Statistical Machine Tran…

200 papers

One major deficiency of most semantic representation techniques is that they usually model a word type as a single point in the semantic space, hence conflating all the meanings that the word can have. Addressing this issue by learning…

Computation and Language · Computer Science 2016-08-08 Mohammad Taher Pilehvar , Nigel Collier

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

Computation and Language · Computer Science 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

Natural language generation models reproduce and often amplify the biases present in their training data. Previous research explored using sequence-to-sequence rewriting models to transform biased model outputs (or original texts) into more…

Computation and Language · Computer Science 2023-05-19 Chantal Amrhein , Florian Schottmann , Rico Sennrich , Samuel Läubli

Recent advances in neural methods have led to substantial improvement in the quality of Neural Machine Translation (NMT) systems. However, these systems frequently produce translations with inaccurate gender (Stanovsky et al., 2019), which…

Computation and Language · Computer Science 2023-11-29 Ranjita Naik , Spencer Rarrick , Vishal Chowdhary

This paper presents a joint model for performing unsupervised morphological analysis on words, and learning a character-level composition function from morphemes to word embeddings. Our model splits individual words into segments, and…

Computation and Language · Computer Science 2016-06-09 Kris Cao , Marek Rei

Contemporary deep learning models effectively handle languages with diverse morphology despite not being directly integrated into them. Morphology and word order are closely linked, with the latter incorporated into transformer-based models…

Computation and Language · Computer Science 2024-05-31 Poulami Ghosh , Shikhar Vashishth , Raj Dabre , Pushpak Bhattacharyya

Morphological classification is a key piece of information to define samples of galaxies aiming to study the large-scale structure of the universe. In essence, the challenge is to build up a robust methodology to perform a reliable…

Instrumentation and Methods for Astrophysics · Physics 2019-11-05 P. H. Barchi , R. R. de Carvalho , R. R. Rosa , R. Sautter , M. Soares-Santos , B. A. D. Marques , E. Clua , T. S. Gonçalves , C. de Sá-Freitas , T. C. Moura

Automatic morphological processing can aid downstream natural language processing applications, especially for low-resource languages, and assist language documentation efforts for endangered languages. Having long been multilingual, the…

Computation and Language · Computer Science 2022-03-18 Adam Wiemerslage , Miikka Silfverberg , Changbing Yang , Arya D. McCarthy , Garrett Nicolai , Eliana Colunga , Katharina Kann

Gender stereotypes are manifest in most of the world's languages and are consequently propagated or amplified by NLP systems. Although research has focused on mitigating gender stereotypes in English, the approaches that are commonly…

Computation and Language · Computer Science 2020-05-28 Ran Zmigrod , Sabrina J. Mielke , Hanna Wallach , Ryan Cotterell

Statistical machine translation models have made great progress in improving the translation quality. However, the existing models predict the target translation with only the source- and target-side local context information. In practice,…

Computation and Language · Computer Science 2015-03-02 Jiajun Zhang

In this work, we present an empirical study of generation order for machine translation. Building on recent advances in insertion-based modeling, we first introduce a soft order-reward framework that enables us to train models to follow…

Computation and Language · Computer Science 2019-10-30 William Chan , Mitchell Stern , Jamie Kiros , Jakob Uszkoreit

Dictionaries and phrase tables are the basis of modern statistical machine translation systems. This paper develops a method that can automate the process of generating and extending dictionaries and phrase tables. Our method can translate…

Computation and Language · Computer Science 2013-09-18 Tomas Mikolov , Quoc V. Le , Ilya Sutskever

Neural Machine Translation (NMT) has been shown to struggle with grammatical gender that is dependent on the gender of human referents, which can cause gender bias effects. Many existing approaches to this problem seek to control gender…

Computation and Language · Computer Science 2020-12-11 Danielle Saunders , Rosie Sallis , Bill Byrne

We propose a language-independent approach for improving statistical machine translation for morphologically rich languages using a hybrid morpheme-word representation where the basic unit of translation is the morpheme, but word boundaries…

Computation and Language · Computer Science 2019-11-20 Minh-Thang Luong , Preslav Nakov , Min-Yen Kan

Theoretical work in morphological typology offers the possibility of measuring morphological diversity on a continuous scale. However, literature in Natural Language Processing (NLP) typically labels a whole language with a strict type of…

Computation and Language · Computer Science 2022-05-09 Arturo Oncevay , Duygu Ataman , Niels van Berkel , Barry Haddow , Alexandra Birch , Johannes Bjerva

The successful application of neural methods to machine translation has realized huge quality advances for the community. With these improvements, many have noted outstanding challenges, including the modeling and treatment of gendered…

Computation and Language · Computer Science 2020-10-16 Hila Gonen , Kellie Webster

While multilingual large language models (LLMs) perform well on high-level tasks like translation and question answering, their ability to handle grammatical gender and morphological agreement remains underexplored. In morphologically rich…

Computation and Language · Computer Science 2026-04-22 Mehul Agarwal , Aditya Aggarwal , Arnav Goel , Medha Hira , Anubha Gupta

Neural machine translation (NMT) suffers a performance deficiency when a limited vocabulary fails to cover the source or target side adequately, which happens frequently when dealing with morphologically rich languages. To address this…

Computation and Language · Computer Science 2018-01-12 Kai Song , Yue Zhang , Min Zhang , Weihua Luo

Generating text from structured data is challenging because it requires bridging the gap between (i) structure and natural language (NL) and (ii) semantically underspecified input and fully specified NL output. Multilingual generation…

Computation and Language · Computer Science 2020-11-12 Angela Fan , Claire Gardent

The lack of parallel data for many language pairs is an important challenge to statistical machine translation (SMT). One common solution is to pivot through a third language for which there exist parallel corpora with the source and target…

Computation and Language · Computer Science 2016-09-13 Ahmed El Kholy , Nizar Habash