English
Related papers

Related papers: Mixup Decoding for Diverse Machine Translation

200 papers

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2023-05-10 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Neural machine translation (NMT) often makes mistakes in translating low-frequency content words that are essential to understanding the meaning of the sentence. We propose a method to alleviate this problem by augmenting NMT systems with…

Computation and Language · Computer Science 2016-10-06 Philip Arthur , Graham Neubig , Satoshi Nakamura

Round-trip Machine Translation (MT) is a popular choice for paraphrase generation, which leverages readily available parallel corpora for supervision. In this paper, we formalize the implicit similarity function induced by this approach,…

Computation and Language · Computer Science 2023-05-24 Aitor Ormazabal , Mikel Artetxe , Aitor Soroa , Gorka Labaka , Eneko Agirre

Mixup is a widely adopted strategy for training deep networks, where additional samples are augmented by interpolating inputs and labels of training pairs. Mixup has shown to improve classification performance, network calibration, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Thomas Mensink , Pascal Mettes

Mixup is a popular data augmentation technique for training deep neural networks where additional samples are generated by linearly interpolating pairs of inputs and their labels. This technique is known to improve the generalization…

Machine Learning · Computer Science 2023-10-17 Yingtian Zou , Vikas Verma , Sarthak Mittal , Wai Hoh Tang , Hieu Pham , Juho Kannala , Yoshua Bengio , Arno Solin , Kenji Kawaguchi

Translation is important for cross-language communication, and many efforts have been made to improve its accuracy. However, less investment is conducted in aligning translations with human preferences, such as translation tones or styles.…

Computation and Language · Computer Science 2024-10-16 Shuqiao Sun , Yutong Yao , Peiwen Wu , Feijun Jiang , Kaifu Zhang

Math Word Problem (MWP) solving is a critical task in natural language processing, has garnered significant research interest in recent years. Various recent studies heavily rely on Seq2Seq models and their extensions (e.g., Seq2Tree and…

Computation and Language · Computer Science 2025-01-08 Yi Zhang , Guangyou Zhou , Zhiwen Xie , Jinjin Ma , Jimmy Xiangji Huang

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Yet, its extensions focus on the definition of interpolation and the space where it takes place, while the…

Machine Learning · Computer Science 2022-07-01 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various…

Computation and Language · Computer Science 2024-02-26 Jingpu Yang , Zehua Han , Mengyu Xiang , Helin Wang , Yuxiao Huang , Miao Fang

While large language models demonstrate remarkable capabilities at task-specific applications through fine-tuning, extending these benefits across diverse languages is essential for broad accessibility. However, effective cross-lingual…

Computation and Language · Computer Science 2025-06-03 Danni Liu , Jan Niehues

Trainable evaluation metrics for machine translation (MT) exhibit strong correlation with human judgements, but they are often hard to interpret and might produce unreliable scores under noisy or out-of-domain data. Recent work has…

Computation and Language · Computer Science 2022-12-01 Chrysoula Zerva , Taisiya Glushkova , Ricardo Rei , André F. T. Martins

This work presents methods for learning cross-lingual sentence representations using paired or unpaired bilingual texts. We hypothesize that the cross-lingual alignment strategy is transferable, and therefore a model trained to align only…

Computation and Language · Computer Science 2022-03-17 Chih-chan Tien , Shane Steinert-Threlkeld

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of translation knowledge transfer (transfer…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Machine translation (MT) plays an important role in benefiting linguists, sociologists, computer scientists, etc. by processing natural language to translate it into some other natural language. And this demand has grown exponentially over…

Computation and Language · Computer Science 2019-01-07 Ankush Garg , Mayank Agarwal

Existing machine translation decoding algorithms generate translations in a strictly monotonic fashion and never revisit previous decisions. As a result, earlier mistakes cannot be corrected at a later stage. In this paper, we present a…

Computation and Language · Computer Science 2018-04-17 Roman Novak , Michael Auli , David Grangier

Existing models of multilingual sentence embeddings require large parallel data resources which are not available for low-resource languages. We propose a novel unsupervised method to derive multilingual sentence embeddings relying only on…

Computation and Language · Computer Science 2021-05-24 Ivana Kvapilıkova , Mikel Artetxe , Gorka Labaka , Eneko Agirre , Ondřej Bojar

Neural translation models have proven to be effective in capturing sufficient information from a source sentence and generating a high-quality target sentence. However, it is not easy to get the best effect for bidirectional translation,…

Computation and Language · Computer Science 2020-11-25 Parnia Bahar , Christopher Brix , Hermann Ney

Finding well-defined clusters in data represents a fundamental challenge for many data-driven applications, and largely depends on good data representation. Drawing on literature regarding representation learning, studies suggest that one…

Machine Learning · Computer Science 2020-11-05 Daniel Lutscher , Ali el Hassouni , Maarten Stol , Mark Hoogendoorn

Multimodal sentiment analysis is a core research area that studies speaker sentiment expressed from the language, visual, and acoustic modalities. The central challenge in multimodal learning involves inferring joint representations that…

Machine Learning · Computer Science 2020-03-02 Hai Pham , Paul Pu Liang , Thomas Manzini , Louis-Philippe Morency , Barnabas Poczos

Mixup generates augmented samples by linearly interpolating inputs and labels with a controllable ratio. However, since it operates in the latent embedding level, the resulting samples are not human-interpretable. In contrast, LLM-based…

Computation and Language · Computer Science 2026-02-09 Fanshuang Kong , Richong Zhang , Qiyu Sun , Zhijie Nie , Ting Deng , Chunming Hu