English
Related papers

Related papers: Zero-Shot Translation Quality Estimation with Expl…

200 papers

End-to-end speech-to-speech translation (S2ST) systems typically struggle with a critical data bottleneck: the scarcity of parallel speech-to-speech corpora. To overcome this, we introduce RosettaSpeech, a novel zero-shot framework trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-17 Zhisheng Zheng , Xiaohang Sun , Tuan Dinh , Abhishek Yanamandra , Abhinav Jain , Zhu Liu , Sunil Hadap , Vimal Bhat , Manoj Aggarwal , Gerard Medioni , David Harwath

Linear embedding transformation has been shown to be effective for zero-shot cross-lingual transfer tasks and achieve surprisingly promising results. However, cross-lingual embedding space mapping is usually studied in static word-level…

Computation and Language · Computer Science 2021-09-08 Haoran Xu , Philipp Koehn

Because it is not feasible to collect training data for every language, there is a growing interest in cross-lingual transfer learning. In this paper, we systematically explore zero-shot cross-lingual transfer learning on reading…

Computation and Language · Computer Science 2019-09-23 Tsung-yuan Hsu , Chi-liang Liu , Hung-yi Lee

Multilingual neural machine translation can translate unseen language pairs during training, i.e. zero-shot translation. However, the zero-shot translation is always unstable. Although prior works attributed the instability to the…

Computation and Language · Computer Science 2022-09-12 Zhi Qu , Taro Watanabe

This paper addresses automatic quality assessment of spoken language translation (SLT). This relatively new task is defined and formalized as a sequence labeling problem where each word in the SLT hypothesis is tagged as good or bad…

Computation and Language · Computer Science 2016-10-02 Ngoc-Tien Le , Benjamin Lecouteux , Laurent Besacier

Cross-lingual word embeddings (CLWE) have been proven useful in many cross-lingual tasks. However, most existing approaches to learn CLWE including the ones with contextual embeddings are sense agnostic. In this work, we propose a novel…

Computation and Language · Computer Science 2022-09-16 Linlin Liu , Thien Hai Nguyen , Shafiq Joty , Lidong Bing , Luo Si

Evaluation of cross-lingual encoders is usually performed either via zero-shot cross-lingual transfer in supervised downstream tasks or via unsupervised cross-lingual textual similarity. In this paper, we concern ourselves with…

Computation and Language · Computer Science 2020-06-09 Wei Zhao , Goran Glavaš , Maxime Peyrard , Yang Gao , Robert West , Steffen Eger

We describe the Universitat d'Alacant submissions to the word- and sentence-level machine translation (MT) quality estimation (QE) shared task at WMT 2018. Our approach to word-level MT QE builds on previous work to mark the words in the…

Computation and Language · Computer Science 2018-11-07 Miquel Esplà-Gomis , Felipe Sánchez-Martínez , Mikel L. Forcada

While neural networks have shown impressive performance on large datasets, applying these models to tasks where little data is available remains a challenging problem. In this paper we propose to use feature transfer in a zero-shot…

Computation and Language · Computer Science 2018-08-30 Javid Dadashkarimi , Alexander Fabbri , Sekhar Tatikonda , Dragomir R. Radev

Reinforcement learning algorithms such as Q-learning have shown great promise in training models to learn the optimal action to take for a given system state; a goal in applications with an exploratory or adversarial nature such as…

Computation and Language · Computer Science 2020-04-08 Xusen Yin , Jonathan May

Traditionally, Machine Translation (MT) Evaluation has been treated as a regression problem -- producing an absolute translation-quality score. This approach has two limitations: i) the scores lack interpretability, and human annotators…

Computation and Language · Computer Science 2024-01-31 Ibraheem Muhammad Moosa , Rui Zhang , Wenpeng Yin

Recent research has shown that independently trained encoders and decoders, combined through a shared fixed-size representation, can achieve competitive performance in speech-to-text translation. In this work, we show that this type of…

Computation and Language · Computer Science 2023-10-09 Paul-Ambroise Duquenne , Holger Schwenk , Benoît Sagot

Quality Estimation (QE) aims to assess the quality of machine translation (MT) outputs without relying on reference translations, making it essential for real-world, large-scale MT evaluation. Large Language Models (LLMs) have shown…

Computation and Language · Computer Science 2026-02-10 Archchana Sindhujan , Girish A. Koushik , Shenbin Qian , Diptesh Kanojia , Constantin Orăsan

Choosing an appropriate tokenization scheme is often a bottleneck in low-resource cross-lingual transfer. To understand the downstream implications of text representation choices, we perform a comparative analysis on language models having…

Computation and Language · Computer Science 2023-10-13 Md Mushfiqur Rahman , Fardin Ahsan Sakib , Fahim Faisal , Antonios Anastasopoulos

In this paper, we present our submission to the sentence-level MQM benchmark at Quality Estimation Shared Task, named UniTE (Unified Translation Evaluation). Specifically, our systems employ the framework of UniTE, which combined three…

Computation and Language · Computer Science 2023-02-20 Keqin Bao , Yu Wan , Dayiheng Liu , Baosong Yang , Wenqiang Lei , Xiangnan He , Derek F. Wong , Jun Xie

Pre-trained multilingual language models show significant performance gains for zero-shot cross-lingual model transfer on a wide range of natural language understanding (NLU) tasks. Previously, for zero-shot cross-lingual evaluation,…

Computation and Language · Computer Science 2022-12-14 Lifu Tu , Caiming Xiong , Yingbo Zhou

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang

Zero-shot translation is a promising direction for building a comprehensive multilingual neural machine translation~(MNMT) system. However, its quality is still not satisfactory due to off-target issues. In this paper, we aim to understand…

Computation and Language · Computer Science 2024-10-22 Wenxuan Wang , Wenxiang Jiao , Shuo Wang , Zhaopeng Tu , Michael R. Lyu

The ability of zero-shot translation emerges when we train a multilingual model with certain translation directions; the model can then directly translate in unseen directions. Alternatively, zero-shot translation can be accomplished by…

Computation and Language · Computer Science 2025-02-07 Yuqiao Wen , Behzad Shayegh , Chenyang Huang , Yanshuai Cao , Lili Mou

Zero-shot In-context learning is the phenomenon where models can perform the task simply given the instructions. However, pre-trained large language models are known to be poorly calibrated for this task. One of the most effective…

Computation and Language · Computer Science 2024-04-04 Suzanna Sia , Alexandra DeLucia , Kevin Duh