English
Related papers

Related papers: Zero-Shot Paraphrase Generation with Multilingual …

200 papers

While neural text-to-speech (TTS) has achieved human-like natural synthetic speech, multilingual TTS systems are limited to resource-rich languages due to the need for paired text and studio-quality audio data. This paper proposes a method…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Takaaki Saeki , Soumi Maiti , Xinjian Li , Shinji Watanabe , Shinnosuke Takamichi , Hiroshi Saruwatari

Existing question answering (QA) systems owe much of their success to large, high-quality training data. Such annotation efforts are costly, and the difficulty compounds in the cross-lingual setting. Therefore, prior cross-lingual QA work…

Computation and Language · Computer Science 2023-10-18 Bryan Li , Chris Callison-Burch

Multilingual neural machine translation can translate unseen language pairs during training, i.e. zero-shot translation. However, the zero-shot translation is always unstable. Although prior works attributed the instability to the…

Computation and Language · Computer Science 2022-09-12 Zhi Qu , Taro Watanabe

Paraphrase generation is a longstanding NLP task that has diverse applications for downstream NLP tasks. However, the effectiveness of existing efforts predominantly relies on large amounts of golden labeled data. Though unsupervised…

Computation and Language · Computer Science 2021-09-28 Kaize Ding , Dingcheng Li , Alexander Hanbo Li , Xing Fan , Chenlei Guo , Yang Liu , Huan Liu

Multilingual pre-trained language models (MPLMs) not only can handle tasks in different languages but also exhibit surprising zero-shot cross-lingual transferability. However, MPLMs usually are not able to achieve comparable supervised…

Computation and Language · Computer Science 2022-03-01 Ziqing Yang , Yiming Cui , Zhigang Chen , Shijin Wang

Targeted evaluations have found that machine translation systems often output incorrect gender, even when the gender is clear from context. Furthermore, these incorrectly gendered translations have the potential to reflect or amplify social…

Computation and Language · Computer Science 2021-04-19 Prafulla Kumar Choubey , Anna Currey , Prashant Mathur , Georgiana Dinu

Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. Many works have…

Computation and Language · Computer Science 2021-11-23 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa , Habeebah Adamu Kakudi , Ismaila Idris Sinan

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

Computation and Language · Computer Science 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan

We present ParaBank, a large-scale English paraphrase dataset that surpasses prior work in both quantity and quality. Following the approach of ParaNMT, we train a Czech-English neural machine translation (NMT) system to generate novel…

Computation and Language · Computer Science 2019-01-14 J. Edward Hu , Rachel Rudinger , Matt Post , Benjamin Van Durme

High-quality paraphrases are easy to produce using instruction-tuned language models or specialized paraphrasing models. Although this capability has a variety of benign applications, paraphrasing attacks$\unicode{x2013}$paraphrases applied…

Computation and Language · Computer Science 2025-03-21 Rafael Rivera Soto , Barry Chen , Nicholas Andrews

Large pre-trained language models have brought remarkable progress in NLP. Pre-training and Fine-tuning have given state-of-art performance across tasks in text processing. Data Augmentation techniques have also helped build state-of-art…

Computation and Language · Computer Science 2022-10-04 Kshitij Gupta

Paraphrase generation is a longstanding important problem in natural language processing. In addition, recent progress in deep generative models has shown promising results on discrete latent variables for text generation. Inspired by…

Computation and Language · Computer Science 2020-01-08 Yao Fu , Yansong Feng , John P. Cunningham

Cross-lingual entity linking maps an entity mention in a source language to its corresponding entry in a structured knowledge base that is in a different (target) language. While previous work relies heavily on bilingual lexical resources…

Computation and Language · Computer Science 2018-11-13 Shruti Rijhwani , Jiateng Xie , Graham Neubig , Jaime Carbonell

We propose a simple method to align multilingual contextual embeddings as a post-pretraining step for improved zero-shot cross-lingual transferability of the pretrained models. Using parallel data, our method aligns embeddings on the word…

Computation and Language · Computer Science 2021-04-13 Lin Pan , Chung-Wei Hang , Haode Qi , Abhishek Shah , Saloni Potdar , Mo Yu

Acquiring training data to improve the robustness of dialog systems can be a painstakingly long process. In this work, we propose a method to reduce the cost and effort of creating new conversational agents by artificially generating more…

Computation and Language · Computer Science 2022-05-05 Louis Marceau , Raouf Belbahar , Marc Queudot , Nada Naji , Eric Charton , Marie-Jean Meurs

Paraphrase generation is an important task in natural language processing. Previous works focus on sentence-level paraphrase generation, while ignoring document-level paraphrase generation, which is a more challenging and valuable task. In…

Computation and Language · Computer Science 2021-09-16 Zhe Lin , Yitao Cai , Xiaojun Wan

This paper studies zero-shot cross-lingual transfer of vision-language models. Specifically, we focus on multilingual text-to-video search and propose a Transformer-based model that learns contextualized multilingual multimodal embeddings.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Po-Yao Huang , Mandela Patrick , Junjie Hu , Graham Neubig , Florian Metze , Alexander Hauptmann

Keyphrase provides highly-condensed information that can be effectively used for understanding, organizing and retrieving text content. Though previous studies have provided many workable solutions for automated keyphrase extraction, they…

Computation and Language · Computer Science 2021-06-02 Rui Meng , Sanqiang Zhao , Shuguang Han , Daqing He , Peter Brusilovsky , Yu Chi

Zero-shot cross-lingual knowledge transfer enables the multilingual pretrained language model (mPLM), finetuned on a task in one language, make predictions for this task in other languages. While being broadly studied for natural language…

Computation and Language · Computer Science 2024-04-23 Nadezhda Chirkova , Sheng Liang , Vassilina Nikoulina

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang