English
Related papers

Related papers: Zero-Shot Joint Modeling of Multiple Spoken-Text-S…

200 papers

We introduce the task of zero-shot style transfer between different languages. Our training data includes multilingual parallel corpora, but does not contain any parallel sentences between styles, similarly to the recent previous work. We…

Computation and Language · Computer Science 2018-08-02 Elizaveta Korotkova , Maksym Del , Mark Fishel

Both grammatical error correction and text style transfer can be viewed as monolingual sequence-to-sequence transformation tasks, but the scarcity of directly annotated data for either task makes them unfeasible for most languages. We…

Computation and Language · Computer Science 2019-10-23 Elizaveta Korotkova , Agnes Luhtaru , Maksym Del , Krista Liin , Daiga Deksne , Mark Fishel

Speech Translation (ST) is the task of translating speech in one language into text in another language. Traditional cascaded approaches for ST, using Automatic Speech Recognition (ASR) and Machine Translation (MT) systems, are prone to…

Computation and Language · Computer Science 2021-07-14 Tu Anh Dinh

Zero-shot transfer learning for dialogue state tracking (DST) enables us to handle a variety of task-oriented dialogue domains without the expense of collecting in-domain data. In this work, we propose to transfer the \textit{cross-task}…

Computation and Language · Computer Science 2021-09-13 Zhaojiang Lin , Bing Liu , Andrea Madotto , Seungwhan Moon , Paul Crook , Zhenpeng Zhou , Zhiguang Wang , Zhou Yu , Eunjoon Cho , Rajen Subba , Pascale Fung

Massively Multilingual Transformer based Language Models have been observed to be surprisingly effective on zero-shot transfer across languages, though the performance varies from language to language depending on the pivot language(s) used…

Computation and Language · Computer Science 2022-05-13 Kabir Ahuja , Shanu Kumar , Sandipan Dandapat , Monojit Choudhury

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang

Voice style transfer, also called voice conversion, seeks to modify one speaker's voice to generate speech as if it came from another (target) speaker. Previous works have made progress on voice conversion with parallel training data and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-18 Siyang Yuan , Pengyu Cheng , Ruiyi Zhang , Weituo Hao , Zhe Gan , Lawrence Carin

Recently, data-driven task-oriented dialogue systems have achieved promising performance in English. However, developing dialogue systems that support low-resource languages remains a long-standing challenge due to the absence of…

Computation and Language · Computer Science 2019-11-22 Zihan Liu , Genta Indra Winata , Zhaojiang Lin , Peng Xu , Pascale Fung

We present a new approach to perform zero-shot cross-modal transfer between speech and text for translation tasks. Multilingual speech and text are encoded in a joint fixed-size representation space. Then, we compare different approaches to…

Computation and Language · Computer Science 2022-11-11 Paul-Ambroise Duquenne , Hongyu Gong , Benoît Sagot , Holger Schwenk

Low resource of parallel data is the key challenge of accent conversion(AC) problem in which both the pronunciation units and prosody pattern need to be converted. We propose a two-stage generative framework "convert-and-speak" in which the…

Sound · Computer Science 2024-08-23 Zhijun Jia , Huaying Xue , Xiulian Peng , Yan Lu

Zero-shot transfer learning for Dialogue State Tracking (DST) helps to handle a variety of task-oriented dialogue domains without the cost of collecting in-domain data. Existing works mainly study common data- or model-level augmentation…

Computation and Language · Computer Science 2023-06-02 Qingyue Wang , Liang Ding , Yanan Cao , Yibing Zhan , Zheng Lin , Shi Wang , Dacheng Tao , Li Guo

Despite the surging demands for multilingual task-oriented dialog systems (e.g., Alexa, Google Home), there has been less research done in multilingual or cross-lingual scenarios. Hence, we propose a zero-shot adaptation of task-oriented…

Computation and Language · Computer Science 2019-11-12 Zihan Liu , Jamin Shin , Yan Xu , Genta Indra Winata , Peng Xu , Andrea Madotto , Pascale Fung

Voice Conversion research in recent times has increasingly focused on improving the zero-shot capabilities of existing methods. Despite remarkable advancements, current architectures still tend to struggle in zero-shot cross-lingual…

Sound · Computer Science 2025-05-26 Advait Joglekar , Divyanshu Singh , Rooshil Rohit Bhatia , S. Umesh

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

Recent advancements in NLP have resulted in models with specialized strengths, such as processing multimodal inputs or excelling in specific domains. However, real-world tasks, like multimodal translation, often require a combination of…

Computation and Language · Computer Science 2024-11-05 Sai Koneru , Matthias Huck , Miriam Exel , Jan Niehues

Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a consequence of implicit multitask learning in language…

Task-oriented personal assistants enable people to interact with a host of devices and services using natural language. One of the challenges of making neural dialogue systems available to more users is the lack of training data for all but…

Computation and Language · Computer Science 2022-03-21 Milan Gritta , Ruoyu Hu , Ignacio Iacobacci

Conventional text style transfer approaches focus on sentence-level style transfer without considering contextual information, and the style is described with attributes (e.g., formality). When applying style transfer in conversations such…

Computation and Language · Computer Science 2023-09-25 Shamik Roy , Raphael Shu , Nikolaos Pappas , Elman Mansimov , Yi Zhang , Saab Mansour , Dan Roth

Text-to-speech (TTS) systems that scale up the amount of training data have achieved significant improvements in zero-shot speech synthesis. However, these systems have certain limitations: they require a large amount of training data,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-07 Taejun Bak , Youngsik Eom , SeungJae Choi , Young-Sun Joo

Previous zero-shot dialogue state tracking (DST) methods only apply transfer learning, ignoring unlabelled data in the target domain. We transform zero-shot DST into few-shot DST by utilising such unlabelled data via joint and self-training…

Computation and Language · Computer Science 2024-04-04 Chuang Li , Yan Zhang , Min-Yen Kan , Haizhou Li
‹ Prev 1 2 3 10 Next ›