English
Related papers

Related papers: Data Augmentation for Voice-Assistant NLU using BE…

200 papers

The field of Natural Language Processing which involves the use of artificial intelligence to support human languages has seen tremendous growth due to its high-quality features. Its applications such as language translation, chatbots,…

Computation and Language · Computer Science 2023-11-14 Sujan Poudel , Nabin Ghimire , Bipesh Subedi , Saugat Singh

With the advances in deep learning, speech enhancement systems benefited from large neural network architectures and achieved state-of-the-art quality. However, speaker-agnostic methods are not always desirable, both in terms of quality and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Anastasia Kuznetsova , Aswin Sivaraman , Minje Kim

This paper describes two novel complementary techniques that improve the detection of lexical stress errors in non-native (L2) English speech: attention-based feature extraction and data augmentation based on Neural Text-To-Speech (TTS). In…

We propose a simple and effective strategy for data augmentation for low-resource machine reading comprehension (MRC). Our approach first pretrains the answer extraction components of a MRC system on the augmented data that contains…

Computation and Language · Computer Science 2021-06-09 Hoang Van , Vikas Yadav , Mihai Surdeanu

Query rewriting (QR) systems are widely used to reduce the friction caused by errors in a spoken language understanding pipeline. However, the underlying supervised models require a large number of labeled pairs, and these pairs are hard…

Computation and Language · Computer Science 2020-12-22 Yunmo Chen , Sixing Lu , Fan Yang , Xiaojiang Huang , Xing Fan , Chenlei Guo

Building the Natural Language Understanding (NLU) modules of task-oriented Spoken Dialogue Systems (SDS) involves a definition of intents and entities, collection of task-relevant data, annotating the data with intents and entities, and…

Computation and Language · Computer Science 2021-05-13 Saurav Sahay , Eda Okur , Nagib Hakim , Lama Nachman

Text-only and semi-supervised training based on audio-only data has gained popularity recently due to the wide availability of unlabeled text and speech data. In this work, we propose incorporating text-only and semi-supervised training…

Computation and Language · Computer Science 2022-06-30 Ke Hu , Tara N. Sainath , Yanzhang He , Rohit Prabhavalkar , Trevor Strohman , Sepand Mavandadi , Weiran Wang

We explore advanced fine-tuning techniques to boost BERT's performance in sentiment analysis, paraphrase detection, and semantic textual similarity. Our approach leverages SMART regularization to combat overfitting, improves hyperparameter…

Computation and Language · Computer Science 2024-07-22 Pradyumna Saligram , Andrew Lanpouthakoun

This paper presents a novel data augmentation technique for text-to-speech (TTS), that allows to generate new (text, audio) training examples without requiring any additional data. Our goal is to increase diversity of text conditionings…

This paper focuses on the Data Augmentation for low-resource Natural Language Understanding (NLU) tasks. We propose Prompt-based D}ata Augmentation model (PromDA) which only trains small-scale Soft Prompt (i.e., a set of trainable vectors)…

Computation and Language · Computer Science 2022-03-18 Yufei Wang , Can Xu , Qingfeng Sun , Huang Hu , Chongyang Tao , Xiubo Geng , Daxin Jiang

Machine reading comprehension with unanswerable questions is a challenging task. In this work, we propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerable question paired…

Computation and Language · Computer Science 2019-06-17 Haichao Zhu , Li Dong , Furu Wei , Wenhui Wang , Bing Qin , Ting Liu

In low resource settings, data augmentation strategies are commonly leveraged to improve performance. Numerous approaches have attempted document-level augmentation (e.g., text classification), but few studies have explored token-level…

Computation and Language · Computer Science 2022-10-04 Arie Pratama Sutiono , Gus Hahn-Powell

Incremental processing allows interactive systems to respond based on partial inputs, which is a desirable property e.g. in dialogue agents. The currently popular Transformer architecture inherently processes sequences as a whole,…

Computation and Language · Computer Science 2024-05-03 Patrick Kahardipraja , Brielen Madureira , David Schlangen

The growing interest in argument mining and computational argumentation brings with it a plethora of Natural Language Understanding (NLU) tasks and corresponding datasets. However, as with many other NLU tasks, the dominant language is…

Computation and Language · Computer Science 2020-10-14 Orith Toledo-Ronen , Matan Orbach , Yonatan Bilu , Artem Spector , Noam Slonim

Spoken Language Understanding (SLU) converts user utterances into structured semantic representations. Data sparsity is one of the main obstacles of SLU due to the high cost of human annotation, especially when domain changes or a new…

Computation and Language · Computer Science 2019-08-29 Zijian Zhao , Su Zhu , Kai Yu

Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Zengrui Jin , Xurong Xie , Tianzi Wang , Mengzhe Geng , Jiajun Deng , Guinan Li , Shujie Hu , Xunying Liu

Text augmentation is a technique for constructing synthetic data from an under-resourced corpus to improve predictive performance. Synthetic data generation is common in numerous domains. However, recently text augmentation has emerged in…

Computation and Language · Computer Science 2023-09-12 Mosleh Mahamud , Zed Lee , Isak Samsten

Data augmentation (DA) has played a pivotal role in the success of deep speaker recognition. Current DA techniques primarily focus on speaker-preserving augmentation, which does not change the speaker trait of the speech and does not create…

Sound · Computer Science 2024-06-12 Zhenyu Zhou , Shibiao Xu , Shi Yin , Lantian Li , Dong Wang

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

We propose a method for joint multichannel speech dereverberation with two spatial-aware tasks: direction-of-arrival (DOA) estimation and speech separation. The proposed method addresses involved tasks as a sequence to sequence mapping…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Yang Jiao