English
Related papers

Related papers: AuGPT: Auxiliary Tasks and Data Augmentation for E…

200 papers

A major bottleneck for building statistical spoken dialogue systems for new domains and applications is the need for large amounts of training data. To address this problem, we adopt the multi-dimensional approach to dialogue management and…

Computation and Language · Computer Science 2022-04-15 Simon Keizer , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

Dialogue understanding tasks often necessitate abundant annotated data to achieve good performance and that presents challenges in low-resource settings. To alleviate this barrier, we explore few-shot data augmentation for dialogue…

Computation and Language · Computer Science 2022-11-03 Maximillian Chen , Alexandros Papangelis , Chenyang Tao , Andy Rosenbaum , Seokhwan Kim , Yang Liu , Zhou Yu , Dilek Hakkani-Tur

While Large Language Models (LLMs) have made significant strides in replicating human-like abilities, there are concerns about a reduction in the linguistic diversity of their outputs. This results in the homogenization of viewpoints and…

Computation and Language · Computer Science 2024-12-05 Long Mai , Julie Carson-Berndsen

Deep learning models have demonstrated superior performance in various healthcare applications. However, the major limitation of these deep models is usually the lack of high-quality training data due to the private and sensitive nature of…

Computation and Language · Computer Science 2022-11-15 Qiuhao Lu , Dejing Dou , Thien Huu Nguyen

Traditional end-to-end task-oriented dialogue systems have been built with a modularized design. However, such design often causes misalignment between the agent response and external knowledge, due to inadequate representation of…

Computation and Language · Computer Science 2023-05-24 Qingyang Wu , Deema Alnuhait , Derek Chen , Zhou Yu

Recently, mT5 - a massively multilingual version of T5 - leveraged a unified text-to-text format to attain state-of-the-art results on a wide variety of multilingual NLP tasks. In this paper, we investigate the impact of incorporating…

Computation and Language · Computer Science 2021-06-07 Mihir Kale , Aditya Siddhant , Noah Constant , Melvin Johnson , Rami Al-Rfou , Linting Xue

Previous work on speaker adaptation for end-to-end speech synthesis still falls short in speaker similarity. We investigate an orthogonal approach to the current speaker adaptation paradigms, speaker augmentation, by creating artificial…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Erica Cooper , Cheng-I Lai , Yusuke Yasuda , Junichi Yamagishi

In a dialog, there can be multiple valid next utterances at any point. The present end-to-end neural methods for dialog do not take this into account. They learn with the assumption that at any time there is only one correct next utterance.…

Computation and Language · Computer Science 2018-08-31 Janarthanan Rajendran , Jatin Ganhotra , Satinder Singh , Lazaros Polymenakos

Data-to-text generation is challenging due to the great variety of the input data in terms of domains (e.g., finance vs sports) or schemata (e.g., diverse predicates). Recent end-to-end neural methods thus require substantial training…

Computation and Language · Computer Science 2023-05-24 Jiannan Xiang , Zhengzhong Liu , Yucheng Zhou , Eric P. Xing , Zhiting Hu

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large…

Computation and Language · Computer Science 2023-03-29 Jakub Macina , Nico Daheim , Lingzhi Wang , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

The NOESIS II challenge, as the Track 2 of the 8th Dialogue System Technology Challenges (DSTC 8), is the extension of DSTC 7. This track incorporates new elements that are vital for the creation of a deployed task-oriented dialogue system.…

Computation and Language · Computer Science 2020-04-07 Jia-Chen Gu , Tianda Li , Quan Liu , Xiaodan Zhu , Zhen-Hua Ling , Yu-Ping Ruan

Non-task-oriented dialog models suffer from poor quality and non-diverse responses. To overcome limited conversational data, we apply Simulated Multiple Reference Training (SMRT; Khayrallah et al., 2020), and use a paraphraser to simulate…

Computation and Language · Computer Science 2021-04-23 Huda Khayrallah , João Sedoc

Large Language Models (LLMs) have demonstrated superior abilities in tasks such as chatting, reasoning, and question-answering. However, standard LLMs may ignore crucial paralinguistic information, such as sentiment, emotion, and speaking…

In recent years, neural models learned through self-supervised pretraining on large scale multilingual text or speech data have exhibited promising results for underresourced languages, especially when a relatively large amount of data from…

Computation and Language · Computer Science 2023-01-19 Karol Nowakowski , Michal Ptaszynski , Kyoko Murasaki , Jagna Nieuważny

Pre-trained language models (PrLM) has been shown powerful in enhancing a broad range of downstream tasks including various dialogue related ones. However, PrLMs are usually trained on general plain text with common language model (LM)…

Computation and Language · Computer Science 2021-08-03 Yi Xu , Hai Zhao

Building a persona-based conversation agent is challenging owing to the lack of large amounts of speaker-specific conversation data for model training. This paper addresses the problem by proposing a multi-task learning approach to training…

Computation and Language · Computer Science 2017-10-23 Yi Luan , Chris Brockett , Bill Dolan , Jianfeng Gao , Michel Galley

Multi-turn dialogues are characterized by their extended length and the presence of turn-taking conversations. Traditional language models often overlook the distinct features of these dialogues by treating them as regular text. In this…

Computation and Language · Computer Science 2024-02-01 Sangwoo Cho , Kaiqiang Song , Chao Zhao , Xiaoyang Wang , Dong Yu

The design of better automated dialogue evaluation metrics offers the potential of accelerate evaluation research on conversational AI. However, existing trainable dialogue evaluation models are generally restricted to classifiers trained…

Computation and Language · Computer Science 2021-04-19 Xiang Gao , Yizhe Zhang , Michel Galley , Bill Dolan

Recent advances in NLP have been attributed to the emergence of large-scale pre-trained language models. GPT-2, in particular, is suited for generation tasks given its left-to-right language modeling objective, yet the linguistic quality of…

Computation and Language · Computer Science 2020-11-03 Wei-Jen Ko , Junyi Jessy Li

Language models (LMs) pretrained on a large text corpus and fine-tuned on a downstream text corpus and fine-tuned on a downstream task becomes a de facto training strategy for several natural language processing (NLP) tasks. Recently, an…

Computation and Language · Computer Science 2021-07-23 Junghoon Lee , Jounghee Kim , Pilsung Kang