English
Related papers

Related papers: Few-shot Natural Language Generation for Task-Orie…

200 papers

In today's digitally driven world, dialogue systems play a pivotal role in enhancing user interactions, from customer service to virtual assistants. In these dialogues, it is important to identify user's goals automatically to resolve their…

Computation and Language · Computer Science 2024-11-19 Juan A. Rodriguez , Nicholas Botzer , David Vazquez , Christopher Pal , Marco Pedersoli , Issam Laradji

Task-oriented Dialogue (ToD) agents are mostly limited to a few widely-spoken languages, mainly due to the high cost of acquiring training data for each language. Existing low-cost approaches that rely on cross-lingual embeddings or naive…

Computation and Language · Computer Science 2023-02-21 Mehrad Moradshahi , Sina J. Semnani , Monica S. Lam

Task-oriented dialog systems have witnessed substantial progress due to conversational pre-training techniques. Yet, two significant challenges persist. First, most systems primarily utilize the latest turn's state label for the generator.…

Computation and Language · Computer Science 2024-01-30 Longxiang Liu , Xiuxing Li , Yang Feng

Speech-based machine learning (ML) has been heralded as a promising solution for tracking prosodic and spectrotemporal patterns in real-life that are indicative of emotional changes, providing a valuable window into one's cognitive and…

Machine Learning · Computer Science 2021-09-08 Kexin Feng , Theodora Chaspari

Dialogue State Tracking (DST), a key component of task-oriented conversation systems, represents user intentions by determining the values of pre-defined slots in an ongoing dialogue. Existing approaches use hand-crafted templates and…

Computation and Language · Computer Science 2023-10-24 Praveen Venkateswaran , Evelyn Duesterwald , Vatche Isahagian

Existing work on controlled text generation (CTG) assumes a control interface of categorical attributes. In this work, we propose a natural language (NL) interface, where we craft a PCFG to embed the control attributes into natural language…

Computation and Language · Computer Science 2022-10-17 Jingyu Zhang , James Glass , Tianxing He

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Few-shot Learning (FSL) is aimed to make predictions based on a limited number of samples. Structured data such as knowledge graphs and ontology libraries has been leveraged to benefit the few-shot setting in various tasks. However, the…

Computation and Language · Computer Science 2023-01-27 Hongbin Ye , Ningyu Zhang , Shumin Deng , Xiang Chen , Hui Chen , Feiyu Xiong , Xi Chen , Huajun Chen

Recent deep learning models have shown improving results to natural language generation (NLG) irrespective of providing sufficient annotated data. However, a modest training data may harm such models performance. Thus, how to build a…

Computation and Language · Computer Science 2018-11-13 Van-Khanh Tran , Le-Minh Nguyen

While pre-trained language models have obtained state-of-the-art performance for several natural language understanding tasks, they are quite opaque in terms of their decision-making process. While some recent works focus on rationalizing…

Computation and Language · Computer Science 2021-09-20 Meghana Moorthy Bhat , Alessandro Sordoni , Subhabrata Mukherjee

Text classification tends to be difficult when data are deficient or when it is required to adapt to unseen classes. In such challenging scenarios, recent studies have often used meta-learning to simulate the few-shot task, thus negating…

Information Retrieval · Computer Science 2019-11-22 Shumin Deng , Ningyu Zhang , Zhanlin Sun , Jiaoyan Chen , Huajun Chen

We present a generative model for multitask conditional language generation. Our guiding hypothesis is that a shared set of latent skills underlies many disparate language generation tasks, and that explicitly modelling these skills in a…

Computation and Language · Computer Science 2020-02-25 Kris Cao , Dani Yogatama

In task-oriented conversation systems, natural language generation systems that generate sentences with specific information related to conversation flow are useful. Our study focuses on language generation by considering various…

Computation and Language · Computer Science 2021-07-29 Joosung Lee

Objective: Few-shot learning (FSL) methods require small numbers of labeled instances for training. As many medical topics have limited annotated textual data in practical settings, FSL-based natural language processing (NLP) methods hold…

Computation and Language · Computer Science 2022-05-02 Yao Ge , Yuting Guo , Yuan-Chi Yang , Mohammed Ali Al-Garadi , Abeed Sarker

Previous attempts to build effective semantic parsers for Wizard-of-Oz (WOZ) conversations suffer from the difficulty in acquiring a high-quality, manually annotated training set. Approaches based only on dialogue synthesis are…

Computation and Language · Computer Science 2022-04-11 Giovanni Campagna , Sina J. Semnani , Ryan Kearns , Lucas Jun Koba Sato , Silei Xu , Monica S. Lam

In this paper, we propose Minimalist Transfer Learning (MinTL) to simplify the system design process of task-oriented dialogue systems and alleviate the over-dependency on annotated data. MinTL is a simple yet effective transfer learning…

Computation and Language · Computer Science 2020-09-29 Zhaojiang Lin , Andrea Madotto , Genta Indra Winata , Pascale Fung

Natural language modeling with limited training data is a challenging problem, and many algorithms make use of large-scale pretrained language models (PLMs) for this due to its great generalization ability. Among them, additive learning…

Computation and Language · Computer Science 2022-09-20 Daejin Jo , Taehwan Kwon , Eun-Sol Kim , Sungwoong Kim

Recently a variety of LSTM-based conditional language models (LM) have been applied across a range of language generation tasks. In this work we study various model architectures and different ways to represent and aggregate the source…

Computation and Language · Computer Science 2016-06-13 Tsung-Hsien Wen , Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , David Vandyke , Steve Young

In real-world scenarios, labeled samples for dialogue summarization are usually limited (i.e., few-shot) due to high annotation costs for high-quality dialogue summaries. To efficiently learn from few-shot samples, previous works have…

Computation and Language · Computer Science 2024-02-28 Kaige Xie , Tong Yu , Haoliang Wang , Junda Wu , Handong Zhao , Ruiyi Zhang , Kanak Mahadik , Ani Nenkova , Mark Riedl

Some NLP tasks can be solved in a fully unsupervised fashion by providing a pretrained language model with "task descriptions" in natural language (e.g., Radford et al., 2019). While this approach underperforms its supervised counterpart,…

Computation and Language · Computer Science 2021-01-26 Timo Schick , Hinrich Schütze