English
Related papers

Related papers: Meta-Learning for Low-resource Natural Language Ge…

200 papers

Natural language generation (NLG) is a critical component of spoken dialogue and it has a significant impact both on usability and perceived quality. Most NLG systems in common use employ rules and heuristics and tend to generate rigid and…

Computation and Language · Computer Science 2015-08-27 Tsung-Hsien Wen , Milica Gasic , Nikola Mrksic , Pei-Hao Su , David Vandyke , Steve Young

The natural language generation (NLG) component of a spoken dialogue system (SDS) usually needs a substantial amount of handcrafting or a well-labeled dataset to be trained on. These limitations add significantly to development costs and…

Computation and Language · Computer Science 2015-08-10 Tsung-Hsien Wen , Milica Gasic , Dongho Kim , Nikola Mrksic , Pei-Hao Su , David Vandyke , Steve Young

Neural-based end-to-end approaches to natural language generation (NLG) from structured data or knowledge are data-hungry, making their adoption for real-world applications difficult with limited data. In this work, we propose the new task…

Computation and Language · Computer Science 2020-04-21 Zhiyu Chen , Harini Eavani , Wenhu Chen , Yinyin Liu , William Yang Wang

This article provides a brief overview of the field of Natural Language Generation. The term Natural Language Generation (NLG), in its broadest definition, refers to the study of systems that verbalize some form of information through…

Computation and Language · Computer Science 2025-11-04 Emiel van Miltenburg , Chenghua Lin

Neural network based approaches to data-to-text natural language generation (NLG) have gained popularity in recent years, with the goal of generating a natural language prompt that accurately realizes an input meaning representation. To…

Computation and Language · Computer Science 2020-11-06 Yuheng Du , Shereen Oraby , Vittorio Perera , Minmin Shen , Anjali Narayan-Chen , Tagyoung Chung , Anu Venkatesh , Dilek Hakkani-Tur

Moving from limited-domain natural language generation (NLG) to open domain is difficult because the number of semantic input combinations grows exponentially with the number of domains. Therefore, it is important to leverage existing…

Computation and Language · Computer Science 2016-03-04 Tsung-Hsien Wen , Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , David Vandyke , Steve Young

Current approaches to Natural Language Generation (NLG) for dialog mainly focus on domain-specific, task-oriented applications (e.g. restaurant booking) using limited ontologies (up to 20 slot types), usually without considering the…

Computation and Language · Computer Science 2019-09-25 Alessandra Cervone , Chandra Khatri , Rahul Goel , Behnam Hedayatnia , Anu Venkatesh , Dilek Hakkani-Tur , Raefer Gabriel

We present and evaluate a new model for Natural Language Generation (NLG) in Spoken Dialogue Systems, based on statistical planning, given noisy feedback from the current generation context (e.g. a user and a surface realiser). We study its…

Computation and Language · Computer Science 2016-06-16 Verena Rieser , Oliver Lemon

Text generation is the automated process of producing written or spoken language using computational methods. It involves generating coherent and contextually relevant text based on predefined rules or learned patterns. However, challenges…

Computation and Language · Computer Science 2025-01-30 Rahimanuddin Shaik , Katikela Sreeharsha Kishore

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

Computation and Language · Computer Science 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

This position paper proposes a conceptual framework for the design of Natural Language Generation (NLG) systems that follow efficient and effective production strategies in order to achieve complex communicative goals. In this general…

Computation and Language · Computer Science 2022-10-25 Mario Giulianelli

Neural natural language generation (NLG) models have recently shown remarkable progress in fluency and coherence. However, existing studies on neural NLG are primarily focused on surface-level realizations with limited emphasis on logical…

Computation and Language · Computer Science 2020-04-29 Wenhu Chen , Jianshu Chen , Yu Su , Zhiyu Chen , William Yang Wang

Natural Language Generation (NLG) has made great progress in recent years due to the development of deep learning techniques such as pre-trained language models. This advancement has resulted in more fluent, coherent and even properties…

Computation and Language · Computer Science 2022-03-11 Wei Li , Wenhao Wu , Moye Chen , Jiachen Liu , Xinyan Xiao , Hua Wu

Natural language understanding(NLU) is challenging for finance due to the lack of annotated data and the specialized language in that domain. As a result, researchers have proposed to use pre-trained language model and multi-task learning…

Computation and Language · Computer Science 2023-03-28 Bixing Yan , Shaoling Chen , Yuxuan He , Zhihan Li

The field of Natural Language Generation (NLG) suffers from a severe shortage of labeled data due to the extremely expensive and time-consuming process involved in manual annotation. A natural approach for coping with this problem is active…

Computation and Language · Computer Science 2023-10-18 Yotam Perlitz , Ariel Gera , Michal Shmueli-Scheuer , Dafna Sheinwald , Noam Slonim , Liat Ein-Dor

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

In modular dialogue systems, natural language understanding (NLU) and natural language generation (NLG) are two critical components, where NLU extracts the semantics from the given texts and NLG is to construct corresponding natural…

Computation and Language · Computer Science 2020-05-01 Shang-Yu Su , Chao-Wei Huang , Yun-Nung Chen

Meta-learning has emerged as an effective methodology to model several real-world tasks and problems due to its extraordinary effectiveness in the low-data regime. There are many scenarios ranging from the classification of rare diseases to…

Machine Learning · Computer Science 2023-12-29 Prabhat Agarwal , Shreya Singh

We present SkillNet-NLG, a sparsely activated approach that handles many natural language generation tasks with one model. Different from traditional dense models that always activate all the parameters, SkillNet-NLG selectively activates…

Computation and Language · Computer Science 2022-04-27 Junwei Liao , Duyu Tang , Fan Zhang , Shuming Shi

The in-context learning ability of large language models (LLMs) enables them to generalize to novel downstream tasks with relatively few labeled examples. However, they require enormous computational resources to be deployed. Alternatively,…

Computation and Language · Computer Science 2024-01-09 Jean Kaddour , Qi Liu