English
Related papers

Related papers: Meta-Learning for Low-resource Natural Language Ge…

200 papers

We present a novel natural language generation system for spoken dialogue systems capable of entraining (adapting) to users' way of speaking, providing contextually appropriate responses. The generator is based on recurrent neural networks…

Computation and Language · Computer Science 2017-09-18 Ondřej Dušek , Filip Jurčíček

One of the hardest problems in the area of Natural Language Processing and Artificial Intelligence is automatically generating language that is coherent and understandable to humans. Teaching machines how to converse as humans do falls…

Computation and Language · Computer Science 2019-06-04 Sashank Santhanam , Samira Shaikh

Recently, neural models led to significant improvements in both machine translation (MT) and natural language generation tasks (NLG). However, generation of long descriptive summaries conditioned on structured data remains an open…

Computation and Language · Computer Science 2019-11-01 Fahimeh Saleh , Alexandre Bérard , Ioan Calapodescu , Laurent Besacier

Automated evaluation of open domain natural language generation (NLG) models remains a challenge and widely used metrics such as BLEU and Perplexity can be misleading in some cases. In our paper, we propose to evaluate natural language…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Ke Xu

Task-oriented dialogue systems use four connected modules, namely, Natural Language Understanding (NLU), a Dialogue State Tracking (DST), Dialogue Policy (DP) and Natural Language Generation (NLG). A research challenge is to learn each…

Computation and Language · Computer Science 2020-08-21 Andrea Madotto , Zihan Liu , Zhaojiang Lin , Pascale Fung

Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models…

Computation and Language · Computer Science 2020-12-14 Yaqing Wang , Subhabrata Mukherjee , Haoda Chu , Yuancheng Tu , Ming Wu , Jing Gao , Ahmed Hassan Awadallah

Neural models trained for next utterance generation in dialogue task learn to mimic the n-gram sequences in the training set with training objectives like negative log-likelihood (NLL) or cross-entropy. Such commonly used training…

Computation and Language · Computer Science 2021-06-22 Prasanna Parthasarathi , Mohamed Abdelsalam , Joelle Pineau , Sarath Chandar

We present a framework for generating natural language description from structured data such as tables; the problem comes under the category of data-to-text natural language generation (NLG). Modern data-to-text NLG systems typically employ…

Computation and Language · Computer Science 2019-10-08 Anirban Laha , Parag Jain , Abhijit Mishra , Karthik Sankaranarayanan

Natural language generation (NLG) is a critical component in spoken dialogue systems. Classic NLG can be divided into two phases: (1) sentence planning: deciding on the overall sentence structure, (2) surface realization: determining…

Computation and Language · Computer Science 2018-08-10 Shang-Yu Su , Kai-Ling Lo , Yi-Ting Yeh , Yun-Nung Chen

Recently, the NLP community has witnessed a rapid advancement in multilingual and cross-lingual transfer research where the supervision is transferred from high-resource languages (HRLs) to low-resource languages (LRLs). However, the…

Computation and Language · Computer Science 2022-03-22 Kaushal Kumar Maurya , Maunendra Sankar Desarkar

Natural Language Inference Generation task is to generate a text hypothesis given a text premise and a logical relation between the two. This task can be used in data augmentation and controllable text generation in practice. In this paper,…

Computation and Language · Computer Science 2022-05-24 Kaijian Li , Shansan Gong , Kenny Q. Zhu

Meta learning has been widely used to exploit rich-resource source tasks to improve the performance of low-resource target tasks. Unfortunately, most existing meta learning approaches treat different source tasks equally, ignoring the…

Computation and Language · Computer Science 2025-04-14 Yu Fu , Jie He , Yifan Yang , Qun Liu , Deyi Xiong

Natural Language Generation (NLG) has improved exponentially in recent years thanks to the development of sequence-to-sequence deep learning technologies such as Transformer-based language models. This advancement has led to more fluent and…

Computation and Language · Computer Science 2024-07-16 Ziwei Ji , Nayeon Lee , Rita Frieske , Tiezheng Yu , Dan Su , Yan Xu , Etsuko Ishii , Yejin Bang , Delong Chen , Wenliang Dai , Ho Shu Chan , Andrea Madotto , Pascale Fung

The rapid development and application of natural language generation (NLG) techniques has revolutionized the field of automatic text production. However, these techniques are still limited in their ability to produce human-like text that is…

Computation and Language · Computer Science 2022-12-08 Jiangjie Chen , Yanghua Xiao

Generating high-quality text with sufficient diversity is essential for a wide range of Natural Language Generation (NLG) tasks. Maximum-Likelihood (MLE) models trained with teacher forcing have consistently been reported as weak baselines,…

Computation and Language · Computer Science 2020-02-21 Massimo Caccia , Lucas Caccia , William Fedus , Hugo Larochelle , Joelle Pineau , Laurent Charlin

Text classification tends to be difficult when data are deficient or when it is required to adapt to unseen classes. In such challenging scenarios, recent studies have often used meta-learning to simulate the few-shot task, thus negating…

Information Retrieval · Computer Science 2019-11-22 Shumin Deng , Ningyu Zhang , Zhanlin Sun , Jiaoyan Chen , Huajun Chen

Large language models (LLMs) are increasingly used in learning algorithms, evaluations, and optimization tasks. Recent studies have shown that using LLM-based optimizers to automatically optimize model prompts, demonstrations, predictions…

Computation and Language · Computer Science 2025-10-23 Guowei Xu , Mert Yuksekgonul , Carlos Guestrin , James Zou

Designing task-oriented dialogue systems is a challenging research topic, since it needs not only to generate utterances fulfilling user requests but also to guarantee the comprehensibility. Many previous works trained end-to-end (E2E)…

Computation and Language · Computer Science 2021-02-22 Jianhong Wang , Yuan Zhang , Tae-Kyun Kim , Yunjie Gu

This work presents BanglaNLG, a comprehensive benchmark for evaluating natural language generation (NLG) models in Bangla, a widely spoken yet low-resource language. We aggregate six challenging conditional text generation tasks under the…

Computation and Language · Computer Science 2023-02-14 Abhik Bhattacharjee , Tahmid Hasan , Wasi Uddin Ahmad , Rifat Shahriyar

The combination of multilingual pre-trained representations and cross-lingual transfer learning is one of the most effective methods for building functional NLP systems for low-resource languages. However, for extremely low-resource…

Computation and Language · Computer Science 2021-04-19 Mengzhou Xia , Guoqing Zheng , Subhabrata Mukherjee , Milad Shokouhi , Graham Neubig , Ahmed Hassan Awadallah