English
Related papers

Related papers: NLG Evaluation: Past, Present, Future

200 papers

Natural language generation (NLG) is increasingly deployed in high-stakes domains, yet common intrinsic evaluation methods, such as n-gram overlap or sentence plausibility, weakly correlate with actual decision-making efficacy. We propose a…

Computation and Language · Computer Science 2025-07-04 Yu-Shiang Huang , Chuan-Ju Wang , Chung-Chi Chen

Natural language processing (NLP) has recently gained much attention for representing and analysing human language computationally. It has spread its applications in various fields such as machine translation, email spam detection,…

Computation and Language · Computer Science 2022-08-01 Diksha Khurana , Aditya Koli , Kiran Khatter , Sukhdev Singh

The rapid development and application of natural language generation (NLG) techniques has revolutionized the field of automatic text production. However, these techniques are still limited in their ability to produce human-like text that is…

Computation and Language · Computer Science 2022-12-08 Jiangjie Chen , Yanghua Xiao

Recent advancements in Retrieval-Augmented Generation (RAG) have revolutionized natural language processing by integrating Large Language Models (LLMs) with external information retrieval, enabling accurate, up-to-date, and verifiable text…

Computation and Language · Computer Science 2025-04-22 Aoran Gan , Hao Yu , Kai Zhang , Qi Liu , Wenyu Yan , Zhenya Huang , Shiwei Tong , Guoping Hu

The field of Deep Learning (DL) has undergone explosive growth during the last decade, with a substantial impact on Natural Language Processing (NLP) as well. Yet, compared to more established disciplines, a lack of common experimental…

In recent years, considerable research has been dedicated to the application of neural models in the field of natural language generation (NLG). The primary objective is to generate text that is both linguistically natural and human-like,…

Computation and Language · Computer Science 2023-06-13 Chen Tang , Frank Guerin , Chenghua Lin

In recent years, large language models (LLMs) and generative AI have revolutionized natural language processing (NLP), offering unprecedented capabilities in education. This chapter explores the transformative potential of LLMs in automated…

Computation and Language · Computer Science 2024-10-15 Subhankar Maity , Aniket Deroy

Natural language processing (NLP) has been traditionally applied to medicine, and generative large language models (LLMs) have become prominent recently. However, the differences between them across different medical tasks remain…

The emergence of Generative Artificial Intelligence (AI) and Large Language Models (LLMs) has marked a new era of Natural Language Processing (NLP), introducing unprecedented capabilities that are revolutionizing various domains. This paper…

Computation and Language · Computer Science 2024-08-26 Desta Haileselassie Hagos , Rick Battle , Danda B. Rawat

Human evaluation for natural language generation (NLG) often suffers from inconsistent user ratings. While previous research tends to attribute this problem to individual user preferences, we show that the quality of human judgements can…

Computation and Language · Computer Science 2018-10-03 Jekaterina Novikova , Ondřej Dušek , Verena Rieser

Precisely assessing the progress in natural language generation (NLG) tasks is challenging, and human evaluation to establish a preference in a model's output over another is often necessary. However, human evaluation is usually costly,…

Computation and Language · Computer Science 2022-11-10 Philippe Laban , Chien-Sheng Wu , Wenhao Liu , Caiming Xiong

Natural Language Generation (NLG) refers to the operation of expressing the calculation results of a system in human language. Since the quality of generated sentences from an NLG model cannot be fully represented using only quantitative…

Computation and Language · Computer Science 2022-08-04 Dojun Park , Youngjin Jang , Harksoo Kim

Recent advances in neural network-based generative modeling have reignited the hopes in having computer systems capable of seamlessly conversing with humans and able to understand natural language. Neural architectures have been employed to…

Computation and Language · Computer Science 2020-08-03 Cristina Garbacea , Qiaozhu Mei

Natural language generation (NLG) is the key technology to achieve generative artificial intelligence (AI). With the breakthroughs in large language models (LLMs), NLG has been widely used in various medical applications, demonstrating the…

Computation and Language · Computer Science 2025-05-08 Mengxian Lyu , Xiaohan Li , Ziyi Chen , Jinqian Pan , Cheng Peng , Sankalp Talankar , Yonghui Wu

The neural boom that has sparked natural language processing (NLP) research through the last decade has similarly led to significant innovations in data-to-text generation (DTG). This survey offers a consolidated view into the neural DTG…

Computation and Language · Computer Science 2024-04-03 Mandar Sharma , Ajay Gogineni , Naren Ramakrishnan

Natural Language Generation (NLG) has improved exponentially in recent years thanks to the development of sequence-to-sequence deep learning technologies such as Transformer-based language models. This advancement has led to more fluent and…

Computation and Language · Computer Science 2024-07-16 Ziwei Ji , Nayeon Lee , Rita Frieske , Tiezheng Yu , Dan Su , Yan Xu , Etsuko Ishii , Yejin Bang , Delong Chen , Wenliang Dai , Ho Shu Chan , Andrea Madotto , Pascale Fung

This article provides a brief overview of the field of Natural Language Generation. The term Natural Language Generation (NLG), in its broadest definition, refers to the study of systems that verbalize some form of information through…

Computation and Language · Computer Science 2025-11-04 Emiel van Miltenburg , Chenghua Lin

Evaluating Natural Language Generation (NLG) systems is a challenging task. Firstly, the metric should ensure that the generated hypothesis reflects the reference's semantics. Secondly, it should consider the grammatical quality of the…

Computation and Language · Computer Science 2022-03-18 Md Rashad Al Hasan Rony , Liubov Kovriguina , Debanjan Chaudhuri , Ricardo Usbeck , Jens Lehmann

In the rapidly evolving landscape of Large Language Models (LLMs), introduction of well-defined and standardized evaluation methodologies remains a crucial challenge. This paper traces the historical trajectory of LLM evaluations, from the…

Computation and Language · Computer Science 2023-11-06 Alexey Tikhonov , Ivan P. Yamshchikov

This literature review focuses on the use of Natural Language Generation (NLG) to automatically detect and generate persuasive texts. Extending previous research on automatic identification of persuasion in text, we concentrate on…

Computation and Language · Computer Science 2021-01-15 Sebastian Duerr , Peter A. Gloor