English
Related papers

Related papers: Evaluating for Diversity in Question Generation ov…

200 papers

Effectively leveraging diversity has been shown to improve performance for various machine learning models, including large language models (LLMs). However, determining the most effective way of using diversity remains a challenge. In this…

Computation and Language · Computer Science 2026-05-21 Rafael Rosales , Santiago Miret

Automatic evaluation metrics are indispensable for evaluating generated text. To date, these metrics have focused almost exclusively on the content selection aspect of the system output, ignoring the linguistic quality aspect altogether. We…

Computation and Language · Computer Science 2020-10-07 Wanzheng Zhu , Suma Bhat

Traditional reference-based metrics, such as BLEU and ROUGE, are less effective for assessing outputs from Large Language Models (LLMs) that produce highly creative or superior-quality text, or in situations where reference outputs are…

Human-Computer Interaction · Computer Science 2024-07-08 Qian Pan , Zahra Ashktorab , Michael Desmond , Martin Santillan Cooper , James Johnson , Rahul Nair , Elizabeth Daly , Werner Geyer

Deep-learning models for language generation tasks tend to produce repetitive output. Various methods have been proposed to encourage lexical diversity during decoding, but this often comes at a cost to the perceived fluency and adequacy of…

Computation and Language · Computer Science 2021-09-22 Giulio Zhou , Gerasimos Lampouras

Despite the increasing use of large language models for creative tasks, their outputs often lack diversity. Common solutions, such as sampling at higher temperatures, can compromise the quality of the results. Dealing with this trade-off is…

Computation and Language · Computer Science 2025-09-26 Giorgio Franceschelli , Mirco Musolesi

The diversity across outputs generated by LLMs shapes perception of their quality and utility. High lexical diversity is often desirable, but there is no standard method to measure this property. Templated answer structures and ``canned''…

Computation and Language · Computer Science 2026-02-19 Chantal Shaib , Venkata S. Govindarajan , Joe Barrow , Jiuding Sun , Alexa F. Siu , Byron C. Wallace , Ani Nenkova

Although the Conditional Variational AutoEncoder (CVAE) model can generate more diversified responses than the traditional Seq2Seq model, the responses often have low relevance with the input words or are illogical with the question. A…

Computation and Language · Computer Science 2022-10-12 Jiayi Liu , Wei Wei , Zhixuan Chu , Xing Gao , Ji Zhang , Tan Yan , Yulin Kang

Different texts shall by nature correspond to different number of keyphrases. This desideratum is largely missing from existing neural keyphrase generation models. In this study, we address this problem from both modeling and evaluation…

Computation and Language · Computer Science 2020-05-13 Xingdi Yuan , Tong Wang , Rui Meng , Khushboo Thaker , Peter Brusilovsky , Daqing He , Adam Trischler

A major challenge in visually grounded language generation is to build robust benchmark datasets and models that can generalize well in real-world settings. To do this, it is critical to ensure that our evaluation protocols are correct, and…

Computation and Language · Computer Science 2020-10-09 Wanrong Zhu , Xin Eric Wang , Pradyumna Narayana , Kazoo Sone , Sugato Basu , William Yang Wang

Automatic evaluation for open-ended natural language generation tasks remains a challenge. Existing metrics such as BLEU show a low correlation with human judgment. We propose a novel and powerful learning-based evaluation metric:…

Computation and Language · Computer Science 2020-08-20 Jing Gu , Qingyang Wu , Zhou Yu

Inductive reasoning - the process of inferring general rules from a small number of observations - is a fundamental aspect of human intelligence. Recent works suggest that large language models (LLMs) can engage in inductive reasoning by…

Artificial Intelligence · Computer Science 2025-02-11 Kang-il Lee , Hyukhun Koh , Dongryeol Lee , Seunghyun Yoon , Minsung Kim , Kyomin Jung

Although neural-based machine translation evaluation metrics, such as COMET or BLEURT, have achieved strong correlations with human judgements, they are sometimes unreliable in detecting certain phenomena that can be considered as critical…

Computation and Language · Computer Science 2023-05-31 Taisiya Glushkova , Chrysoula Zerva , André F. T. Martins

Neural Machine Translation (NMT) systems are typically evaluated using automated metrics that assess the agreement between generated translations and ground truth candidates. To improve systems with respect to these metrics, NLP researchers…

Computation and Language · Computer Science 2020-11-30 Nicholas Roberts , Davis Liang , Graham Neubig , Zachary C. Lipton

The evaluation of Natural Language Generation (NLG) models has gained increased attention, urging the development of metrics that evaluate various aspects of generated text. LUNA addresses this challenge by introducing a unified interface…

Computation and Language · Computer Science 2024-01-10 Marat Saidov , Aleksandra Bakalova , Ekaterina Taktasheva , Vladislav Mikhailov , Ekaterina Artemova

Existing LLM-as-a-Judge approaches for evaluating text generation suffer from rating inconsistencies, with low agreement and high rating variance across different evaluator models. We attribute this to subjective evaluation criteria…

Computation and Language · Computer Science 2025-11-04 Yukyung Lee , Joonghoon Kim , Jaehee Kim , Hyowon Cho , Jaewook Kang , Pilsung Kang , Najoung Kim

Reference-based metrics such as BLEU and BERTScore are widely used to evaluate question generation (QG). In this study, on QG benchmarks such as SQuAD and HotpotQA, we find that using human-written references cannot guarantee the…

Computation and Language · Computer Science 2024-10-11 Bang Nguyen , Mengxia Yu , Yun Huang , Meng Jiang

A major challenge in the field of Text Generation is evaluation: Human evaluations are cost-intensive, and automated metrics often display considerable disagreement with human judgments. In this paper, we propose a statistical model of Text…

Computation and Language · Computer Science 2023-06-07 Jan Deriu , Pius von Däniken , Don Tuggener , Mark Cieliebak

Existing metrics for evaluating the quality of automatically generated questions such as BLEU, ROUGE, BERTScore, and BLEURT compare the reference and predicted questions, providing a high score when there is a considerable lexical overlap…

Computation and Language · Computer Science 2023-05-29 Alireza Mohammadshahi , Thomas Scialom , Majid Yazdani , Pouya Yanki , Angela Fan , James Henderson , Marzieh Saeidi

While recent neural encoder-decoder models have shown great promise in modeling open-domain conversations, they often generate dull and generic responses. Unlike past work that has focused on diversifying the output of the decoder at…

Computation and Language · Computer Science 2017-10-24 Tiancheng Zhao , Ran Zhao , Maxine Eskenazi

Modelling human variation in rating tasks is crucial for personalization, pluralistic model alignment, and computational social science. We propose representing individuals using natural language value profiles -- descriptions of underlying…