English
Related papers

Related papers: Evaluating the Evaluation of Diversity in Commonse…

200 papers

Large language models (LLMs) have demonstrated impressive capabilities in natural language generation. However, their output quality can be inconsistent, posing challenges for generating natural language from logical forms (LFs). This task…

Computation and Language · Computer Science 2023-09-22 Levon Haroutunian , Zhuang Li , Lucian Galescu , Philip Cohen , Raj Tumuluri , Gholamreza Haffari

In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.…

Computation and Language · Computer Science 2024-06-13 Zhen Li , Xiaohan Xu , Tao Shen , Can Xu , Jia-Chen Gu , Yuxuan Lai , Chongyang Tao , Shuai Ma

Large Language Models (LLMs) have shown impressive capabilities in various applications, but they still face various inconsistency issues. Existing works primarily focus on the inconsistency issues within a single LLM, while we…

Computation and Language · Computer Science 2024-11-15 Kai Xiong , Xiao Ding , Yixin Cao , Ting Liu , Bing Qin

Language models (LMs) have exhibited impressive abilities in generating code from natural language requirements. In this work, we highlight the diversity of code generated by LMs as a critical criterion for evaluating their code generation…

Software Engineering · Computer Science 2025-03-10 Seonghyeon Lee , Heejae Chon , Joonwon Jang , Dongha Lee , Hwanjo Yu

Generating unbiased summaries in real-world settings such as political perspective summarization remains a crucial application of Large Language Models (LLMs). Yet, existing evaluation frameworks rely on traditional metrics for measuring…

Computation and Language · Computer Science 2025-06-23 Narutatsu Ri , Nicholas Deas , Kathleen McKeown

Large language models (LLMs) have demonstrated significant utility in real-world applications, exhibiting impressive capabilities in natural language processing and understanding. Benchmark evaluations are crucial for assessing the…

Computation and Language · Computer Science 2026-05-12 Wenbo Zhang , Hengrui Cai , Wenyu Chen

We introduce {\em generative monoculture}, a behavior observed in large language models (LLMs) characterized by a significant narrowing of model output diversity relative to available training data for a given task: for example, generating…

Computation and Language · Computer Science 2024-07-03 Fan Wu , Emily Black , Varun Chandrasekaran

The generation of texts using Large Language Models (LLMs) is inherently uncertain, with sources of uncertainty being not only the generation of texts, but also the prompt used and the downstream interpretation. Within this work, we provide…

Machine Learning · Computer Science 2026-03-30 Steffen Herbold , Florian Lemmerich

Story-writing is a fundamental aspect of human imagination, relying heavily on creativity to produce narratives that are novel, effective, and surprising. While large language models (LLMs) have demonstrated the ability to generate…

Computation and Language · Computer Science 2025-05-13 Mete Ismayilzada , Claire Stevenson , Lonneke van der Plas

Large Language Models (LLMs) have demonstrated remarkable capabilities across various applications, fundamentally reshaping the landscape of natural language processing (NLP) research. However, recent evaluation frameworks often rely on the…

Computation and Language · Computer Science 2024-07-10 Chenyang Lyu , Minghao Wu , Alham Fikri Aji

As large language models become increasingly capable at various writing tasks, their weakness at generating unique and creative content becomes a major liability. Although LLMs have the ability to generate text covering diverse topics,…

Computation and Language · Computer Science 2025-08-12 Ramya Namuduri , Yating Wu , Anshun Asher Zheng , Manya Wadhwa , Greg Durrett , Junyi Jessy Li

Generating diverse, interesting responses to chitchat conversations is a problem for neural conversational agents. This paper makes two substantial contributions to improving diversity in dialogue generation. First, we propose a novel…

Computation and Language · Computer Science 2022-05-04 Katherine Stasaski , Marti A. Hearst

As large language models (LLMs) continue to advance, accurately and comprehensively evaluating their performance becomes increasingly challenging. Ranking the relative performance of LLMs based on Elo ratings, according to human judgment,…

Computation and Language · Computer Science 2023-11-14 Minghao Wu , Alham Fikri Aji

Recently, large language models (LLMs) have emerged as a groundbreaking technology and their unparalleled text generation capabilities have sparked interest in their application to the fundamental sentence representation learning task.…

Computation and Language · Computer Science 2024-05-20 Huiming Wang , Zhaodonghui Li , Liying Cheng , Soh De Wen , Lidong Bing

Collecting diverse human opinions is costly and challenging. This leads to a recent trend in exploiting large language models (LLMs) for generating diverse data for potential scalable and efficient solutions. However, the extent to which…

Computation and Language · Computer Science 2024-10-15 Shirley Anugrah Hayati , Minhwa Lee , Dheeraj Rajagopal , Dongyeop Kang

Large language models (LLMs) are proficient at generating fluent text with minimal task-specific supervision. Yet, their ability to provide well-grounded rationalizations for knowledge-intensive tasks remains under-explored. Such tasks,…

Computation and Language · Computer Science 2024-02-02 Aditi Mishra , Sajjadur Rahman , Hannah Kim , Kushan Mitra , Estevam Hruschka

A common approach for testing fairness issues in text-based classifiers is through the use of counterfactuals: does the classifier output change if a sensitive attribute in the input is changed? Existing counterfactual generation methods…

Computation and Language · Computer Science 2022-06-29 Zee Fryer , Vera Axelrod , Ben Packer , Alex Beutel , Jilin Chen , Kellie Webster

Large Language Models (LLMs) have demonstrated amazing capabilities in language generation, text comprehension, and knowledge reasoning. While a single powerful model can already handle multiple tasks, relying on a single perspective can…

Computation and Language · Computer Science 2024-06-12 Zining Qin , Chenhao Wang , Huiling Qin , Weijia Jia

Large Language Models (LLMs) have in recent years demonstrated impressive prowess in natural language generation. A common practice to improve generation diversity is to sample multiple outputs from the model. However, there lacks a simple…

Computation and Language · Computer Science 2022-09-23 Xingdi Yuan , Tong Wang , Yen-Hsiang Wang , Emery Fine , Rania Abdelghani , Pauline Lucas , Hélène Sauzéon , Pierre-Yves Oudeyer

Large Language Models (LLMs) are known to lack cultural representation and overall diversity in their generations, from expressing opinions to answering factual questions. To mitigate this problem, we propose multilingual prompting: a…

Computation and Language · Computer Science 2025-09-30 Qihan Wang , Shidong Pan , Tal Linzen , Emily Black