中文
相关论文

相关论文: Evaluating LLM Story Generation through Large-scal…

200 篇论文

Evaluating the creativity of large language models (LLMs) in story writing is difficult because LLM-generated stories could seemingly look creative but be very similar to some existing stories in their huge and proprietary training corpus.…

As LLMs (large language models) are increasingly used to generate synthetic personas particularly in data-limited domains such as health, privacy, and HCI, it becomes necessary to understand how these narratives represent identity,…

计算与语言 · 计算机科学 2025-05-14 Pranav Narayanan Venkit , Jiayi Li , Yingfan Zhou , Sarah Rajtmajer , Shomir Wilson

Evaluations of creative stories generated by large language models (LLMs) often focus on objective properties of the text, such as its style, coherence, and diversity. While these metrics are indispensable, they do not speak to a story's…

计算与语言 · 计算机科学 2024-10-07 Fabrice Harel-Canada , Hanyu Zhou , Sreya Muppalla , Zeynep Yildiz , Miryung Kim , Amit Sahai , Nanyun Peng

With rapid advances in large language models (LLMs), there has been an increasing application of LLMs in creative content ideation and generation. A critical question emerges: can current LLMs provide ideas that are diverse enough to truly…

计算与语言 · 计算机科学 2025-09-03 Weijia Xu , Nebojsa Jojic , Sudha Rao , Chris Brockett , Bill Dolan

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

计算与语言 · 计算机科学 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

In the era of rapid digital communication, vast amounts of textual data are generated daily, demanding efficient methods for latent content analysis to extract meaningful insights. Large Language Models (LLMs) offer potential for automating…

Large language models (LLMs) are increasingly being utilised across a range of tasks and domains, with a burgeoning interest in their application within the field of journalism. This trend raises concerns due to our limited understanding of…

计算与语言 · 计算机科学 2024-06-18 Filip Trhlik , Pontus Stenetorp

Large Language Models (LLMs) are widely applied in educational practices, such as for generating children's stories. However, the generated stories are often too difficult for children to read, and the operational cost of LLMs hinders their…

计算与语言 · 计算机科学 2026-05-14 Qian Shen , Fanghua Cao , Min Yao , Shlok Gilda , Bonnie J. Dorr , Walter L. Leite

The rapid advancements in large language models (LLMs) have significantly improved their ability to generate natural language, making texts generated by LLMs increasingly indistinguishable from human-written texts. Recent research has…

计算与语言 · 计算机科学 2024-12-05 Sergio E. Zanotto , Segun Aroyehun

The emergence of Large Language Models (LLMs) has opened new opportunities to automate software engineering activities that traditionally require substantial manual effort. Among these, class diagram generation represents a critical yet…

软件工程 · 计算机科学 2026-03-11 Jackson Nguyen , Rui En Koe , Fanyu Wang , Chetan Arora , Alessio Ferrari

Recent research has focused on examining Large Language Models' (LLMs) characteristics from a psychological standpoint, acknowledging the necessity of understanding their behavioral characteristics. The administration of personality tests…

计算与语言 · 计算机科学 2024-10-07 Jen-tse Huang , Wenxiang Jiao , Man Ho Lam , Eric John Li , Wenxuan Wang , Michael R. Lyu

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like…

计算与语言 · 计算机科学 2025-10-14 Dana Sotto Porat , Ella Rabinovich

Personality traits are richly encoded in natural language, and large language models (LLMs) trained on human text can simulate personality when conditioned on persona descriptions. However, existing evaluations rely predominantly on…

计算与语言 · 计算机科学 2026-04-08 Ben Wigler , Maria Tsfasman , Tiffany Matej Hrkalovic

Large language models (LLMs) are recognized as systems that closely mimic aspects of human intelligence. This capability has attracted attention from the social science community, who see the potential in leveraging LLMs to replace human…

计算机与社会 · 计算机科学 2025-03-04 Qiuejie Xie , Qiming Feng , Tianqi Zhang , Qingqiu Li , Linyi Yang , Yuejie Zhang , Rui Feng , Liang He , Shang Gao , Yue Zhang

This paper assesses the potential for large language models (LLMs) to serve as assistive tools in the creative writing process, by means of a single, in-depth case study. In the course of the study, we develop interactive and multi-voice…

计算与语言 · 计算机科学 2023-12-08 Murray Shanahan , Catherine Clarke

This paper proposes a novel approach to evaluate Counter Narrative (CN) generation using a Large Language Model (LLM) as an evaluator. We show that traditional automatic metrics correlate poorly with human judgements and fail to capture the…

计算与语言 · 计算机科学 2024-11-05 Irune Zubiaga , Aitor Soroa , Rodrigo Agerri

Despite the many use cases for large language models (LLMs) in creating personalized chatbots, there has been limited research on evaluating the extent to which the behaviors of personalized LLMs accurately and consistently reflect specific…

计算与语言 · 计算机科学 2024-04-03 Hang Jiang , Xiajie Zhang , Xubo Cao , Cynthia Breazeal , Deb Roy , Jad Kabbara

Generating social networks is essential for many applications, such as epidemic modeling and social simulations. The emergence of generative AI, especially large language models (LLMs), offers new possibilities for social network…

计算机与社会 · 计算机科学 2025-03-31 Serina Chang , Alicja Chaszczewicz , Emma Wang , Maya Josifovska , Emma Pierson , Jure Leskovec

Applications of narrative theories using large language models (LLMs) deliver promising use-cases in automatic story generation and understanding tasks. Our survey examines how natural language processing (NLP) research engages with fields…

计算与语言 · 计算机科学 2026-02-19 David Y. Liu , Aditya Joshi , Paul Dawson

Stories are key to transmitting values across cultures, but their interpretation varies across linguistic and cultural contexts. Thus, we introduce multilingual story moral generation as a novel culturally grounded evaluation task. Using a…

计算与语言 · 计算机科学 2026-04-13 Sophie Wu , Andrew Piper