中文
相关论文

相关论文: Evaluating LLM Story Generation through Large-scal…

200 篇论文

Story-writing is a fundamental aspect of human imagination, relying heavily on creativity to produce narratives that are novel, effective, and surprising. While large language models (LLMs) have demonstrated the ability to generate…

计算与语言 · 计算机科学 2025-05-13 Mete Ismayilzada , Claire Stevenson , Lonneke van der Plas

To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge. The application of prompt-based learning with large language…

计算与语言 · 计算机科学 2023-07-25 Zhuohan Xie , Trevor Cohn , Jey Han Lau

Story generation has been a prominent application of Large Language Models (LLMs). However, understanding LLMs' ability to produce high-quality stories remains limited due to challenges in automatic evaluation methods and the high cost and…

计算与语言 · 计算机科学 2025-06-13 Yi Wang , Max Kreminski

This paper investigates the capability of LLMs in storytelling, focusing on narrative development and plot progression. We introduce a novel computational framework to analyze narratives through three discourse-level aspects: i) story arcs,…

计算与语言 · 计算机科学 2024-10-08 Yufei Tian , Tenghao Huang , Miri Liu , Derek Jiang , Alexander Spangher , Muhao Chen , Jonathan May , Nanyun Peng

Large Language Models (LLMs) have shown a tremendous capacity for generating literary text. However, their effectiveness in generating children's stories has yet to be thoroughly examined. In this study, we evaluate the trustworthiness of…

计算与语言 · 计算机科学 2023-08-02 Prabin Bhandari , Hannah Marie Brennan

This study explores the effectiveness of Large Language Models (LLMs) in creating personalized "mirror stories" that reflect and resonate with individual readers' identities, addressing the significant lack of diversity in literature. We…

计算与语言 · 计算机科学 2024-09-25 Sarfaroz Yunusov , Hamza Sidat , Ali Emami

Can LLMs provide support to creative writers by giving meaningful writing feedback? In this paper, we explore the challenges and limitations of model-generated writing feedback by defining a new task, dataset, and evaluation frameworks. To…

计算与语言 · 计算机科学 2025-07-23 Hannah Rashkin , Elizabeth Clark , Fantine Huot , Mirella Lapata

Large language models (LLMs) such as GPT, Claude, Gemini, and Grok have been deeply integrated into our daily life. They now support a wide range of tasks -- from dialogue and email drafting to assisting with teaching and coding, serving as…

计算与语言 · 计算机科学 2026-01-13 Hongyi Zhou , Jin Zhu , Ying Yang , Chengchun Shi

The surge in scientific submissions has placed increasing strain on the traditional peer-review process, prompting the exploration of large language models (LLMs) for automated review generation. While LLMs demonstrate competence in…

计算与语言 · 计算机科学 2025-09-25 Ruochi Li , Haoxuan Zhang , Edward Gehringer , Ting Xiao , Junhua Ding , Haihua Chen

With the development of artificial intelligence, particularly the success of Large Language Models (LLMs), the quantity and quality of automatically generated stories have significantly increased. This has led to the need for automatic…

计算与语言 · 计算机科学 2024-08-28 Dingyi Yang , Qin Jin

We evaluate recent Large Language Models (LLMs) on the challenging task of summarizing short stories, which can be lengthy, and include nuanced subtext or scrambled timelines. Importantly, we work directly with authors to ensure that the…

计算与语言 · 计算机科学 2024-07-15 Melanie Subbiah , Sean Zhang , Lydia B. Chilton , Kathleen McKeown

The use of Large Language Models (LLMs) has become ubiquitous, with abundant applications in computational creativity. One such application is fictional story generation. Fiction is a narrative that occurs in a story world that is slightly…

计算与语言 · 计算机科学 2024-08-16 Aisha Khatun , Daniel G. Brown

The rapid advancements in large language models (LLMs) have significantly improved their ability to generate natural language, making texts generated by LLMs increasingly indistinguishable from human-written texts. While recent research has…

计算与语言 · 计算机科学 2025-10-01 Sergio E. Zanotto , Segun Aroyehun

Large language models (LLMs) are increasingly used as substitutes for human subjects in behavioral simulations, including synthetic social network generation. Yet it remains unclear how their relational outputs depend on prompt design,…

Analyzing literature involves tracking interactions between characters, locations, and themes. Visualization has the potential to facilitate the mapping and analysis of these complex relationships, but capturing structured information from…

人机交互 · 计算机科学 2025-08-12 Catherine Yeh , Tara Menon , Robin Singh Arya , Helen He , Moira Weigel , Fernanda Viégas , Martin Wattenberg

Robustly evaluating the long-form storytelling capabilities of Large Language Models (LLMs) remains a significant challenge, as existing benchmarks often lack the necessary scale, diversity, or objective measures. To address this, we…

计算与语言 · 计算机科学 2025-05-22 Leon Lin , Jun Zheng , Haidong Wang

Written texts reflect an author's perspective, making the thorough analysis of literature a key research method in fields such as the humanities and social sciences. However, conventional text mining techniques like sentiment analysis and…

计算与语言 · 计算机科学 2024-11-12 Riona Matsuoka , Hiroki Matsumoto , Takahiro Yoshida , Tomohiro Watanabe , Ryoma Kondo , Ryohei Hisano

Generating a long story of several thousand words with narrative coherence using Large Language Models (LLMs) has been a challenging task. Previous research has addressed this challenge by proposing different frameworks that create a story…

计算与语言 · 计算机科学 2024-10-04 Minwook Bae , Hyounghun Kim

Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative…

人机交互 · 计算机科学 2024-06-07 Surabhi S. Nath , Peter Dayan , Claire Stevenson

Evaluating large language models (LLMs) in long-form, knowledge-grounded role-play dialogues remains challenging. This study compares LLM-generated and human-authored responses in multi-turn professional training simulations through human…

计算与语言 · 计算机科学 2025-10-10 Dongxu Lu , Johan Jeuring , Albert Gatt
‹ 上一页 1 2 3 10 下一页 ›