English
Related papers

Related papers: Collective Critics for Creative Story Generation

200 papers

Large Language Models (LLMs) often struggle with creative generation, and multi-agent frameworks that improve reasoning through interaction can paradoxically hinder creativity by inducing content homogenization. We introduce LLM Review, a…

Computation and Language · Computer Science 2026-01-14 Weiyue Li , Mingxiao Song , Zhenda Shen , Dachuan Zhao , Yunfan Long , Yi Li , Yongce Li , Ruyi Yang , Mengyu Wang

Critiques are important for enhancing the performance of Large Language Models (LLMs), enabling both self-improvement and constructive feedback for others by identifying flaws and suggesting improvements. However, evaluating the critique…

Computation and Language · Computer Science 2025-01-27 Zhengyang Tang , Ziniu Li , Zhenyang Xiao , Tian Ding , Ruoyu Sun , Benyou Wang , Dayiheng Liu , Fei Huang , Tianyu Liu , Bowen Yu , Junyang Lin

A crucial challenge for generative large language models (LLMs) is diversity: when a user's prompt is under-specified, models may follow implicit assumptions while generating a response, which may result in homogenization of the responses,…

Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative…

Human-Computer Interaction · Computer Science 2024-06-07 Surabhi S. Nath , Peter Dayan , Claire Stevenson

The generation of a long story consisting of several thousand words is a sub-task in the field of long text generation~(LTG). Previous research has addressed this challenge through outline-based generation, which employs a multi-stage…

Computation and Language · Computer Science 2025-08-06 Ge Shi , Kaiyu Huang , Guochen Feng

Large Language Models (LLMs) have impacted the writing process, enhancing productivity by collaborating with humans in content creation platforms. However, generating high-quality, user-aligned text to satisfy real-world content creation…

Computation and Language · Computer Science 2025-02-25 Yukyung Lee , Soonwon Ka , Bokyung Son , Pilsung Kang , Jaewook Kang

Since the natural language processing (NLP) community started to make large language models (LLMs) act as a critic to evaluate the quality of generated texts, most of the existing works train a critique generation model on the evaluation…

Computation and Language · Computer Science 2024-06-27 Pei Ke , Bosi Wen , Zhuoer Feng , Xiao Liu , Xuanyu Lei , Jiale Cheng , Shengyuan Wang , Aohan Zeng , Yuxiao Dong , Hongning Wang , Jie Tang , Minlie Huang

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

Computation and Language · Computer Science 2022-12-19 Harsh Lara , Manoj Tiwari

The development of Large Language Models (LLMs) has brought impressive performances on mitigation strategies against misinformation, such as counterargument generation. However, LLMs are still seriously hindered by outdated knowledge and by…

Computation and Language · Computer Science 2024-10-21 Blanca Calvo Figueras , Rodrigo Agerri

Automated story generation has been one of the long-standing challenges in NLP. Among all dimensions of stories, suspense is very common in human-written stories but relatively under-explored in AI-generated stories. While recent advances…

Computation and Language · Computer Science 2024-02-28 Kaige Xie , Mark Riedl

Despite the remarkable capabilities of large language models (LLMs) in various reasoning tasks, they still struggle with table reasoning tasks, particularly in maintaining consistency throughout multi-step reasoning processes. While…

Artificial Intelligence · Computer Science 2025-05-26 Peiying Yu , Guoxin Chen , Jingjing Wang

Critique ability, a meta-cognitive capability of humans, presents significant challenges for LLMs to improve. Recent works primarily rely on supervised fine-tuning (SFT) using critiques generated by a single LLM like GPT-4. However, these…

Computation and Language · Computer Science 2024-10-22 Tian Lan , Wenwei Zhang , Chengqi Lyu , Shuaibin Li , Chen Xu , Heyan Huang , Dahua Lin , Xian-Ling Mao , Kai Chen

Can LLMs provide support to creative writers by giving meaningful writing feedback? In this paper, we explore the challenges and limitations of model-generated writing feedback by defining a new task, dataset, and evaluation frameworks. To…

Computation and Language · Computer Science 2025-07-23 Hannah Rashkin , Elizabeth Clark , Fantine Huot , Mirella Lapata

Conversational recommender systems (CRSs) aim to recommend high-quality items to users through a dialogue interface. It usually contains multiple sub-tasks, such as user preference elicitation, recommendation, explanation, and item…

Information Retrieval · Computer Science 2023-08-14 Yue Feng , Shuchang Liu , Zhenghai Xue , Qingpeng Cai , Lantao Hu , Peng Jiang , Kun Gai , Fei Sun

As powerful tools in Natural Language Processing (NLP), Large Language Models (LLMs) have been leveraged for crafting recommendations to achieve precise alignment with user preferences and elevate the quality of the recommendations. The…

Information Retrieval · Computer Science 2025-10-20 Zhisheng Yang , Xiaofei Xu , Ke Deng , Li Li

Language models have demonstrated the ability to generate highly fluent text; however, it remains unclear whether their output retains coherent high-level structure (e.g., story progression). Here, we propose to apply a statistical tool,…

Computation and Language · Computer Science 2022-10-18 Yuntian Deng , Volodymyr Kuleshov , Alexander M. Rush

The surge in scientific submissions has placed increasing strain on the traditional peer-review process, prompting the exploration of large language models (LLMs) for automated review generation. While LLMs demonstrate competence in…

Computation and Language · Computer Science 2025-09-25 Ruochi Li , Haoxuan Zhang , Edward Gehringer , Ting Xiao , Junhua Ding , Haihua Chen

Large language models (LLMs) have significant potential for generating educational questions and problems, enabling educators to create large-scale learning materials. However, LLMs are fundamentally limited by the ``Artificial Hivemind''…

Artificial Intelligence · Computer Science 2025-12-30 Manh Hung Nguyen , Adish Singla

While Large Language Models (LLMs) can generate fluent text, producing high-quality creative stories remains challenging. Reinforcement Learning (RL) offers a promising solution but faces two critical obstacles: designing reliable reward…

Artificial Intelligence · Computer Science 2026-01-13 Zhaoyan Li , Hang Lei , Yujia Wang , Lanbo Liu , Hao Liu , Liang Yu

The conventional paradigm of using large language models (LLMs) for natural language generation (NLG) evaluation relies on pre-defined task definitions and evaluation criteria, positioning LLMs as "passive critics" that strictly follow…

Computation and Language · Computer Science 2025-02-18 Shuying Xu , Junjie Hu , Ming Jiang