English
Related papers

Related papers: Benchmarking Language Model Creativity: A Case Stu…

200 papers

Large language models (LLMs) are applied to all sorts of creative tasks, and their outputs vary from beautiful, to peculiar, to pastiche, into plain plagiarism. The temperature parameter of an LLM regulates the amount of randomness, leading…

Computation and Language · Computer Science 2024-05-02 Max Peeperkorn , Tom Kouwenhoven , Dan Brown , Anna Jordanous

Evaluating the creativity of large language models (LLMs) in story writing is difficult because LLM-generated stories could seemingly look creative but be very similar to some existing stories in their huge and proprietary training corpus.…

Large Language Models (LLMs) excel at many tasks, yet they struggle to produce truly creative, diverse ideas. In this paper, we introduce a novel approach that enhances LLM creativity. We apply LLMs for translating between natural language…

Computation and Language · Computer Science 2025-09-30 Moran Mizrahi , Chen Shani , Gabriel Stanovsky , Dan Jurafsky , Dafna Shahaf

Large Language Models (LLMs) are revolutionizing several areas of Artificial Intelligence. One of the most remarkable applications is creative writing, e.g., poetry or storytelling: the generated outputs are often of astonishing quality.…

Artificial Intelligence · Computer Science 2025-02-14 Giorgio Franceschelli , Mirco Musolesi

As artificial intelligence advances, models are not improving uniformly. Instead, progress unfolds in a jagged fashion, with capabilities growing unevenly across tasks, domains, and model scales. In this work, we examine this dynamic…

Artificial Intelligence · Computer Science 2026-05-21 Shray Mathur , J. Anibal Boscoboinik , Esther H. R. Tsai , Kevin G. Yager

This paper explores the enhancement of creativity in Large Language Models (LLMs) like vGPT-4 through associative thinking, a cognitive process where creative ideas emerge from linking seemingly unrelated concepts. Associative thinking…

Computation and Language · Computer Science 2024-05-14 Pronita Mehrotra , Aishni Parab , Sumit Gulwani

Following the widespread adoption of ChatGPT in early 2023, numerous studies reported that large language models (LLMs) can match or even surpass human performance in creative tasks. However, it remains unclear whether LLMs have become more…

Computation and Language · Computer Science 2025-04-18 Jennifer Haase , Paul H. P. Hanel , Sebastian Pokutta

Reasoning based on Large Language Models (LLMs) has garnered increasing attention due to outstanding performance of these models in mathematical and complex logical tasks. Beginning with the Chain-of-Thought (CoT) prompting technique,…

Artificial Intelligence · Computer Science 2025-11-27 Yuto Suzuki , Farnoush Banaei-Kashani

Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the…

Artificial Intelligence · Computer Science 2025-05-22 Luning Sun , Yuzhuo Yuan , Yuan Yao , Yanyan Li , Hao Zhang , Xing Xie , Xiting Wang , Fang Luo , David Stillwell

Creativity assessment in science and engineering is increasingly based on both human and AI judgment, but the cognitive processes and biases behind these evaluations remain poorly understood. We conducted two experiments examining how…

Computation and Language · Computer Science 2025-05-06 Antonio Laverghetta , Tuhin Chakrabarty , Tom Hope , Jimmy Pronchick , Krupa Bhawsar , Roger E. Beaty

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

Concept generation is a creative step in the conceptual design phase, where designers often turn to brainstorming, mindmapping, or crowdsourcing design ideas to complement their own knowledge of the domain. Recent advances in natural…

Computation and Language · Computer Science 2023-06-06 Kevin Ma , Daniele Grandi , Christopher McComb , Kosa Goucher-Lambert

As large language models (LLMs) are increasingly used for ideation and scientific discovery, it is important to evaluate their ability to generate novel output. Prior work evaluates novelty as originality with respect to model training…

Computation and Language · Computer Science 2025-10-08 Vishakh Padmakumar , Chen Yueh-Han , Jane Pan , Valerie Chen , He He

Large language models (LLMs) are increasingly shaping creative work and problem-solving; however, prior research suggests that they may diminish unassisted creativity. To address this tension, a coach-like LLM environment was developed that…

Human-Computer Interaction · Computer Science 2025-10-31 Alon Rosenbaum , Yigal David , Eran Kaufman , Gilad Ravid , Amit Ronen , Assaf Krebs

Designing system algorithms remains challenging, where the discontinuous nature of the solution space often forces system engineers to rely on generic heuristics at the expense of performance. We study whether LLMs can practically drive…

Artificial Intelligence · Computer Science 2026-04-17 Ruiying Ma , Chieh-Jan Mike Liang , Yanjie Gao , Francis Y. Yan

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

Computation and Language · Computer Science 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

Large language models (LLMs) have significant potential for generating educational questions and problems, enabling educators to create large-scale learning materials. However, LLMs are fundamentally limited by the ``Artificial Hivemind''…

Artificial Intelligence · Computer Science 2025-12-30 Manh Hung Nguyen , Adish Singla

Large language models (LLMs) have shown exceptional proficiency in natural language processing but often fall short of generating creative and original responses to open-ended questions. To enhance LLM creativity, our key insight is to…

Computation and Language · Computer Science 2024-08-09 Li-Chun Lu , Shou-Jen Chen , Tsung-Min Pai , Chan-Hung Yu , Hung-yi Lee , Shao-Hua Sun

Increasingly, large language models (LLMs) are being used to automate workplace processes requiring a high degree of creativity. While much prior work has examined the creativity of LLMs, there has been little research on whether they can…

Computation and Language · Computer Science 2024-09-04 Antonio Laverghetta , Simone Luchini , Averie Linell , Roni Reiter-Palmon , Roger Beaty

Large language models (LLMs) have achieved remarkable progress in code generation, yet their true programming competence remains underexplored. We introduce the Code Triangle framework, which systematically evaluates LLMs across three…

Computation and Language · Computer Science 2025-07-09 Taolin Zhang , Zihan Ma , Maosong Cao , Junnan Liu , Songyang Zhang , Kai Chen