English
Related papers

Related papers: Assessing and Understanding Creativity in Large La…

200 papers

The following paper introduces a general linguistic creativity test for humans and Large Language Models (LLMs). The test consists of various tasks aimed at assessing their ability to generate new original words and phrases based on word…

Computation and Language · Computer Science 2025-11-11 Anca Dinu , Andra-Maria Florescu , Alina Resceanu

Creativity is often seen as a hallmark of human intelligence. While large language models (LLMs) are increasingly perceived as generating creative text, there is still no holistic and scalable framework to evaluate their creativity across…

Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative…

Human-Computer Interaction · Computer Science 2024-06-07 Surabhi S. Nath , Peter Dayan , Claire Stevenson

Although capable of generating creative text, Large Language Models (LLMs) are poor judges of what constitutes "creativity". In this work, we show that we can leverage this knowledge of how to write creatively in order to better judge what…

Computation and Language · Computer Science 2024-12-10 Matthew Lyle Olson , Neale Ratzlaff , Musashi Hinck , Shao-yen Tseng , Vasudev Lal

Story-writing is a fundamental aspect of human imagination, relying heavily on creativity to produce narratives that are novel, effective, and surprising. While large language models (LLMs) have demonstrated the ability to generate…

Computation and Language · Computer Science 2025-05-13 Mete Ismayilzada , Claire Stevenson , Lonneke van der Plas

Large language models (LLMs) have shown exceptional proficiency in natural language processing but often fall short of generating creative and original responses to open-ended questions. To enhance LLM creativity, our key insight is to…

Computation and Language · Computer Science 2024-08-09 Li-Chun Lu , Shou-Jen Chen , Tsung-Min Pai , Chan-Hung Yu , Hung-yi Lee , Shao-Hua Sun

Creativity is a fundamental aspect of intelligence, involving the ability to generate novel and appropriate solutions across diverse contexts. While Large Language Models (LLMs) have been extensively evaluated for their creative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Xinyu Fang , Zhijian Chen , Kai Lan , Lixin Ma , Shengyuan Ding , Yingji Liang , Xiangyu Zhao , Farong Wen , Zicheng Zhang , Guofeng Zhang , Haodong Duan , Kai Chen , Dahua Lin

Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the…

Artificial Intelligence · Computer Science 2025-05-22 Luning Sun , Yuzhuo Yuan , Yuan Yao , Yanyan Li , Hao Zhang , Xing Xie , Xiting Wang , Fang Luo , David Stillwell

While the use of Large Language Models (LLMs) in programming has been extensively studied, there is limited understanding of how LLMs support collaborative work where creativity plays a central role. Software design, as a collaborative and…

Software Engineering · Computer Science 2026-04-28 Victoria Jackson , Grischa Liebel , Rafael Prikladnicki , Andre van der Hoek

The recent surge of Large Language Models (LLMs) has led to claims that they are approaching a level of creativity akin to human capabilities. This idea has sparked a blend of excitement and apprehension. However, a critical piece that has…

Computation and Language · Computer Science 2025-07-03 Antoine Bellemare-Pepin , François Lespinasse , Philipp Thölke , Yann Harel , Kory Mathewson , Jay A. Olson , Yoshua Bengio , Karim Jerbi

Researchers have argued that large language models (LLMs) exhibit high-quality writing capabilities from blogs to stories. However, evaluating objectively the creativity of a piece of writing is challenging. Inspired by the Torrance Test of…

Computation and Language · Computer Science 2024-03-11 Tuhin Chakrabarty , Philippe Laban , Divyansh Agarwal , Smaranda Muresan , Chien-Sheng Wu

We introduce Creativity Benchmark, an evaluation framework for large language models (LLMs) in marketing creativity. The benchmark covers 100 brands (12 categories) and three prompt types (Insights, Ideas, Wild Ideas). Human pairwise…

Computation and Language · Computer Science 2025-10-21 Ninad Bhat , Kieran Browne , Pip Bingemann

Numerous powerful large language models (LLMs) are now available for use as writing support tools, idea generators, and beyond. Although these LLMs are marketed as helpful creative assistants, several works have shown that using an LLM as a…

Computers and Society · Computer Science 2025-02-03 Emily Wenger , Yoed Kenett

This paper investigates whether large language models (LLMs) show agreement in assessing creativity in responses to the Alternative Uses Test (AUT). While LLMs are increasingly used to evaluate creative content, previous studies have…

Artificial Intelligence · Computer Science 2024-11-27 Abdullah Al Rabeyah , Fabrício Góes , Marco Volpe , Talles Medeiros

Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people co-create with them, it's unclear how this will…

Human-Computer Interaction · Computer Science 2025-02-18 Harsh Kumar , Jonathan Vincentius , Ewan Jordan , Ashton Anderson

This paper assesses the potential for large language models (LLMs) to serve as assistive tools in the creative writing process, by means of a single, in-depth case study. In the course of the study, we develop interactive and multi-voice…

Computation and Language · Computer Science 2023-12-08 Murray Shanahan , Catherine Clarke

Large Language Models (LLMs) are revolutionizing several areas of Artificial Intelligence. One of the most remarkable applications is creative writing, e.g., poetry or storytelling: the generated outputs are often of astonishing quality.…

Artificial Intelligence · Computer Science 2025-02-14 Giorgio Franceschelli , Mirco Musolesi

Molecule generation requires satisfying multiple chemical and biological constraints while searching a large and structured chemical space. This makes it a non-binary problem, where effective models must identify non-obvious solutions under…

Computation and Language · Computer Science 2026-04-21 Wen Tao , Yiwei Wang , Peng Zhou , Bryan Hooi , Wanlong Fang , Tianle Zhang , Xiao Luo , Yuansheng Liu , Alvin Chan

Creativity assessment in science and engineering is increasingly based on both human and AI judgment, but the cognitive processes and biases behind these evaluations remain poorly understood. We conducted two experiments examining how…

Computation and Language · Computer Science 2025-05-06 Antonio Laverghetta , Tuhin Chakrabarty , Tom Hope , Jimmy Pronchick , Krupa Bhawsar , Roger E. Beaty

Creative thinking is a fundamental aspect of human cognition, and divergent thinking-the capacity to generate novel and varied ideas-is widely regarded as its core generative engine. Large language models (LLMs) have recently demonstrated…

‹ Prev 1 2 3 10 Next ›