English
Related papers

Related papers: CREATE: Testing LLMs for Associative Creativity

200 papers

Chain-of-Thought (CoT) reasoning has emerged as a promising approach for enhancing the performance of large language models (LLMs) on complex reasoning tasks. Recently, a series of studies attempt to explain the mechanisms underlying CoT,…

Computation and Language · Computer Science 2024-10-29 Qiguang Chen , Libo Qin , Jiaqi Wang , Jinxuan Zhou , Wanxiang Che

The following paper introduces a general linguistic creativity test for humans and Large Language Models (LLMs). The test consists of various tasks aimed at assessing their ability to generate new original words and phrases based on word…

Computation and Language · Computer Science 2025-11-11 Anca Dinu , Andra-Maria Florescu , Alina Resceanu

Promoting creativity is considered an important goal of education, but creativity is notoriously hard to measure.In this paper, we make the journey fromdefining a formal measure of creativity that is efficientlycomputable to applying the…

Human-Computer Interaction · Computer Science 2022-11-11 Anastasia Kovalkov , Benjamin Paaßen , Avi Segal , Niels Pinkwart , Kobi Gal

Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the…

Artificial Intelligence · Computer Science 2025-05-22 Luning Sun , Yuzhuo Yuan , Yuan Yao , Yanyan Li , Hao Zhang , Xing Xie , Xiting Wang , Fang Luo , David Stillwell

Large language models (LLMs) excel at solving problems with clear and complete statements, but often struggle with nuanced environments or interactive tasks which are common in most real-world scenarios. This highlights the critical need…

Computer system creativity is a key step on the pathway to artificial general intelligence (AGI). It is elusive, however, due to the fact that human creativity is not fully understood and, thus, it is difficult to develop this capability in…

Artificial Intelligence · Computer Science 2024-09-05 Jeremy Straub , Zach Johnson

The meteoric rise of foundation models (FMs) has expanded their capabilities far beyond conventional tasks. Creativity, long regarded as a hallmark of human intelligence and a driver of innovation, is now increasingly recognized as a…

Artificial Intelligence · Computer Science 2025-10-07 Zicong He , Boxuan Zhang , Weihao Liu , Ruixiang Tang , Lu Cheng

Despite the increasing use of large language models for creative tasks, their outputs often lack diversity. Common solutions, such as sampling at higher temperatures, can compromise the quality of the results. Dealing with this trade-off is…

Computation and Language · Computer Science 2025-09-26 Giorgio Franceschelli , Mirco Musolesi

We introduce CRAFT, a multi-agent benchmark for evaluating pragmatic communication in large language models under strict partial information. In this setting, multiple agents with complementary but incomplete views must coordinate through…

Computation and Language · Computer Science 2026-04-29 Abhijnan Nath , Hannah VanderHoeven , Nikhil Krishnaswamy

Creative plot generation presents a fundamental challenge for language models: transforming a concise premise into a coherent narrative that sustains global structure, character development, and emotional resonance. Although recent Large…

Computation and Language · Computer Science 2026-03-18 Abhinav Thorat , Ravi Kolla , Jyotin Goel , Niranjan Pedanekar

Simulation-based theory development has yielded powerful insights into collective performance by linking social structure to emergent outcomes, yet it has struggled to extend to collective creativity. Creativity is hard to capture purely at…

Social and Information Networks · Computer Science 2026-02-04 Mirza Nayeem Ahmed , Raiyan Abdul Baten

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

Machine Learning · Computer Science 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Evaluating creativity is challenging, even for humans, not only because of its subjectivity but also because it involves complex cognitive processes. Inspired by work in marketing, we attempt to break down visual advertisement creativity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zhaoyi Joey Hou , Adriana Kovashka , Xiang Lorraine Li

Traditional ontologies describe domain structure but cannot generate novel artifacts. Large language models generate fluently but produce outputs lacking structural validity, hallucinating mechanisms without components, goals without end…

Artificial Intelligence · Computer Science 2026-02-10 Benny Cheung

Are large language models (LLMs) creative in the same way humans are, and can the same interventions increase creativity in both? We evaluate a promising but largely untested intervention for creativity: forcing creators to draw an analogy…

Artificial Intelligence · Computer Science 2026-03-20 Qiawen Ella Liu , Marina Dubova , Henry Conklin , Takumi Harada , Thomas L. Griffiths

One of the defining characteristics of human creativity is the ability to make conceptual leaps, creating something surprising from typical knowledge. In comparison, deep neural networks often struggle to handle cases outside of their…

Machine Learning · Computer Science 2018-09-10 Matthew Guzdial , Mark O. Riedl

Evaluating the creativity of large language models (LLMs) in story writing is difficult because LLM-generated stories could seemingly look creative but be very similar to some existing stories in their huge and proprietary training corpus.…

Many creativity methods follow similar structures and principles. Design Patterns capture such invariants of proven good practices and discuss why, when and how creative thinking methods match various situations of collaboration. Moreover…

Computers and Society · Computer Science 2015-03-04 Christian Kohls

How should we evaluate the quality of generative models? Many existing metrics focus on a model's producibility, i.e. the quality and breadth of outputs it can generate. However, the actual value from using a generative model stems not just…

Machine Learning · Computer Science 2025-11-13 Keyon Vafa , Sarah Bentley , Jon Kleinberg , Sendhil Mullainathan

Creativity is perhaps what most differentiates humans from other species. It involves the capacity to shift between divergent and convergent modes of thought in response to task demands. Divergent thought has been characterized as the kind…

Neurons and Cognition · Quantitative Biology 2019-12-03 Liane Gabora