English
Related papers

Related papers: How do Humans and Language Models Reason About Cre…

200 papers

Large Language Models (LLMs) have shown promise in accelerating the scientific research pipeline. A key capability for this process is the ability to generate novel research ideas, and prior studies have found settings in which…

Computation and Language · Computer Science 2025-06-27 Chenglei Si , Tatsunori Hashimoto , Diyi Yang

Generative AI is rapidly transforming how organizations create value and evaluate talent. While large language models enhance baseline output quality, they simultaneously introduce ambiguity in assessing human creativity, as observable…

Human-Computer Interaction · Computer Science 2026-04-23 Yigal Rosen , Ilia Rushkin

Creativity is a fundamental pillar of human expression and a driving force behind innovation, yet it now stands at a crossroads. As artificial intelligence advances at an astonishing pace, the question arises: can machines match and…

General Economics · Economics 2024-09-30 Anne-Gaëlle Maltese , Pierre Pelletier , Rémy Guichardaz

Scientific discovery begins with ideas, yet evaluating early-stage research concepts is a subtle and subjective human judgment. As large language models (LLMs) are increasingly tasked with generating scientific hypotheses, most systems…

Human-Computer Interaction · Computer Science 2026-03-26 Lingyu Zhang , Mitchell Wang , Boyuan Chen

Large language models (LLMs) are increasingly used for creative tasks such as literary translation. Yet translational creativity remains underexplored and is rarely evaluated at scale, while source-text comprehension is typically studied in…

Computation and Language · Computer Science 2026-04-21 Ran Zhang , Steffen Eger , Arda Tezcan , Wei Zhao , Simone Paolo Ponzetto , Lieve Macken

As AI-generated and AI-assisted content floods online spaces, source labels attached to such content can distort human reasoning judgments, with downstream consequences for moderation, evaluation, and decision-making. Whether LLMs share…

Human-Computer Interaction · Computer Science 2026-05-29 Mahjabin Nahar , Nafis Irtiza Tripto , Aiping Xiong , Ting-Hao `Kenneth' Huang , Dongwon Lee

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

Evaluating creativity is challenging, even for humans, not only because of its subjectivity but also because it involves complex cognitive processes. Inspired by work in marketing, we attempt to break down visual advertisement creativity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zhaoyi Joey Hou , Adriana Kovashka , Xiang Lorraine Li

Despite the increasing use of large language models for creative tasks, their outputs often lack diversity. Common solutions, such as sampling at higher temperatures, can compromise the quality of the results. Dealing with this trade-off is…

Computation and Language · Computer Science 2025-09-26 Giorgio Franceschelli , Mirco Musolesi

Evaluating creative text generation remains a challenge because existing reference-based metrics fail to capture the subjective nature of creativity. We propose a structured evaluation framework for AI story generation comprising four…

Computation and Language · Computer Science 2026-01-08 Pharath Sathya , Yin Jou Huang , Fei Cheng

Large Language Models (LLMs) have shown significant limitations in understanding creative content, as demonstrated by Hessel et al. (2023)'s influential work on the New Yorker Cartoon Caption Contest (NYCCC). Their study exposed a…

Computation and Language · Computer Science 2025-02-28 Kuan Lok Zhou , Jiayi Chen , Siddharth Suresh , Reuben Narad , Timothy T. Rogers , Lalit K Jain , Robert D Nowak , Bob Mankoff , Jifan Zhang

The widespread adoption of Large Language Models (LLMs) and publicly available ChatGPT have marked a significant turning point in the integration of Artificial Intelligence (AI) into people's everyday lives. This study examines the ability…

Computation and Language · Computer Science 2025-10-28 Sandeep Kumar , Tirthankar Ghosal , Vinayak Goyal , Asif Ekbal

This article investigates the performance of automatic evaluation metrics (AEMs) and LLM-as-a-judge evaluation on literary translation across multiple languages, genres, and translation modalities. The aim is to assess how well these tools…

Computation and Language · Computer Science 2026-05-14 Kyo Gerrits , Rik van Noord , Ana Guerberof Arenas

Recent advancements in large language models (LLMs) have sparked optimism about their potential to accelerate scientific discovery, with a growing number of works proposing research agents that autonomously generate and validate new ideas.…

Computation and Language · Computer Science 2024-09-09 Chenglei Si , Diyi Yang , Tatsunori Hashimoto

While the use of Large Language Models (LLMs) in programming has been extensively studied, there is limited understanding of how LLMs support collaborative work where creativity plays a central role. Software design, as a collaborative and…

Software Engineering · Computer Science 2026-04-28 Victoria Jackson , Grischa Liebel , Rafael Prikladnicki , Andre van der Hoek

Novelty is a crucial criterion in the peer review process for evaluating academic papers. Traditionally, it's judged by experts or measure by unique reference combinations. Both methods have limitations: experts have limited knowledge, and…

Computation and Language · Computer Science 2025-07-17 Wenqing Wu , Chengzhi Zhang , Yi Zhao

Are large language models (LLMs) creative in the same way humans are, and can the same interventions increase creativity in both? We evaluate a promising but largely untested intervention for creativity: forcing creators to draw an analogy…

Artificial Intelligence · Computer Science 2026-03-20 Qiawen Ella Liu , Marina Dubova , Henry Conklin , Takumi Harada , Thomas L. Griffiths

Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people co-create with them, it's unclear how this will…

Human-Computer Interaction · Computer Science 2025-02-18 Harsh Kumar , Jonathan Vincentius , Ewan Jordan , Ashton Anderson

Creativity serves as a cornerstone for societal progress and innovation. With the rise of advanced generative AI models capable of tasks once reserved for human creativity, the study of AI's creative potential becomes imperative for its…

N-gram novelty is widely used to evaluate language models' ability to generate text outside of their training data. More recently, it has also been adopted as a metric for measuring textual creativity. However, theoretical work on…

Computation and Language · Computer Science 2026-03-04 Arkadiy Saakyan , Najoung Kim , Smaranda Muresan , Tuhin Chakrabarty