中文
相关论文

相关论文: Benchmarking Language Model Creativity: A Case Stu…

200 篇论文

Large language models (LLMs) are applied to all sorts of creative tasks, and their outputs vary from beautiful, to peculiar, to pastiche, into plain plagiarism. The temperature parameter of an LLM regulates the amount of randomness, leading…

计算与语言 · 计算机科学 2024-05-02 Max Peeperkorn , Tom Kouwenhoven , Dan Brown , Anna Jordanous

Evaluating the creativity of large language models (LLMs) in story writing is difficult because LLM-generated stories could seemingly look creative but be very similar to some existing stories in their huge and proprietary training corpus.…

Large Language Models (LLMs) excel at many tasks, yet they struggle to produce truly creative, diverse ideas. In this paper, we introduce a novel approach that enhances LLM creativity. We apply LLMs for translating between natural language…

计算与语言 · 计算机科学 2025-09-30 Moran Mizrahi , Chen Shani , Gabriel Stanovsky , Dan Jurafsky , Dafna Shahaf

Large Language Models (LLMs) are revolutionizing several areas of Artificial Intelligence. One of the most remarkable applications is creative writing, e.g., poetry or storytelling: the generated outputs are often of astonishing quality.…

人工智能 · 计算机科学 2025-02-14 Giorgio Franceschelli , Mirco Musolesi

As artificial intelligence advances, models are not improving uniformly. Instead, progress unfolds in a jagged fashion, with capabilities growing unevenly across tasks, domains, and model scales. In this work, we examine this dynamic…

人工智能 · 计算机科学 2026-05-21 Shray Mathur , J. Anibal Boscoboinik , Esther H. R. Tsai , Kevin G. Yager

This paper explores the enhancement of creativity in Large Language Models (LLMs) like vGPT-4 through associative thinking, a cognitive process where creative ideas emerge from linking seemingly unrelated concepts. Associative thinking…

计算与语言 · 计算机科学 2024-05-14 Pronita Mehrotra , Aishni Parab , Sumit Gulwani

Following the widespread adoption of ChatGPT in early 2023, numerous studies reported that large language models (LLMs) can match or even surpass human performance in creative tasks. However, it remains unclear whether LLMs have become more…

计算与语言 · 计算机科学 2025-04-18 Jennifer Haase , Paul H. P. Hanel , Sebastian Pokutta

Reasoning based on Large Language Models (LLMs) has garnered increasing attention due to outstanding performance of these models in mathematical and complex logical tasks. Beginning with the Chain-of-Thought (CoT) prompting technique,…

人工智能 · 计算机科学 2025-11-27 Yuto Suzuki , Farnoush Banaei-Kashani

Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the…

人工智能 · 计算机科学 2025-05-22 Luning Sun , Yuzhuo Yuan , Yuan Yao , Yanyan Li , Hao Zhang , Xing Xie , Xiting Wang , Fang Luo , David Stillwell

Creativity assessment in science and engineering is increasingly based on both human and AI judgment, but the cognitive processes and biases behind these evaluations remain poorly understood. We conducted two experiments examining how…

计算与语言 · 计算机科学 2025-05-06 Antonio Laverghetta , Tuhin Chakrabarty , Tom Hope , Jimmy Pronchick , Krupa Bhawsar , Roger E. Beaty

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

计算与语言 · 计算机科学 2024-12-23 Zhisheng Tang , Mayank Kejriwal

Concept generation is a creative step in the conceptual design phase, where designers often turn to brainstorming, mindmapping, or crowdsourcing design ideas to complement their own knowledge of the domain. Recent advances in natural…

计算与语言 · 计算机科学 2023-06-06 Kevin Ma , Daniele Grandi , Christopher McComb , Kosa Goucher-Lambert

As large language models (LLMs) are increasingly used for ideation and scientific discovery, it is important to evaluate their ability to generate novel output. Prior work evaluates novelty as originality with respect to model training…

计算与语言 · 计算机科学 2025-10-08 Vishakh Padmakumar , Chen Yueh-Han , Jane Pan , Valerie Chen , He He

Large language models (LLMs) are increasingly shaping creative work and problem-solving; however, prior research suggests that they may diminish unassisted creativity. To address this tension, a coach-like LLM environment was developed that…

人机交互 · 计算机科学 2025-10-31 Alon Rosenbaum , Yigal David , Eran Kaufman , Gilad Ravid , Amit Ronen , Assaf Krebs

Designing system algorithms remains challenging, where the discontinuous nature of the solution space often forces system engineers to rely on generic heuristics at the expense of performance. We study whether LLMs can practically drive…

人工智能 · 计算机科学 2026-04-17 Ruiying Ma , Chieh-Jan Mike Liang , Yanjie Gao , Francis Y. Yan

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

计算与语言 · 计算机科学 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

Large language models (LLMs) have significant potential for generating educational questions and problems, enabling educators to create large-scale learning materials. However, LLMs are fundamentally limited by the ``Artificial Hivemind''…

人工智能 · 计算机科学 2025-12-30 Manh Hung Nguyen , Adish Singla

Large language models (LLMs) have shown exceptional proficiency in natural language processing but often fall short of generating creative and original responses to open-ended questions. To enhance LLM creativity, our key insight is to…

计算与语言 · 计算机科学 2024-08-09 Li-Chun Lu , Shou-Jen Chen , Tsung-Min Pai , Chan-Hung Yu , Hung-yi Lee , Shao-Hua Sun

Increasingly, large language models (LLMs) are being used to automate workplace processes requiring a high degree of creativity. While much prior work has examined the creativity of LLMs, there has been little research on whether they can…

计算与语言 · 计算机科学 2024-09-04 Antonio Laverghetta , Simone Luchini , Averie Linell , Roni Reiter-Palmon , Roger Beaty

Large language models (LLMs) have achieved remarkable progress in code generation, yet their true programming competence remains underexplored. We introduce the Code Triangle framework, which systematically evaluates LLMs across three…

计算与语言 · 计算机科学 2025-07-09 Taolin Zhang , Zihan Ma , Maosong Cao , Junnan Liu , Songyang Zhang , Kai Chen