English
Related papers

Related papers: Assessing and Understanding Creativity in Large La…

200 papers

Human evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and its quality is notoriously unstable,…

Computation and Language · Computer Science 2023-05-04 Cheng-Han Chiang , Hung-yi Lee

Large language models (LLMs) are applied to all sorts of creative tasks, and their outputs vary from beautiful, to peculiar, to pastiche, into plain plagiarism. The temperature parameter of an LLM regulates the amount of randomness, leading…

Computation and Language · Computer Science 2024-05-02 Max Peeperkorn , Tom Kouwenhoven , Dan Brown , Anna Jordanous

Evaluating the creativity of large language models (LLMs) in story writing is difficult because LLM-generated stories could seemingly look creative but be very similar to some existing stories in their huge and proprietary training corpus.…

Automatic systems are increasingly used to assess the originality of responses in creative tasks. They offer a potential solution to key limitations of human assessment (cost, fatigue, and subjectivity), but there is preliminary evidence of…

Human-Computer Interaction · Computer Science 2026-04-24 Umberto Domanti , Moritz Mock , Sergio Agnoli , Antonella De Angeli

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

Computation and Language · Computer Science 2024-08-07 Philipp Mondorf , Barbara Plank

From pre-trained language model (PLM) to large language model (LLM), the field of natural language processing (NLP) has witnessed steep performance gains and wide practical uses. The evaluation of a research field guides its direction of…

Computation and Language · Computer Science 2023-08-16 Ziyu Zhuang , Qiguang Chen , Longxuan Ma , Mingda Li , Yi Han , Yushan Qian , Haopeng Bai , Zixian Feng , Weinan Zhang , Ting Liu

Large language model (LLM)-driven multi-agent systems (MAS) are transforming how humans and AIs collaboratively generate ideas and artifacts. While existing surveys provide comprehensive overviews of MAS infrastructures, they largely…

Human-Computer Interaction · Computer Science 2025-05-28 Yi-Cheng Lin , Kang-Chieh Chen , Zhe-Yan Li , Tzu-Heng Wu , Tzu-Hsuan Wu , Kuan-Yu Chen , Hung-yi Lee , Yun-Nung Chen

Collaboration has been shown to enhance creativity, leading to more innovative and effective outcomes. While previous research has explored the abilities of Large Language Models (LLMs) to serve as co-creative partners in tasks like writing…

Human-Computer Interaction · Computer Science 2025-01-24 Zhikun Wu , Thomas Weber , Florian Müller

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

Computation and Language · Computer Science 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

Large Language Models (LLMs) have demonstrated human-like capabilities in language comprehension and generation, becoming active participants in social and cognitive domains. This study investigates whether LLMs exhibit personality-like…

Computation and Language · Computer Science 2025-05-22 Wang Jiaqi , Wang bo , Guo fa , Cheng cheng , Yang li

Critical thinking is essential for rational decision-making and problem-solving. This skill hinges on the ability to provide precise and reasoned critiques and is a hallmark of human intelligence. In the era of large language models (LLMs),…

Machine Learning · Computer Science 2023-10-10 Liangchen Luo , Zi Lin , Yinxiao Liu , Lei Shu , Yun Zhu , Jingbo Shang , Lei Meng

The rapid advancement of large language model (LLM) technology has led to diverse applications, many of which inherently require randomness, such as stochastic decision-making, gaming, scheduling, AI agents, and cryptography-related tasks.…

Artificial Intelligence · Computer Science 2025-10-15 Rabimba Karanjai , Yang Lu , Ranjith Chodavarapu , Lei Xu , Weidong Shi

While Large Language Models (LLMs) demonstrate remarkable capabilities in scientific tasks such as literature analysis and experimental design (e.g., accurately extracting key findings from papers or generating coherent experimental…

Computation and Language · Computer Science 2026-02-24 Kai Ruan , Xuan Wang , Jixiang Hong , Peng Wang , Yang Liu , Hao Sun

Scientific idea generation is central to discovery, requiring the joint satisfaction of novelty and scientific soundness. Unlike standard reasoning or general creative generation, scientific ideation is inherently open-ended and…

Measuring the creativity of large language models (LLMs) is essential for designing methods that can improve creativity and for enhancing our scientific understanding of this ability. To accomplish this, it has become common in recent years…

Artificial Intelligence · Computer Science 2026-05-14 Samuel Schapiro , Alexi Gladstone , Jonah Black , Heng Ji

This paper explores the enhancement of creativity in Large Language Models (LLMs) like vGPT-4 through associative thinking, a cognitive process where creative ideas emerge from linking seemingly unrelated concepts. Associative thinking…

Computation and Language · Computer Science 2024-05-14 Pronita Mehrotra , Aishni Parab , Sumit Gulwani

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

Computation and Language · Computer Science 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

Large Language Models (LLMs) have shown impressive capabilities in complex tasks and interactive environments, yet their creativity remains underexplored. This paper introduces a simulation framework utilizing the game Balderdash to…

Multiagent Systems · Computer Science 2024-11-18 Parsa Hejabi , Elnaz Rahmati , Alireza S. Ziabari , Preni Golazizian , Jesse Thomason , Morteza Dehghani

Psychological assessment tools have long helped humans understand behavioural patterns. While Large Language Models (LLMs) can generate content comparable to that of humans, we explore whether they exhibit personality traits. To this end,…

Computation and Language · Computer Science 2025-02-11 Pranav Bhandari , Usman Naseem , Amitava Datta , Nicolas Fay , Mehwish Nasim

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

Computation and Language · Computer Science 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal