中文
相关论文

相关论文: Assessing and Understanding Creativity in Large La…

200 篇论文

Human evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and its quality is notoriously unstable,…

计算与语言 · 计算机科学 2023-05-04 Cheng-Han Chiang , Hung-yi Lee

Large language models (LLMs) are applied to all sorts of creative tasks, and their outputs vary from beautiful, to peculiar, to pastiche, into plain plagiarism. The temperature parameter of an LLM regulates the amount of randomness, leading…

计算与语言 · 计算机科学 2024-05-02 Max Peeperkorn , Tom Kouwenhoven , Dan Brown , Anna Jordanous

Evaluating the creativity of large language models (LLMs) in story writing is difficult because LLM-generated stories could seemingly look creative but be very similar to some existing stories in their huge and proprietary training corpus.…

Automatic systems are increasingly used to assess the originality of responses in creative tasks. They offer a potential solution to key limitations of human assessment (cost, fatigue, and subjectivity), but there is preliminary evidence of…

人机交互 · 计算机科学 2026-04-24 Umberto Domanti , Moritz Mock , Sergio Agnoli , Antonella De Angeli

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

计算与语言 · 计算机科学 2024-08-07 Philipp Mondorf , Barbara Plank

From pre-trained language model (PLM) to large language model (LLM), the field of natural language processing (NLP) has witnessed steep performance gains and wide practical uses. The evaluation of a research field guides its direction of…

计算与语言 · 计算机科学 2023-08-16 Ziyu Zhuang , Qiguang Chen , Longxuan Ma , Mingda Li , Yi Han , Yushan Qian , Haopeng Bai , Zixian Feng , Weinan Zhang , Ting Liu

Large language model (LLM)-driven multi-agent systems (MAS) are transforming how humans and AIs collaboratively generate ideas and artifacts. While existing surveys provide comprehensive overviews of MAS infrastructures, they largely…

人机交互 · 计算机科学 2025-05-28 Yi-Cheng Lin , Kang-Chieh Chen , Zhe-Yan Li , Tzu-Heng Wu , Tzu-Hsuan Wu , Kuan-Yu Chen , Hung-yi Lee , Yun-Nung Chen

Collaboration has been shown to enhance creativity, leading to more innovative and effective outcomes. While previous research has explored the abilities of Large Language Models (LLMs) to serve as co-creative partners in tasks like writing…

人机交互 · 计算机科学 2025-01-24 Zhikun Wu , Thomas Weber , Florian Müller

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

计算与语言 · 计算机科学 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

Large Language Models (LLMs) have demonstrated human-like capabilities in language comprehension and generation, becoming active participants in social and cognitive domains. This study investigates whether LLMs exhibit personality-like…

计算与语言 · 计算机科学 2025-05-22 Wang Jiaqi , Wang bo , Guo fa , Cheng cheng , Yang li

Critical thinking is essential for rational decision-making and problem-solving. This skill hinges on the ability to provide precise and reasoned critiques and is a hallmark of human intelligence. In the era of large language models (LLMs),…

机器学习 · 计算机科学 2023-10-10 Liangchen Luo , Zi Lin , Yinxiao Liu , Lei Shu , Yun Zhu , Jingbo Shang , Lei Meng

The rapid advancement of large language model (LLM) technology has led to diverse applications, many of which inherently require randomness, such as stochastic decision-making, gaming, scheduling, AI agents, and cryptography-related tasks.…

人工智能 · 计算机科学 2025-10-15 Rabimba Karanjai , Yang Lu , Ranjith Chodavarapu , Lei Xu , Weidong Shi

While Large Language Models (LLMs) demonstrate remarkable capabilities in scientific tasks such as literature analysis and experimental design (e.g., accurately extracting key findings from papers or generating coherent experimental…

计算与语言 · 计算机科学 2026-02-24 Kai Ruan , Xuan Wang , Jixiang Hong , Peng Wang , Yang Liu , Hao Sun

Scientific idea generation is central to discovery, requiring the joint satisfaction of novelty and scientific soundness. Unlike standard reasoning or general creative generation, scientific ideation is inherently open-ended and…

Measuring the creativity of large language models (LLMs) is essential for designing methods that can improve creativity and for enhancing our scientific understanding of this ability. To accomplish this, it has become common in recent years…

人工智能 · 计算机科学 2026-05-14 Samuel Schapiro , Alexi Gladstone , Jonah Black , Heng Ji

This paper explores the enhancement of creativity in Large Language Models (LLMs) like vGPT-4 through associative thinking, a cognitive process where creative ideas emerge from linking seemingly unrelated concepts. Associative thinking…

计算与语言 · 计算机科学 2024-05-14 Pronita Mehrotra , Aishni Parab , Sumit Gulwani

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

计算与语言 · 计算机科学 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

Large Language Models (LLMs) have shown impressive capabilities in complex tasks and interactive environments, yet their creativity remains underexplored. This paper introduces a simulation framework utilizing the game Balderdash to…

多智能体系统 · 计算机科学 2024-11-18 Parsa Hejabi , Elnaz Rahmati , Alireza S. Ziabari , Preni Golazizian , Jesse Thomason , Morteza Dehghani

Psychological assessment tools have long helped humans understand behavioural patterns. While Large Language Models (LLMs) can generate content comparable to that of humans, we explore whether they exhibit personality traits. To this end,…

计算与语言 · 计算机科学 2025-02-11 Pranav Bhandari , Usman Naseem , Amitava Datta , Nicolas Fay , Mehwish Nasim

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

计算与语言 · 计算机科学 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal