中文
相关论文

相关论文: Beyond Divergent Creativity: A Human-Based Evaluat…

200 篇论文

Large language model (LLM)-driven multi-agent systems (MAS) are transforming how humans and AIs collaboratively generate ideas and artifacts. While existing surveys provide comprehensive overviews of MAS infrastructures, they largely…

人机交互 · 计算机科学 2025-05-28 Yi-Cheng Lin , Kang-Chieh Chen , Zhe-Yan Li , Tzu-Heng Wu , Tzu-Hsuan Wu , Kuan-Yu Chen , Hung-yi Lee , Yun-Nung Chen

Large language models (LLMs) have shown great promise in machine translation, but they still struggle with contextually dependent terms, such as new or domain-specific words. This leads to inconsistencies and errors that are difficult to…

计算与语言 · 计算机科学 2024-10-29 Meiqi Chen , Fandong Meng , Yingxue Zhang , Yan Zhang , Jie Zhou

As large language models (LLMs) are increasingly used for ideation and scientific discovery, it is important to evaluate their ability to generate novel output. Prior work evaluates novelty as originality with respect to model training…

计算与语言 · 计算机科学 2025-10-08 Vishakh Padmakumar , Chen Yueh-Han , Jane Pan , Valerie Chen , He He

Large language models (LLMs) are increasingly used for creative tasks such as literary translation. Yet translational creativity remains underexplored and is rarely evaluated at scale, while source-text comprehension is typically studied in…

计算与语言 · 计算机科学 2026-04-21 Ran Zhang , Steffen Eger , Arda Tezcan , Wei Zhao , Simone Paolo Ponzetto , Lieve Macken

Artificial intelligence (AI) systems, and Large Language Models (LLMs) in particular, are increasingly employed for creative tasks like scientific idea generation, constituting a form of generalization from training data unaddressed by…

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

计算与语言 · 计算机科学 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

Although capable of generating creative text, Large Language Models (LLMs) are poor judges of what constitutes "creativity". In this work, we show that we can leverage this knowledge of how to write creatively in order to better judge what…

计算与语言 · 计算机科学 2024-12-10 Matthew Lyle Olson , Neale Ratzlaff , Musashi Hinck , Shao-yen Tseng , Vasudev Lal

Story-writing is a fundamental aspect of human imagination, relying heavily on creativity to produce narratives that are novel, effective, and surprising. While large language models (LLMs) have demonstrated the ability to generate…

计算与语言 · 计算机科学 2025-05-13 Mete Ismayilzada , Claire Stevenson , Lonneke van der Plas

Causality is essential for understanding complex systems, such as the economy, the brain, and the climate. Constructing causal graphs often relies on either data-driven or expert-driven approaches, both fraught with challenges. The former…

Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the…

人工智能 · 计算机科学 2025-05-22 Luning Sun , Yuzhuo Yuan , Yuan Yao , Yanyan Li , Hao Zhang , Xing Xie , Xiting Wang , Fang Luo , David Stillwell

Large language models (LLMs) are increasingly shaping creative work and problem-solving; however, prior research suggests that they may diminish unassisted creativity. To address this tension, a coach-like LLM environment was developed that…

人机交互 · 计算机科学 2025-10-31 Alon Rosenbaum , Yigal David , Eran Kaufman , Gilad Ravid , Amit Ronen , Assaf Krebs

Supervised learning relies on high-quality labeled data, but obtaining such data through human annotation is both expensive and time-consuming. Recent work explores using large language models (LLMs) for annotation, but LLM-generated labels…

机器学习 · 计算机科学 2026-03-23 Lequan Lin , Dai Shi , Andi Han , Feng Chen , Qiuzheng Chen , Jiawen Li , Zhaoyang Li , Jiyuan Li , Zhenbang Sun , Junbin Gao

Large language models (LLMs), particularly when integrated into agentic systems, have demonstrated human- and even superhuman-level performance across multiple domains. Whether these systems can truly be considered creative, however,…

计算机与社会 · 计算机科学 2026-04-21 Giorgio Franceschelli , Mirco Musolesi

Divergent thinking is a core dimension of creativity, yet existing evaluations of Large Language Models (LLMs) treat them as single-turn text generations, failing to capture how an agent reasons through iterative interaction. To address…

计算与语言 · 计算机科学 2026-05-28 Jihyeong Park , Ingeol Baek , Jeonghyun Park , Hwanhee Lee

Adaptive reasoning is essential for aligning the computational effort of large language models (LLMs) with the intrinsic difficulty of problems. Current chain-of-thought methods boost reasoning ability but indiscriminately generate long…

人工智能 · 计算机科学 2025-12-17 Ruofan Zhang , Bin Xia , Zhen Cheng , Cairen Jian , Minglun Yang , Ngai Wong , Yuan Cheng

Large language models (LLMs) have demonstrated strong performance across various tasks, leveraging their exceptional in-context learning ability with only a few examples. Accordingly, the selection of optimal in-context examples has been…

计算与语言 · 计算机科学 2025-06-03 Dohyun Lee , Seungil Chad Lee , Chanwoo Yang , Yujin Baek , Jaegul Choo

To advance the mathematical proficiency of large language models (LLMs), the DeepMath team has launched an open-source initiative aimed at developing an open mathematical LLM and systematically evaluating its mathematical creativity. This…

Large language models (LLMs) are increasingly used for tasks that implicitly reduce to Boolean satisfiability (SAT), yet their reasoning ability on SAT remains unclear. We present a systematic study of LLMs on 2-SAT and 3-SAT, together with…

人工智能 · 计算机科学 2026-05-28 Leizhen Zhang , Shuhan Chen , Sheng Chen

The following paper introduces a general linguistic creativity test for humans and Large Language Models (LLMs). The test consists of various tasks aimed at assessing their ability to generate new original words and phrases based on word…

计算与语言 · 计算机科学 2025-11-11 Anca Dinu , Andra-Maria Florescu , Alina Resceanu

Automatic systems are increasingly used to assess the originality of responses in creative tasks. They offer a potential solution to key limitations of human assessment (cost, fatigue, and subjectivity), but there is preliminary evidence of…

人机交互 · 计算机科学 2026-04-24 Umberto Domanti , Moritz Mock , Sergio Agnoli , Antonella De Angeli