English
Related papers

Related papers: How do Humans and Language Models Reason About Cre…

200 papers

Creativity has long been considered one of the most difficult aspect of human intelligence for AI to mimic. However, the rise of Large Language Models (LLMs), like ChatGPT, has raised questions about whether AI can match or even surpass…

Following the widespread adoption of ChatGPT in early 2023, numerous studies reported that large language models (LLMs) can match or even surpass human performance in creative tasks. However, it remains unclear whether LLMs have become more…

Computation and Language · Computer Science 2025-04-18 Jennifer Haase , Paul H. P. Hanel , Sebastian Pokutta

Creativity of generative AI models has been a subject of scientific debate in the last years, without a conclusive answer. In this paper, we study creativity from a practical perspective and introduce quantitative measures that help the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Aditi Ramaswamy , Hana Chockler , Melane Navaratnarajah

Assessing the novelty of patent claims is a critical yet challenging task traditionally performed by patent examiners. While advancements in NLP have enabled progress in various patent-related tasks, novelty assessment remains unexplored.…

Computation and Language · Computer Science 2025-02-11 Hayato Ikoma , Teruko Mitamura

Recent studies comparing AI-generated and human-authored literary texts have produced conflicting results: some suggest AI already surpasses human quality, while others argue it still falls short. We start from the hypothesis that such…

Computation and Language · Computer Science 2025-06-05 Guillermo Marco , Julio Gonzalo , Víctor Fresno

Analogical reasoning is a unique ability of humans to address unfamiliar challenges by transferring strategies from relevant past experiences. One key finding in psychology is that compared with irrelevant past experiences, recalling…

Computation and Language · Computer Science 2025-06-03 Chengwei Qin , Wenhan Xia , Tan Wang , Fangkai Jiao , Yuchen Hu , Bosheng Ding , Ruirui Chen , Shafiq Joty

The use of large language models like ChatGPT in code review offers promising efficiency gains but also raises concerns about correctness and safety. Existing evaluation methods for code review generation either rely on automatic…

Software Engineering · Computer Science 2025-12-18 Robert Heumüller , Frank Ortmeier

Cognitive diversity, reflected in variations of language, perspective, and reasoning, is essential to creativity and collective intelligence. This diversity is rich and grounded in culture, history, and individual experience. Yet as large…

Computation and Language · Computer Science 2026-01-07 Zhivar Sourati , Alireza S. Ziabari , Morteza Dehghani

As artificial intelligence advances, models are not improving uniformly. Instead, progress unfolds in a jagged fashion, with capabilities growing unevenly across tasks, domains, and model scales. In this work, we examine this dynamic…

Artificial Intelligence · Computer Science 2026-05-21 Shray Mathur , J. Anibal Boscoboinik , Esther H. R. Tsai , Kevin G. Yager

The evolution of mathematics is shaped importantly by interestingness: researchers choose which problems to pursue, and students choose which problems to engage with, based on expectations of interest and challenge. As AI systems,…

Creativity in artificial intelligence is most often addressed through evaluative frameworks that aim to measure novelty, diversity, or usefulness in generated outputs. While such approaches have provided valuable insights into the behavior…

Artificial Intelligence · Computer Science 2026-01-14 Corina Chutaux

Although artificial intelligence (AI) now matches or exceeds human performance across numerous cognitive tasks, creativity remains a highly contested frontier. As AI systems based on large language models (LLMs) are increasingly adopted in…

Computation and Language · Computer Science 2026-05-19 Tiancheng Hu , Yixuan Jiang , Haotian Li , José Hernández-Orallo , Xing Xie , Nigel Collier , David Stillwell , Luning Sun

Recent Large Language Models (LLMs) have shown the ability to generate content that is difficult or impossible to distinguish from human writing. We investigate the ability of differently-sized LLMs to replicate human writing style in…

Computation and Language · Computer Science 2024-05-06 Tolga Buz , Benjamin Frost , Nikola Genchev , Moritz Schneider , Lucie-Aimée Kaffee , Gerard de Melo

Artificial Intelligence (AI), and in particular generative models, are transformative tools for knowledge work. They problematise notions of creativity, originality, plagiarism, the attribution of credit, and copyright ownership. Critics of…

Human-Computer Interaction · Computer Science 2023-07-21 Advait Sarkar

Creativity is the ability to produce novel, useful, and surprising ideas, and has been widely studied as a crucial aspect of human cognition. Machine creativity on the other hand has been a long-standing challenge. With the rise of advanced…

Artificial Intelligence · Computer Science 2025-07-01 Mete Ismayilzada , Debjit Paul , Antoine Bosselut , Lonneke van der Plas

Large language models (LLMs) show strong potential to support creative tasks, but the role of the interface design is poorly understood. In particular, the effect of different modes of collaboration between humans and LLMs on co-creation…

Human-Computer Interaction · Computer Science 2026-03-10 Sebastian Maier , Manuel Schneider , Stefan Feuerriegel

Large language models (LLMs) have become common decision-support tools across educational and professional contexts, raising questions about how their outputs shape human critical thinking. Prior work suggests that the amount of AI…

Artificial Intelligence · Computer Science 2026-03-10 Natalie Friedman , Adelaide Nyanyo , Kevin Weatherwax , Lifei Wang , Chengchao Zhu , Zeshu Zhu , S. Joy Mountford

Large Language Models (LLMs) are increasingly employed in software engineering tasks such as requirements elicitation, design, and evaluation, raising critical questions regarding their alignment with human judgments on responsible AI…

Software Engineering · Computer Science 2025-11-07 Asma Yamani , Malak Baslyman , Moataz Ahmed

Language models (LMs) have exhibited impressive abilities in generating codes from natural language requirements. In this work, we highlight the diversity of code generated by LMs as a critical criterion for evaluating their code generation…

Software Engineering · Computer Science 2024-08-28 Heejae Chon , Seonghyeon Lee , Jinyoung Yeo , Dongha Lee

Large language models (LLMs), particularly when integrated into agentic systems, have demonstrated human- and even superhuman-level performance across multiple domains. Whether these systems can truly be considered creative, however,…

Computers and Society · Computer Science 2026-04-21 Giorgio Franceschelli , Mirco Musolesi