English
Related papers

Related papers: Benchmarking Language Model Creativity: A Case Stu…

200 papers

Large Language Models are increasingly used in software engineering, but both code generation and its evaluation remain predominantly English-centric. This leaves a major gap in our understanding of how well current tools support…

The opportunities offered by LLM coders (and their current limitations) demand a reevaluation of how software is structured. Software today is often "illegible" - lacking a direct correspondence between code and observed behavior - and…

Software Engineering · Computer Science 2025-08-29 Eagon Meng , Daniel Jackson

Modern large language models (LLMs) excel at objective tasks such as evaluating mathematical reasoning and factual accuracy, yet they falter when faced with the nuanced, subjective nature of assessing creativity. In this work, we propose a…

Computation and Language · Computer Science 2025-10-08 Vanya Bannihatti Kumar , Divyanshu Goyal , Akhil Eppa , Neel Bhandari

Automated code generation using large language models (LLMs) has gained attention due to its efficiency and adaptability. However, real-world coding tasks or benchmarks like HumanEval and StudentEval often lack dedicated training datasets,…

Software Engineering · Computer Science 2025-01-15 Shuai Wang , Liang Ding , Yibing Zhan , Yong Luo , Zheng He , Dapeng Tao

Large Language Models (LLMs) have demonstrated great promise in generating code, especially when used inside an evolutionary computation framework to iteratively optimize the generated algorithms. However, in some cases they fail to…

Neural and Evolutionary Computing · Computer Science 2025-03-24 Niki van Stein , Anna V. Kononova , Lars Kotthoff , Thomas Bäck

This paper assesses the potential for large language models (LLMs) to serve as assistive tools in the creative writing process, by means of a single, in-depth case study. In the course of the study, we develop interactive and multi-voice…

Computation and Language · Computer Science 2023-12-08 Murray Shanahan , Catherine Clarke

Large language models (LLMs), particularly when integrated into agentic systems, have demonstrated human- and even superhuman-level performance across multiple domains. Whether these systems can truly be considered creative, however,…

Computers and Society · Computer Science 2026-04-21 Giorgio Franceschelli , Mirco Musolesi

Large Language Models (LLMs) have emerged as coding assistants, capable of generating source code from natural language prompts. With the increasing adoption of LLMs in software development, academic research and industry based projects are…

Recent years have seen the remarkable capabilities of large language models (LLMs) for code generation. Different from existing work that evaluate the correctness of the code generated by LLMs, we propose to further evaluate its efficiency.…

Software Engineering · Computer Science 2024-04-10 Changan Niu , Ting Zhang , Chuanyi Li , Bin Luo , Vincent Ng

Recent Large Language Models (LLMs) have reported high accuracy on reasoning benchmarks. However, it is still unclear whether the observed results arise from true reasoning or from statistical recall of the training set. Inspired by the…

Computation and Language · Computer Science 2025-06-19 Xinnuo Xu , Rachel Lawrence , Kshitij Dubey , Atharva Pandey , Risa Ueno , Fabian Falck , Aditya V. Nori , Rahul Sharma , Amit Sharma , Javier Gonzalez

Today's software engineering (SE) complexities require a more diverse tool set going beyond technical expertise to be able to successfully tackle all challenges. Previous studies have indicated that creativity is a prime indicator for…

Software Engineering · Computer Science 2025-02-06 Wouter Groeneveld

Current bundle generation studies focus on generating a combination of items to improve user experience. In real-world applications, there is also a great need to produce bundle creatives that consist of mixture types of objects (e.g.,…

Information Retrieval · Computer Science 2022-06-10 Penghui Wei , Shaoguo Liu , Xuanhua Yang , Liang Wang , Bo Zheng

Generative artificial intelligence (GenAI) can rapidly produce large and diverse volumes of content. This lends to it a quality of creativity which can be empowering in the early stages of design. In seeking to understand how creative ways…

Human-Computer Interaction · Computer Science 2024-03-20 Gionnieve Lim , Simon T. Perrault

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

Computation and Language · Computer Science 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

Natural language generation (NLG) is a process within artificial intelligence where computer systems produce human-comprehensible language texts from information. English as a foreign language (EFL) students' use of NLG tools might…

Computers and Society · Computer Science 2023-06-02 David James Woo , Yanzhi Wang , Hengky Susanto , Kai Guo

Natural generation allows Large Language Models (LLMs) to produce free-form responses with rich reasoning, yet the lack of structure makes outputs difficult to verify. Conversely, constrained decoding ensures standardized formats but can…

Computation and Language · Computer Science 2026-05-29 Ngoc Trinh Hung Nguyen , Alonso Silva , Laith Zumot , Liubov Tupikina , Armen Aghasaryan , Mehwish Alam

Code generation aims to produce code that fulfills requirements written in natural languages automatically. Large language Models (LLMs) like ChatGPT have demonstrated promising effectiveness in this area. Nonetheless, these LLMs often fail…

Software Engineering · Computer Science 2025-01-15 Ruwei Pan , Hongyu Zhang , Chao Liu

Creativity is perhaps what most differentiates humans from other species. It involves the capacity to shift between divergent and convergent modes of thought in response to task demands. Divergent thought has been characterized as the kind…

Neurons and Cognition · Quantitative Biology 2019-12-03 Liane Gabora

The rapid advancement of Large Language Models (LLMs) presents both challenges and opportunities for Natural Language Processing (NLP) education. This paper introduces ``Vibe Coding,'' a pedagogical approach that leverages LLMs as coding…

Computation and Language · Computer Science 2026-02-03 Hend Al-Khalifa

Large language models (LLMs) have demonstrated unparalleled prowess in mimicking human-like text generation and processing. Among the myriad of applications that benefit from LLMs, automated code generation is increasingly promising. The…

Software Engineering · Computer Science 2023-11-15 Lincoln Murr , Morgan Grainger , David Gao