English
Related papers

Related papers: Steering Large Language Models to Evaluate and Amp…

200 papers

Large Language Models (LLMs) have demonstrated remarkable creative writing capabilities, yet their substantial computational demands hinder widespread use. Enhancing Small Language Models (SLMs) offers a promising alternative, but current…

Computation and Language · Computer Science 2025-09-01 Xiaolong Wei , Bo Lu , Xingyu Zhang , Zhejun Zhao , Dongdong Shen , Long Xia , Dawei Yin

Large Language Models (LLMs) excel at many tasks, yet they struggle to produce truly creative, diverse ideas. In this paper, we introduce a novel approach that enhances LLM creativity. We apply LLMs for translating between natural language…

Computation and Language · Computer Science 2025-09-30 Moran Mizrahi , Chen Shani , Gabriel Stanovsky , Dan Jurafsky , Dafna Shahaf

Hallucinations in large language models (LLMs) are always seen as limitations. However, could they also be a source of creativity? This survey explores this possibility, suggesting that hallucinations may contribute to LLM application by…

Artificial Intelligence · Computer Science 2024-02-13 Xuhui Jiang , Yuxing Tian , Fengrui Hua , Chengjin Xu , Yuanzhuo Wang , Jian Guo

Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people co-create with them, it's unclear how this will…

Human-Computer Interaction · Computer Science 2025-02-18 Harsh Kumar , Jonathan Vincentius , Ewan Jordan , Ashton Anderson

The use of creative writing as training data for large language models (LLMs) is highly contentious and many writers have expressed outrage at the use of their work without consent or compensation. In this paper, we seek to understand how…

Human-Computer Interaction · Computer Science 2025-03-07 Katy Ilonka Gero , Meera Desai , Carly Schnitzler , Nayun Eom , Jack Cushman , Elena L. Glassman

Large Language Models (LLMs) demonstrate remarkable proficiency in generating accurate and fluent text. However, they often struggle with diversity and novelty, leading to repetitive or overly deterministic responses. These limitations stem…

Computation and Language · Computer Science 2025-02-19 Arash Lagzian , Srinivas Anumasa , Dianbo Liu

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in…

Computation and Language · Computer Science 2023-05-29 Jie Huang , Kevin Chen-Chuan Chang

Large Language Models (LLMs) have proved effective and efficient in generating code, leading to their utilization within the hardware design process. Prior works evaluating LLMs' abilities for register transfer level code generation solely…

Computation and Language · Computer Science 2024-04-16 Matthew DeLorenzo , Vasudev Gohil , Jeyavijayan Rajendran

Large language models are revolutionizing several areas, including artificial creativity. However, the process of generation in machines profoundly diverges from that observed in humans. In particular, machine generation is characterized by…

Artificial Intelligence · Computer Science 2024-10-08 Giorgio Franceschelli , Mirco Musolesi

We introduce Creativity Benchmark, an evaluation framework for large language models (LLMs) in marketing creativity. The benchmark covers 100 brands (12 categories) and three prompt types (Insights, Ideas, Wild Ideas). Human pairwise…

Computation and Language · Computer Science 2025-10-21 Ninad Bhat , Kieran Browne , Pip Bingemann

Researchers have argued that large language models (LLMs) exhibit high-quality writing capabilities from blogs to stories. However, evaluating objectively the creativity of a piece of writing is challenging. Inspired by the Torrance Test of…

Computation and Language · Computer Science 2024-03-11 Tuhin Chakrabarty , Philippe Laban , Divyansh Agarwal , Smaranda Muresan , Chien-Sheng Wu

Can LLMs provide support to creative writers by giving meaningful writing feedback? In this paper, we explore the challenges and limitations of model-generated writing feedback by defining a new task, dataset, and evaluation frameworks. To…

Computation and Language · Computer Science 2025-07-23 Hannah Rashkin , Elizabeth Clark , Fantine Huot , Mirella Lapata

Recent advancements in large language models (LLMs) have sparked optimism about their potential to accelerate scientific discovery, with a growing number of works proposing research agents that autonomously generate and validate new ideas.…

Computation and Language · Computer Science 2024-09-09 Chenglei Si , Diyi Yang , Tatsunori Hashimoto

Generative artificial intelligence (GenAI) can rapidly produce large and diverse volumes of content. This lends to it a quality of creativity which can be empowering in the early stages of design. In seeking to understand how creative ways…

Human-Computer Interaction · Computer Science 2024-03-20 Gionnieve Lim , Simon T. Perrault

Evaluating creativity is challenging, even for humans, not only because of its subjectivity but also because it involves complex cognitive processes. Inspired by work in marketing, we attempt to break down visual advertisement creativity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zhaoyi Joey Hou , Adriana Kovashka , Xiang Lorraine Li

This study explored how large language models (LLMs) perform in two areas related to art: writing critiques of artworks and reasoning about mental states (Theory of Mind, or ToM) in art-related situations. For the critique generation part,…

Computation and Language · Computer Science 2025-09-16 Takaya Arita , Wenxian Zheng , Reiji Suzuki , Fuminori Akiba

While the use of Large Language Models (LLMs) in programming has been extensively studied, there is limited understanding of how LLMs support collaborative work where creativity plays a central role. Software design, as a collaborative and…

Software Engineering · Computer Science 2026-04-28 Victoria Jackson , Grischa Liebel , Rafael Prikladnicki , Andre van der Hoek

Large language models (LLMs) have demonstrated notable creative abilities in generating literary texts, including poetry and short stories. However, prior research has primarily centered on English, with limited exploration of non-English…

Computation and Language · Computer Science 2026-02-16 Armin Tourajmehr , Mohammad Reza Modarres , Yadollah Yaghoobzadeh

Creativity assessment in science and engineering is increasingly based on both human and AI judgment, but the cognitive processes and biases behind these evaluations remain poorly understood. We conducted two experiments examining how…

Computation and Language · Computer Science 2025-05-06 Antonio Laverghetta , Tuhin Chakrabarty , Tom Hope , Jimmy Pronchick , Krupa Bhawsar , Roger E. Beaty

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

Computation and Language · Computer Science 2024-10-30 Rob Sullivan , Nelly Elsayed