English

Creative Invention Benchmark

Artificial Intelligence 2018-05-11 v1
Authors: Matthew Guzdial , Nicholas Liao , Vishwa Shah , Mark O. Riedl
View on arXiv ↗ PDF ↗

Abstract

In this paper we present the Creative Invention Benchmark (CrIB), a 2000-problem benchmark for evaluating a particular facet of computational creativity. Specifically, we address combinational p-creativity, the creativity at play when someone combines existing knowledge to achieve a solution novel to that individual. We present generation strategies for the five problem categories of the benchmark and a set of initial baselines.

Cite

@article{arxiv.1805.03720,
  title  = {Creative Invention Benchmark},
  author = {Matthew Guzdial and Nicholas Liao and Vishwa Shah and Mark O. Riedl},
  journal= {arXiv preprint arXiv:1805.03720},
  year   = {2018}
}

Comments

8 pages, 4 figures, International Conference on Computational Creativity

Related papers

View all related →
Computation and Language · Computer Science
CresOWLve: Benchmarking Creative Problem-Solving Over Real-World Knowledge
Mete Ismayilzada, Renqing Cuomao, Daniil Yurshevich, Anna Sotnikova +2
2026-04-07
Artificial Intelligence · Computer Science
CreativeBench: Benchmarking and Enhancing Machine Creativity via Self-Evolving Challenges
Zi-Han Wang, Lam Nguyen, Zhengyang Zhao, Mengyue Yang +3
2026-03-17
Artificial Intelligence · Computer Science
Evaluating Creativity in Computational Co-Creative Systems
Pegah Karimi, Kazjon Grace, Mary Lou Maher, Nicholas Davis
2018-07-27
Sound · Computer Science
Towards Automation of Creativity: A Machine Intelligence Approach
Subodh Deolekar, Siby Abraham
2019-04-30
Artificial Intelligence · Computer Science
Quantifying Creativity in Art Networks
Ahmed Elgammal, Babak Saleh
2015-07-31
Artificial Intelligence · Computer Science
Towards Game-based Metrics for Computational Co-creativity
Rodrigo Canaan, Stefan Menzel, Julian Togelius, Andy Nealen
2018-09-27
Computation and Language · Computer Science
CREATE: Testing LLMs for Associative Creativity
Manya Wadhwa, Tiasa Singha Roy, Harvey Lederman, Junyi Jessy Li +1
2026-05-12
Artificial Intelligence · Computer Science
The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Games
Ahmed Khalifa, Roberto Gallotta, Matthew Barthet, Antonios Liapis +2
2025-03-31
Computation and Language · Computer Science
Creativity Benchmark: A benchmark for marketing creativity for large language models
Ninad Bhat, Kieran Browne, Pip Bingemann
2025-10-21
Artificial Intelligence · Computer Science
An Artificial Intelligence Approach for Interpreting Creative Combinational Designs
Liuqing Chen, Shuhong Xiao, Yunnong Chen, Linyun Sun +2
2024-05-09
Human-Computer Interaction · Computer Science
Automatic Creativity Measurement in Scratch Programs Across Modalities
Anastasia Kovalkov, Benjamin Paaßen, Avi Segal, Niels Pinkwart +1
2022-11-11
Machine Learning · Computer Science
DeepCreativity: Measuring Creativity with Deep Learning Techniques
Giorgio Franceschelli, Mirco Musolesi
2024-05-17
Human-Computer Interaction · Computer Science
crea.blender: A Neural Network-Based Image Generation Game to Assess Creativity
Janet Rafner, Arthur Hjorth, Sebastian Risi, Lotte Philipsen +8
2020-08-18
Software Engineering · Computer Science
Leveraging Creativity as a Problem Solving Tool in Software Engineering
Wouter Groeneveld
2025-02-06
Computation and Language · Computer Science
Rethinking Creativity Evaluation: A Critical Analysis of Existing Creativity Evaluations
Li-Chun Lu, Miri Liu, Pin-Chun Lu, Yufei Tian +2
2026-01-29
Artificial Intelligence · Computer Science
What Shapes a Creative Machine Mind? Comprehensively Benchmarking Creativity in Foundation Models
Zicong He, Boxuan Zhang, Weihao Liu, Ruixiang Tang +1
2025-10-07
Software Engineering · Computer Science
Self-Assessing Creative Problem Solving for Aspiring Software Developers: A Pilot Study
Wouter Groeneveld, Lynn Van den Broeck, Joost Vennekens, Kris Aerts
2022-03-28
Computer Vision and Pattern Recognition · Computer Science
Defining and Quantifying Creative Behavior in Popular Image Generators
Aditi Ramaswamy, Hana Chockler, Melane Navaratnarajah
2025-05-09
Computers and Society · Computer Science
The Dynamic Creativity of Proto-artifacts in Generative Computational Co-creation
Juan Salamanca, Daniel Gómez-Marín, Sergi Jordà
2024-11-27
Artificial Intelligence · Computer Science
CreBench: Human-Aligned Creativity Evaluation from Idea to Process to Product
Kaiwen Xue, Chenglong Li, Zhonghong Ou, Guoxin Zhang +9
2025-11-18
Computation and Language · Computer Science
Benchmarking Language Model Creativity: A Case Study on Code Generation
Yining Lu, Dixuan Wang, Tianjian Li, Dongwei Jiang +3
2025-02-11
Machine Learning · Computer Science
A Machine Learning Approach for Evaluating Creative Artifacts
Disha Shrivastava, Saneem Ahmed CG, Anirban Laha, Karthik Sankaranarayanan
2017-07-19
Software Engineering · Computer Science
Does Interdisciplinary Creative Coding Boost Creativity? A Mixed Methods Approach
Arne Duyver, Wouter Groeneveld, Kris Aerts
2023-07-04
Computers and Society · Computer Science
A Big Data Approach to Computational Creativity
Lav R. Varshney, Florian Pinel, Kush R. Varshney, Debarun Bhattacharjya +2
2013-11-07
Artificial Intelligence · Computer Science
A computational model and tool for generating more novel opportunities in professional innovation processes
Neil Maiden, Konstantinos Zachos, James Lockerbie, Kostas Petrianakis +1
2025-10-24
R2 v1 2026-06-23T01:50:13.917Z