Bits of Grass: Does GPT already know how to write like Whitman?
Computation and Language
2023-05-19 v1
Abstract
This study examines the ability of GPT-3.5, GPT-3.5-turbo (ChatGPT) and GPT-4 models to generate poems in the style of specific authors using zero-shot and many-shot prompts (which use the maximum context length of 8192 tokens). We assess the performance of models that are not fine-tuned for generating poetry in the style of specific authors, via automated evaluation. Our findings indicate that without fine-tuning, even when provided with the maximum number of 17 poem examples (8192 tokens) in the prompt, these models do not generate poetry in the desired style.
Keywords
Cite
@article{arxiv.2305.11064,
title = {Bits of Grass: Does GPT already know how to write like Whitman?},
author = {Piotr Sawicki and Marek Grzes and Fabricio Goes and Dan Brown and Max Peeperkorn and Aisha Khatun},
journal= {arXiv preprint arXiv:2305.11064},
year = {2023}
}
Comments
short paper 5 pages