English

Multimodal Story Generation on Plural Images

Computation and Language 2021-06-08 v2 Computer Vision and Pattern Recognition Machine Learning Machine Learning

Abstract

Traditionally, text generation models take in a sequence of text as input, and iteratively generate the next most probable word using pre-trained parameters. In this work, we propose the architecture to use images instead of text as the input of the text generation model, called StoryGen. In the architecture, we design a Relational Text Data Generator algorithm that relates different features from multiple images. The output samples from the model demonstrate the ability to generate meaningful paragraphs of text containing the extracted features from the input images. This is an undergraduate project report. Completed Dec. 2019 at the Cooper Union.

Keywords

Cite

@article{arxiv.2001.10980,
  title  = {Multimodal Story Generation on Plural Images},
  author = {Jing Jiang},
  journal= {arXiv preprint arXiv:2001.10980},
  year   = {2021}
}

Comments

This is an undergraduate project report. Completed Dec. 2019 at the Cooper Union

R2 v1 2026-06-23T13:24:18.447Z