English
Related papers

Related papers: Beyond Narrative Description: Generating Poetry fr…

200 papers

Text-to-image synthesis refers to computational methods which translate human written textual descriptions, in the form of keywords or sentences, into images with similar semantic meaning to the text. In earlier research, image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jorge Agnese , Jonathan Herrera , Haicheng Tao , Xingquan Zhu

We propose a novel lightweight generative adversarial network for efficient image manipulation using natural language descriptions. To achieve this, a new word-level discriminator is proposed, which provides the generator with fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

Translating information between text and image is a fundamental problem in artificial intelligence that connects natural language processing and computer vision. In the past few years, performance in image caption generation has seen…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Hao Dong , Jingqing Zhang , Douglas McIlwraith , Yike Guo

Natural Language Inference is an important task for Natural Language Understanding. It is concerned with classifying the logical relation between two sentences. In this paper, we propose several text generative neural networks for…

Artificial Intelligence · Computer Science 2017-03-28 Janez Starc , Dunja Mladenić

Poetry has long been a central art form for Arabic speakers, serving as a powerful medium of expression and cultural identity. While modern Arabic speakers continue to value poetry, existing research on Arabic poetry within Large Language…

Computation and Language · Computer Science 2026-05-01 Abdelrahman Sadallah , Kareem Elozeiri , Mervat Abassy , Rania Elbadry , Mohamed Anwar , Abed Alhakim Freihat , Preslav Nakov , Fajri Koto

Text-to-Image translation has been an active area of research in the recent past. The ability for a network to learn the meaning of a sentence and generate an accurate image that depicts the sentence shows ability of the model to think more…

Machine Learning · Computer Science 2018-08-15 Satya Krishna Gorti , Jeremy Ma

Traditionally, text generation models take in a sequence of text as input, and iteratively generate the next most probable word using pre-trained parameters. In this work, we propose the architecture to use images instead of text as the…

Computation and Language · Computer Science 2021-06-08 Jing Jiang

The performance of computer vision models in certain real-world applications (e.g., rare wildlife observation) is limited by the small number of available images. Expanding datasets using pre-trained generative models is an effective way to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Changjian Chen , Fei Lv , Yalong Guan , Pengcheng Wang , Shengjie Yu , Yifan Zhang , Zhuo Tang

A growing number of approaches exist to generate explanations for image classification. However, few of these approaches are subjected to human-subject evaluations, partly because it is challenging to design controlled experiments with…

Artificial Intelligence · Computer Science 2021-05-07 Martin Schuessler , Philipp Weiß , Leon Sixt

Generative Adversarial Networks (GANs) have long been used to understand the semantic relationship between the text and image. However, there are problems with mode collapsing in the image generation that causes some preferred output modes.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Naitik Bhise , Zhenfei Zhang , Tien D. Bui

Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generating music that…

Sound · Computer Science 2024-09-13 Tanisha Hisariya , Huan Zhang , Jinhua Liang

We develop a quantitative method to assess the style of American poems and to visualize a collection of poems in relation to one another. Qualitative poetry criticism helped guide our development of metrics that analyze various…

Computation and Language · Computer Science 2023-10-17 David M. Kaplan , David M. Blei

Can a machine write good poetry? Any positive answer raises fundamental questions about the nature and value of art. We report a seven-month poetry workshop in which a large language model was shaped into a digital poet through iterative…

Artificial Intelligence · Computer Science 2026-02-19 Vered Tohar , Tsahi Hayat , Amir Leshem

Recently, a unified model for image-to-image translation tasks within adversarial learning framework has aroused widespread research interests in computer vision practitioners. Their reported empirical success however lacks solid…

Machine Learning · Statistics 2018-06-20 Xudong Pan , Mi Zhang , Daizong Ding

Although psycholinguists and psychologists have long studied the tendency of linguistic strings to evoke mental images in hearers or readers, most computational studies have applied this concept of imageability only to isolated words. Using…

Computation and Language · Computer Science 2024-12-30 Si Wu , David A. Smith

Recent progress in generative models, especially in text-guided diffusion models, has enabled the production of aesthetically-pleasing imagery resembling the works of professional human artists. However, one has to carefully compose the…

Human-Computer Interaction · Computer Science 2023-06-05 Nikita Pavlichenko , Dmitry Ustalov

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

Automatically describing the content of an image is a fundamental problem in artificial intelligence that connects computer vision and natural language processing. In this paper, we present a generative model based on a deep recurrent…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Oriol Vinyals , Alexander Toshev , Samy Bengio , Dumitru Erhan

Natural language provides a widely accessible and expressive interface for robotic agents. To understand language in complex environments, agents must reason about the full range of language inputs and their correspondence to the world.…

Computation and Language · Computer Science 2017-10-03 Stephanie Zhou , Alane Suhr , Yoav Artzi

The impressive capacity shown by recent text-to-image diffusion models to generate high-quality pictures from textual input prompts has leveraged the debate about the very definition of art. Nonetheless, these models have been trained using…

Computation and Language · Computer Science 2022-10-20 Ricardo Kleinlein , Cristina Luna-Jiménez , Fernando Fernández-Martínez