English
Related papers

Related papers: Image Inspired Poetry Generation in XiaoIce

200 papers

To truly understand the visual world our models should be able not only to recognize images but also generate them. To this end, there has been exciting recent progress on generating images from natural language descriptions. These methods…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Justin Johnson , Agrim Gupta , Li Fei-Fei

Recent text-to-image generation methods provide a simple yet exciting conversion capability between text and image domains. While these methods have incrementally improved the generated image fidelity and text relevancy, several pivotal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Oran Gafni , Adam Polyak , Oron Ashual , Shelly Sheynin , Devi Parikh , Yaniv Taigman

The consistent mapping from poems to paintings is essential for the research and restoration of traditional Chinese gardens. But the lack of firsthand ma-terial is a great challenge to the reconstruction work. In this paper, we pro-pose a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Jiaxi Shi1 , Hao Hua1

Emotion recognition and generation have emerged as crucial topics in Artificial Intelligence research, playing a significant role in enhancing human-computer interaction within healthcare, customer service, and other fields. Although…

Machine Learning · Computer Science 2025-02-12 Rebecca Mobbs , Dimitrios Makris , Vasileios Argyriou

Generating metaphors is a difficult task as it requires understanding nuanced relationships between abstract concepts. In this paper, we aim to generate a metaphoric sentence given a literal expression by replacing relevant verbs. Guided by…

Computation and Language · Computer Science 2021-06-03 Kevin Stowe , Tuhin Chakrabarty , Nanyun Peng , Smaranda Muresan , Iryna Gurevych

The way our eyes move while reading can tell us about the cognitive effort required to process the text. In the present study, we use this fact to generate texts with controllable reading ease. Our method employs a model that predicts human…

Computation and Language · Computer Science 2026-01-27 Andreas Säuberli , Darja Jepifanova , Diego Frassinelli , Barbara Plank

Poetry generation has been a difficult task in natural language processing. Unlike plain neural text generation tasks, poetry has a high requirement for novelty, since an easily-understood sentence with too many high frequency words might…

Computation and Language · Computer Science 2021-08-30 Xinran Zhang , Maosong Sun , Jiafeng Liu , Xiaobing Li

Automatic image captioning has recently approached human-level performance due to the latest advances in computer vision and natural language understanding. However, most of the current models can only generate plain factual descriptions…

Computer Vision and Pattern Recognition · Computer Science 2018-01-31 Quanzeng You , Hailin Jin , Jiebo Luo

Deep neural networks have achieved great successes on the image captioning task. However, most of the existing models depend heavily on paired image-sentence datasets, which are very expensive to acquire. In this paper, we make the first…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yang Feng , Lin Ma , Wei Liu , Jiebo Luo

Since the birth of artificial intelligence 70 years ago, attempts at literary "creation" with computers are present in the course of technological development, creating what one might call "artificial intelligence literature" (AI…

Computers and Society · Computer Science 2022-01-10 Tianhua Zhu

Images are capable of conveying emotions, but emotional experience is highly subjective. Advances in artificial intelligence have enabled the generation of images based on emotional descriptions. However, the level of agreement between the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Miguel Carrasco , Cesar Gonzalez-Martin , Sonia Navajas-Torrente , Raul Dastres

The rapid advancement of generative AI has enabled the creation of highly photorealistic visual content, offering practical substitutes for real images and videos in scenarios where acquiring real data is difficult or expensive. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Aniruddha Mukherjee , Spriha Dubey , Somdyuti Paul

Inspiration is linked to various positive outcomes, such as increased creativity, productivity, and happiness. Although inspiration has great potential, there has been limited effort toward identifying content that is inspiring, as opposed…

Computation and Language · Computer Science 2024-06-21 Oana Ignat , Gayathri Ganesh Lakshmy , Rada Mihalcea

Can an algorithm create original and compelling fashion designs to serve as an inspirational assistant? To help answer this question, we design and investigate different image generation models associated with different loss functions to…

Machine Learning · Computer Science 2018-09-17 Othman Sbai , Mohamed Elhoseiny , Antoine Bordes , Yann LeCun , Camille Couprie

Unsupervised Concept Extraction aims to extract concepts from a single image; however, existing methods suffer from the inability to extract composable intrinsic concepts. To address this, this paper introduces a new task called…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hanyu Shi , Hong Tao , Guoheng Huang , Jianbin Jiang , Xuhang Chen , Chi-Man Pun , Shanhu Wang , Pan Pan

Generative AI has increasingly been used for artistic creation, but little work has explored how it shapes the experiential meaning of practice. We consider how generative AI might transform the embodied and tangible process of instant…

Human-Computer Interaction · Computer Science 2026-05-05 Michael Yin , Angela Chiang , Robert Xiao

Recent studies in sequence-to-sequence learning demonstrate that RNN encoder-decoder structure can successfully generate Chinese poetry. However, existing methods can only generate poetry with a given first line or user's intent theme. In…

Computation and Language · Computer Science 2019-11-20 Dayiheng Liu , Quan Guo , Wubo Li , Jiancheng Lv

The rapid development of the Internet has profoundly changed human life. Humans are increasingly expressing themselves and interacting with others on social media platforms. However, although artificial intelligence technology has been…

Computation and Language · Computer Science 2024-07-11 Haochen Xue , Chong Zhang , Chengzhi Liu , Fangyu Wu , Xiaobo Jin

A method for generating narratives by analyzing single images or image sequences is presented, inspired by the time immemorial tradition of Narrative Art. The proposed method explores the multimodal capabilities of GPT-4o to interpret…

Computation and Language · Computer Science 2024-08-22 Edirlei Soares de Lima , Marco A. Casanova , Antonio L. Furtado

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Shantanu Jaiswal , Mihir Prabhudesai , Nikash Bhardwaj , Zheyang Qin , Amir Zadeh , Chuan Li , Katerina Fragkiadaki , Deepak Pathak