English
Related papers

Related papers: Text to Image Generation: Leaving no Language Behi…

200 papers

This study examines how Large Language Models (LLMs) can reduce biases in text-to-image generation systems by modifying user prompts. We define bias as a model's unfair deviation from population statistics given neutral prompts. Our…

Computation and Language · Computer Science 2025-04-16 René Peinl

Recently, language-guided global image editing draws increasing attention with growing application potentials. However, previous GAN-based methods are not only confined to domain-specific, low-resolution data but also lacking in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Jing Shi , Ning Xu , Yihang Xu , Trung Bui , Franck Dernoncourt , Chenliang Xu

In this paper, we focus on generating realistic images from text descriptions. Current methods first generate an initial image with rough shape and color, and then refine the initial image to a high-resolution one. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Minfeng Zhu , Pingbo Pan , Wei Chen , Yi Yang

Translating information between text and image is a fundamental problem in artificial intelligence that connects natural language processing and computer vision. In the past few years, performance in image caption generation has seen…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Hao Dong , Jingqing Zhang , Douglas McIlwraith , Yike Guo

It's useful to automatically transform an image from its original form to some synthetic form (style, partial contents, etc.), while keeping the original structure or semantics. We define this requirement as the "image-to-image translation"…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Hao Dong , Paarth Neekhara , Chao Wu , Yike Guo

Visual generative AI models often encounter challenges related to text-image alignment and reasoning limitations. This paper presents a novel method for selectively enhancing the signal at critical denoising steps, optimizing image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Paul Grimal , Hervé Le Borgne , Olivier Ferret

Recent advances in text-to-image synthesis make it possible to visualize machine imaginations for a given context. On the other hand, when generating text, human writers are gifted at creative visualization, which enhances their writings by…

Computation and Language · Computer Science 2023-02-16 Wanrong Zhu , An Yan , Yujie Lu , Wenda Xu , Xin Eric Wang , Miguel Eckstein , William Yang Wang

Self-rewarding have emerged recently as a powerful tool in the field of Natural Language Processing (NLP), allowing language models to generate high-quality relevant responses by providing their own rewards during training. This innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Safouane El Ghazouali , Arnaud Gucciardi , Umberto Michelucci

AI-generated content is becoming increasingly prevalent in the real world, leading to serious ethical and societal concerns. For instance, adversaries might exploit large multimodal models (LMMs) to create images that violate ethical or…

Computation and Language · Computer Science 2025-04-14 Hongchao Fang , Yixin Liu , Jiangshu Du , Can Qin , Ran Xu , Feng Liu , Lichao Sun , Dongwon Lee , Lifu Huang , Wenpeng Yin

Generative Adversarial Networks (GANs) have been extremely successful in various application domains. Adversarial image synthesis has drawn increasing attention and made tremendous progress in recent years because of its wide range of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 William Roy , Glen Kelly , Robert Leer , Frederick Ricardo

Detecting manipulated images has become a significant emerging challenge. The advent of image sharing platforms and the easy availability of advanced photo editing software have resulted in a large quantities of manipulated images being…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Peng Zhou , Bor-Chun Chen , Xintong Han , Mahyar Najibi , Abhinav Shrivastava , Ser Nam Lim , Larry S. Davis

In this paper, we present an end-to-end approach to generate high-resolution person images conditioned on texts only. State-of-the-art text-to-image generation models are mainly designed for center-object generation, e.g., flowers and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Deyin Liu , Lin Yuanbo Wu , Bo Li , Zongyuan Ge

Research of adversarial attacks is important for AI security because it shows the vulnerability of deep learning models and helps to build more robust models. Adversarial attacks on images are most widely studied, which include noise-based…

Cryptography and Security · Computer Science 2024-10-14 Xiaopei Zhu , Peiyang Xu , Guanning Zeng , Yingpeng Dong , Xiaolin Hu

Altering the content of an image with photo editing tools is a tedious task for an inexperienced user. Especially, when modifying the visual attributes of a specific object in an image without affecting other constituents such as background…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Dawei Zhu , Aditya Mogadala , Dietrich Klakow

The rise of Large Language Models has not been inclusive of all cultures. The models are mostly trained on English texts and culture which makes them underperform in other languages and cultural contexts. By developing a generalizable…

Computation and Language · Computer Science 2025-10-07 Tim Bakkenes , Daniel Wang , Anton Johansson

Artificial Intelligence is present in the generation and distribution of culture. How do artists exploit neural networks? What impact do these algorithms have on artistic practice? Through a practice-based research methodology, this paper…

Human-Computer Interaction · Computer Science 2023-07-18 Varvara Guljajeva , Mar Canet Sola , Isaac Joseph Clarke

Text-to-image generation has evolved beyond single monolithic models to complex multi-component pipelines. These combine fine-tuned generators, adapters, upscaling blocks and even editing steps, leading to significant improvements in image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Uri Gadot , Rinon Gal , Yftah Ziser , Gal Chechik , Shie Mannor

Artificial intelligence is revolutionizing architecture through text-to-image synthesis, converting textual descriptions into detailed visual representations. We explore AI-assisted floor plan design, focusing on technical background,…

Human-Computer Interaction · Computer Science 2024-05-28 Xiaoyu Li , Jonathan Benjamin , Xin Zhang

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

It is a well-known fact that current AI-based language technology -- language models, machine translation systems, multilingual dictionaries and corpora -- focuses on the world's 2-3% most widely spoken languages. Recent research efforts…

Computation and Language · Computer Science 2023-07-26 Gábor Bella , Paula Helm , Gertraud Koch , Fausto Giunchiglia