English
Related papers

Related papers: Scientific Image Synthesis: Benchmarking, Methodol…

200 papers

Text-and-Image-To-Image (TI2I), an extension of Text-To-Image (T2I), integrates image inputs with textual instructions to enhance image generation. Existing methods often partially utilize image inputs, focusing on specific elements like…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Teng-Fang Hsiao , Bo-Kai Ruan , Yi-Lun Wu , Tzu-Ling Lin , Hong-Han Shuai

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

The transformative potential of text-to-image (T2I) models hinges on their ability to synthesize culturally diverse, photorealistic images from textual prompts. However, these models often perpetuate cultural biases embedded within their…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Muna Numan Said , Aarib Zaidi , Rabia Usman , Sonia Okon , Praneeth Medepalli , Kevin Zhu , Vasu Sharma , Sean O'Brien

Text-to-image (T2I) generation models have significantly advanced in recent years. However, effective interaction with these models is challenging for average users due to the need for specialized prompt engineering knowledge and the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Minbin Huang , Yanxin Long , Xinchi Deng , Ruihang Chu , Jiangfeng Xiong , Xiaodan Liang , Hong Cheng , Qinglin Lu , Wei Liu

Due to the availability of increasingly large amounts of visual data, there is a growing need for tools that can help users find relevant images. While existing tools can perform image retrieval based on similarity or metadata, they fall…

Human-Computer Interaction · Computer Science 2024-01-22 Celeste Barnaby , Qiaochu Chen , Chenglong Wang , Isil Dillig

Image-to-image translation (I2I) is defined as a computer vision task where the aim is to transfer images in a source domain to a target domain with minimal loss or alteration of the content representations. Major progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Zhuohao Yin

Generative models have achieved impressive fidelity in text-to-image synthesis, yet struggle with complex compositional prompts involving multiple constraints. We introduce \textbf{M3 (Multi-Modal, Multi-Agent, Multi-Round)}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Bangji Yang , Ruihan Guo , Jiajun Fan , Chaoran Cheng , Ge Liu

Multimodal large language models (LLMs) have demonstrated impressive capabilities in generating high-quality images from textual instructions. However, their performance in generating scientific images--a critical application for…

Text-to-image (T2I) models based on diffusion processes have achieved remarkable success in controllable image generation using user-provided captions. However, the tight coupling between the current text encoder and image decoder in T2I…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Can Qin , Ning Yu , Chen Xing , Shu Zhang , Zeyuan Chen , Stefano Ermon , Yun Fu , Caiming Xiong , Ran Xu

We present an approach to synthesizing photographic images conditioned on semantic layouts. Given a semantic label map, our approach produces an image with photographic appearance that conforms to the input layout. The approach thus…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Qifeng Chen , Vladlen Koltun

The ability to distinguish whether an image is generated by artificial intelligence (AI) is a crucial ingredient in human intelligence, usually accompanied by a complex and dialectical forensic and reasoning process. However, current fake…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yixuan Li , Xuelin Liu , Xiaoyang Wang , Bu Sung Lee , Shiqi Wang , Anderson Rocha , Weisi Lin

Text-to-Image generation has evolved from basic image synthesis into a frequently used core capability in professional creative workflows, where simple text-image alignment can no longer satisfy users' pressing demands for faithful…

Constructing scientific multimodal document reasoning datasets for foundation model training involves an inherent trade-off among scale, faithfulness, and realism. To address this challenge, we introduce the synthesize-and-reground…

Computation and Language · Computer Science 2026-04-30 Ziyu Chen , Yilun Zhao , Chengye Wang , Rilyn Han , Manasi Patwardhan , Arman Cohan

Text-to-image generation has recently seen remarkable success, granting users with the ability to create high-quality images through the use of text. However, contemporary methods face challenges in capturing the precise semantics conveyed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shay Shomer-Chai , Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor

Despite the impressive text-to-image (T2I) synthesis capabilities of diffusion models, they often struggle to understand compositional relationships between objects and attributes, especially in complex settings. Existing solutions have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Evans Xu Han , Linghao Jin , Xiaofeng Liu , Paul Pu Liang

Recent text-to-image (T2I) models have made remarkable progress in generating visually realistic and semantically coherent images. However, they still suffer from randomness and inconsistency with the given prompts, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Kaishen Wang , Ruibo Chen , Tong Zheng , Heng Huang

Recent advancements in text-to-image (T2I) generation have enabled models to produce high-quality images from textual descriptions. However, these models often struggle with complex instructions involving multiple objects, attributes, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Yucheng Zhou , Jiahao Yuan , Qianning Wang

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

Cryptography and Security · Computer Science 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Medical image synthesis is crucial for alleviating data scarcity and privacy constraints. However, fine-tuning general text-to-image (T2I) models remains challenging, mainly due to the significant modality gap between complex visual details…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xin Huang , Junjie Liang , Qingshan Hou , Peng Cao , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji