English
Related papers

Related papers: Trade-offs in Image Generation: How Do Different D…

200 papers

Recent advances in diffusion models have significantly elevated the visual fidelity of Virtual Try-On (VTON) systems, yet reliable evaluation remains a persistent bottleneck. Traditional metrics struggle to quantify fine-grained texture…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jin Li , Tao Chen , Shuai Jiang , Weijie Wang , Jingwen Luo , Chenhui Wu

In recent years, Text-to-Image (T2I) models have been extensively studied, especially with the emergence of diffusion models that achieve state-of-the-art results on T2I synthesis tasks. However, existing benchmarks heavily rely on…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Eslam Mohamed Bakr , Pengzhan Sun , Xiaoqian Shen , Faizan Farooq Khan , Li Erran Li , Mohamed Elhoseiny

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

Virtual Try-On (VTON) has seen rapid advancements, providing a strong foundation for generative fashion tasks. However, the inverse problem, Virtual Try-Off (VTOFF)-aimed at reconstructing the canonical garment from a draped-on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Loc-Phat Truong , Meysam Madadi , Sergio Escalera

Achieving Artificial General Intelligence (AGI) requires agents that learn and interact adaptively, with interactive world models providing scalable environments for perception, reasoning, and action. Yet current research still lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jianjie Fang , Yingshan Lei , Qin Wan , Ziyou Wang , Yuchao Huang , Yongyan Xu , Baining Zhao , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

Text-to-Image (T2I) diffusion models have shown impressive results in generating visually compelling images following user prompts. Building on this, various methods further fine-tune the pre-trained T2I model for specific tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tsu-Jui Fu , Yusu Qian , Chen Chen , Wenze Hu , Zhe Gan , Yinfei Yang

The findings of the 2023 AAPM Grand Challenge on Deep Generative Modeling for Learning Medical Image Statistics are reported in this Special Report. The goal of this challenge was to promote the development of deep generative models (DGMs)…

Image and Video Processing · Electrical Eng. & Systems 2024-05-06 Rucha Deshpande , Varun A. Kelkar , Dimitrios Gotsis , Prabhat Kc , Rongping Zeng , Kyle J. Myers , Frank J. Brooks , Mark A. Anastasio

Unified multimodal models integrate the reasoning capacity of large language models with both image understanding and generation, showing great promise for advanced multimodal intelligence. However, the community still lacks a rigorous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hongxiang Li , Yaowei Li , Bin Lin , Yuwei Niu , Yuhang Yang , Xiaoshuang Huang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Long Chen

Top-down images play an important role in safety-critical settings such as autonomous navigation and aerial surveillance, where they provide holistic spatial information that front-view images cannot capture. Despite this, Vision Language…

Machine Learning · Computer Science 2025-10-02 Kaiyuan Hou , Minghui Zhao , Lilin Xu , Yuang Fan , Xiaofan Jiang

The rapid advancements of Text-to-Image (T2I) models have ushered in a new phase of AI-generated content, marked by their growing ability to interpret and follow user instructions. However, existing T2I model evaluation benchmarks fall…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xinyu Wei , Jinrui Zhang , Zeqing Wang , Hongyang Wei , Zhen Guo , Lei Zhang

Virtual try-on, which aims to seamlessly fit garments onto person images, has recently seen significant progress with diffusion-based models. However, existing methods commonly resort to duplicated backbones or additional image encoders to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Haifeng Ni , Ming Xu

Virtual try-on (VTON) has been widely explored for rendering garments onto person images, while its inverse task, virtual try-off (VTOFF), remains largely overlooked. VTOFF aims to recover standardized product images of garments directly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Davide Lobba , Fulvio Sanguigni , Bin Ren , Marcella Cornia , Rita Cucchiara , Nicu Sebe

Multimodal Dialogue Response Generation (MDRG) is a recently proposed task where the model needs to generate responses in texts, images, or a blend of both based on the dialogue context. Due to the lack of a large-scale dataset specifically…

Artificial Intelligence · Computer Science 2024-08-13 Hee Suk Yoon , Eunseop Yoon , Joshua Tian Jin Tee , Kang Zhang , Yu-Jung Heo , Du-Seong Chang , Chang D. Yoo

Precise spatial fidelity in Image-to-3D multi-instance generation is critical for downstream real-world applications. Recent work attempts to address this by fine-tuning pre-trained Image-to-3D (I23D) models on multi-instance datasets,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xiao Cai , Lianli Gao , Pengpeng Zeng , Ji Zhang , Heng Tao Shen , Jingkuan Song

Deep neural networks trained with different architectures, objectives, and datasets have been reported to converge on similar visual representations. However, what remains unknown is which visual properties models actually converge on and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Florian P. Mahner , Johannes Roth , Ka Chun Lam , Michael F. Bonner , Francisco Pereira , Martin N. Hebart

Despite their wide-spread success, Text-to-Image models (T2I) still struggle to produce images that are both aesthetically pleasing and faithful to the user's input text. We introduce DreamSync, a model-agnostic training algorithm by design…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jiao Sun , Deqing Fu , Yushi Hu , Su Wang , Royi Rassin , Da-Cheng Juan , Dana Alon , Charles Herrmann , Sjoerd van Steenkiste , Ranjay Krishna , Cyrus Rashtchian

Generative modeling is widely regarded as one of the most essential problems in today's AI community, with text-to-image generation having gained unprecedented real-world impacts. Among various approaches, diffusion models have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Xuyang Guo , Jiayan Huo , Yingyu Liang , Zhenmei Shi , Zhao Song , Jiahao Zhang , Zhen Zhuang

Subject-driven text-to-image (T2I) generation aims to produce images that align with a given textual description, while preserving the visual identity from a referenced subject image. Despite its broad downstream applicability - ranging…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Aviv Slobodkin , Hagai Taitelbaum , Yonatan Bitton , Brian Gordon , Michal Sokolik , Nitzan Bitton Guetta , Almog Gueta , Royi Rassin , Dani Lischinski , Idan Szpektor

The rapid development and reduced barriers to entry for Text-to-Image (T2I) models have raised concerns about the biases in their outputs, but existing research lacks a holistic definition and evaluation framework of biases, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Hanjun Luo , Ziye Deng , Ruizhe Chen , Zuozhu Liu

Evaluating the realism of generated images remains a fundamental challenge in generative modeling. Existing distributional metrics such as the Frechet Inception Distance (FID) and CLIP-MMD (CMMD) compare feature distributions at a semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Joé Napolitano , Pascal Nguyen