English
Related papers

Related papers: oboro: Text-to-Image Synthesis on Limited Data usi…

200 papers

Fine-grained open-set recognition (FineOSR) aims to recognize images belonging to classes with subtle appearance differences while rejecting images of unknown classes. A recent trend in OSR shows the benefit of generative models to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Wentao Bao , Qi Yu , Yu Kong

Textual content in images is crucial in e-commerce sectors, particularly in marketing campaigns, product imaging, advertising, and the entertainment industry. Current text-to-image (T2I) generation diffusion models, though proficient at…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Shubham Singh Paliwal , Arushi Jain , Monika Sharma , Vikram Jamwal , Lovekesh Vig

The most advanced text-to-image (T2I) models require significant training costs (e.g., millions of GPU hours), seriously hindering the fundamental innovation for the AIGC community while increasing CO2 emissions. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Junsong Chen , Jincheng Yu , Chongjian Ge , Lewei Yao , Enze Xie , Yue Wu , Zhongdao Wang , James Kwok , Ping Luo , Huchuan Lu , Zhenguo Li

Recent advancements in text-to-image diffusion models have shown remarkable creative capabilities with textual prompts, but generating personalized instances based on specific subjects, known as subject-driven generation, remains…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Shanyan Guan , Yanhao Ge , Ying Tai , Jian Yang , Wei Li , Mingyu You

Zero-shot and few-shot learning aim to improve generalization to unseen concepts, which are promising in many realistic scenarios. Due to the lack of data in unseen domain, relation modeling between seen and unseen domains is vital for…

Machine Learning · Computer Science 2019-09-02 Chenrui Zhang , Xiaoqing Lyu , Zhi Tang

Recent advancements in image generative foundation models have prioritized quality improvements but often at the cost of increased computational complexity and inference latency. To address this critical trade-off, we introduce HiDream-I1,…

Images generated by most of generative models trained with limited data often exhibit deficiencies in either fidelity, diversity, or both. One effective solution to address the limitation is few-shot generative model adaption. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yuexing Han , Liheng Ruan , Bing Wang

Diffusion Transformer (DiT) architectures have significantly advanced Text-to-Image (T2I) generation but suffer from prohibitive computational costs and deployment barriers. To address these challenges, we propose an efficient compression…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Chaojie Yang , Tian Li , Yue Zhang , Jun Gao

Image generation has achieved remarkable progress with the development of large-scale text-to-image models, especially diffusion-based models. However, generating human images with plausible details, such as faces or hands, remains…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yuxuan Wang , Tianwei Cao , Huayu Zhang , Zhongjiang He , Kongming Liang , Zhanyu Ma

Recently, video generation has achieved significant rapid development based on superior text-to-image generation techniques. In this work, we propose a high fidelity framework for image-to-video generation, named AtomoVideo. Based on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Litong Gong , Yiran Zhu , Weijie Li , Xiaoyang Kang , Biao Wang , Tiezheng Ge , Bo Zheng

Recent years have witnessed remarkable progress in image generation task, where users can create visually astonishing images with high-quality. However, existing text-to-image diffusion models are proficient in generating concrete concepts…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jingyuan Yang , Jiawei Feng , Hui Huang

We introduce Lumina-DiMOO, an open-source foundational model for seamless multi-modal generation and understanding. Lumina-DiMOO sets itself apart from prior unified models by utilizing a fully discrete diffusion modeling to handle inputs…

A novel accelerated mobile edge generation (MEG) framework is proposed for generating high-resolution images on mobile devices. Exploiting a large-scale latent diffusion model (LDM) distributed across edge server (ES) and user equipment…

Systems and Control · Electrical Eng. & Systems 2024-08-08 Xiaoxia Xu , Yuanwei Liu , Xidong Mu , Hong Xing , Arumugam Nallanathan

We present ObjBlur, a novel curriculum learning approach to improve layout-to-image generation models, where the task is to produce realistic images from layouts composed of boxes and labels. Our method is based on progressive object-level…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Stanislav Frolov , Brian B. Moser , Sebastian Palacio , Andreas Dengel

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , Kfir Aberman

Effective connectivity estimation plays a crucial role in understanding the interactions and information flow between different brain regions. However, the functional time series used for estimating effective connectivity is derived from…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Qiankun Zuo , Ling Chen , Yanyan Shen , Michael Kwok-Po Ng , Baiying Lei , Shuqiang Wang

Diffusion models excel at image generation. Recent studies have shown that these models not only generate high-quality images but also encode text-image alignment information through attention maps or loss functions. This information is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Qin Zhou , Zhiyang Zhang , Jinglong Wang , Xiaobin Li , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Recent advancements in large scale text-to-image models have opened new possibilities for guiding the creation of images through human-devised natural language. However, while prior literature has primarily focused on the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Hyeonho Jeong , Gihyun Kwon , Jong Chul Ye

Diffusion-based text-to-image (T2I) models have made remarkable progress in generating photorealistic and semantically rich images. However, when the target concepts lie in low-density regions of the training distribution, these models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Kwanyoung Lee , SeungJu Cha , Yebin Ahn , Hyunwoo Oh , Sungho Koh , Dong-Jin Kim

Optical illusion hidden picture is an interesting visual perceptual phenomenon where an image is cleverly integrated into another picture in a way that is not immediately obvious to the viewer. Established on the off-the-shelf text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Xiang Gao , Shuai Yang , Jiaying Liu