English
Related papers

Related papers: BLIP3o-NEXT: Next Frontier of Native Image Generat…

200 papers

Diffusion models have revitalized the image generation domain, playing crucial roles in both academic research and artistic expression. With the emergence of new diffusion models, assessing the performance of text-to-image models has become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chutian Meng , Fan Ma , Jiaxu Miao , Chi Zhang , Yi Yang , Yueting Zhuang

We present LayerDiffuse, an approach enabling large-scale pretrained latent diffusion models to generate transparent images. The method allows generation of single transparent images or of multiple transparent layers. The method learns a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Lvmin Zhang , Maneesh Agrawala

Diffusion models have emerged as the best approach for generative modeling of 2D images. Part of their success is due to the possibility of training them on millions if not billions of images with a stable learning objective. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Animesh Karnewar , Andrea Vedaldi , David Novotny , Niloy Mitra

Natural language offers a highly intuitive interface for image editing. In this paper, we introduce the first solution for performing local (region-based) edits in generic natural images, based on a natural language description along with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Omri Avrahami , Dani Lischinski , Ohad Fried

Text-to-image diffusion models sometimes depict blended concepts in the generated images. One promising use case of this effect would be the nonword-to-image generation task which attempts to generate images intuitively imaginable from a…

Multimedia · Computer Science 2024-11-07 Chihaya Matsuhira , Marc A. Kastner , Takahiro Komamizu , Takatsugu Hirayama , Ichiro Ide

Recently, diffusion models have demonstrated impressive capabilities in text-guided and image-conditioned image generation. However, existing diffusion models cannot simultaneously generate an image and a panoptic segmentation of objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yinghan Long , Kaushik Roy

In recent years, image editing models have witnessed remarkable and rapid development. The recent unveiling of cutting-edge multimodal models such as GPT-4o and Gemini2 Flash has introduced highly promising image editing capabilities. These…

Recent studies have demonstrated that the forward diffusion process is crucial for the effectiveness of diffusion models in terms of generative quality and sampling efficiency. We propose incorporating an analytical image attenuation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuhang Huang , Zheng Qin , Xinwang Liu , Kai Xu

3D scene generation is in high demand across various domains, including virtual reality, gaming, and the film industry. Owing to the powerful generative capabilities of text-to-image diffusion models that provide reliable priors, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Haiyang Zhou , Xinhua Cheng , Wangbo Yu , Yonghong Tian , Li Yuan

Recent advances in diffusion models have enabled high-quality image generation, leading to increasing demand for post-generation editing that modifies local regions while preserving global structure. Achieving such flexible and precise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Hanyi Wang , Han Fang , Zheng Wang , Shilin Wang , Ee-Chien Chang

Deep learning is providing a wealth of new approaches to the problem of novel view synthesis, from Neural Radiance Field (NeRF) based approaches to end-to-end style architectures. Each approach offers specific strengths but also comes with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Bernard Spiegl , Andrea Perin , Stéphane Deny , Alexander Ilin

We present Acc3D to tackle the challenge of accelerating the diffusion process to generate 3D models from single images. To derive high-quality reconstructions through few-step inferences, we emphasize the critical issue of regularizing the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Kendong Liu , Zhiyu Zhu , Hui Liu , Junhui Hou

The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Chia-Hern Lai , I-Hsuan Lo , Yen-Ku Yeh , Thanh-Nguyen Truong , Ching-Chun Huang

Artificial Intelligence-Generated Content (AIGC) has made significant strides, with high-resolution text-to-image (T2I) generation becoming increasingly critical for improving users' Quality of Experience (QoE). Although…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Chongbin Yi , Yuxin Liang , Ziqi Zhou , Peng Yang

Stable diffusion models have ushered in a new era of advancements in image generation, currently reigning as the state-of-the-art approach, exhibiting unparalleled performance. The process of diffusion, accompanied by denoising through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Andras Horvath

This study presents a novel approach to enhance the cost-to-quality ratio of image generation with diffusion models. We hypothesize that differences between distilled (e.g. FLUX.1-schnell) and baseline (e.g. FLUX.1-dev) models are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Jakub Wasala , Bartlomiej Wrzalski , Kornelia Noculak , Yuliia Tarasenko , Oliwer Krupa , Jan Kocon , Grzegorz Chodak

Diffusion models equipped with language models demonstrate excellent controllability in image generation tasks, allowing image processing to adhere to human instructions. However, the lack of diverse instruction-following data hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yongsheng Yu , Ziyun Zeng , Hang Hua , Jianlong Fu , Jiebo Luo

In autoregressive (AR) image generation, models based on the 'next-token prediction' paradigm of LLMs have shown comparable performance to diffusion models by reducing inductive biases. However, directly applying LLMs to complex image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Miaomiao Cai , Guanjie Wang , Wei Li , Zhijun Tu , Hanting Chen , Shaohui Lin , Jie Hu

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu

Autoregressive models have achieved significant success in image generation. However, unlike the inherent hierarchical structure of image information in the spectral domain, standard autoregressive methods typically generate pixels…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Zhihao Huang , Xi Qiu , Yukuo Ma , Yifu Zhou , Junjie Chen , Hongyuan Zhang , Chi Zhang , Xuelong Li