English
Related papers

Related papers: MegaFusion: Extend Diffusion Models towards Higher…

200 papers

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Text-to-image generation (TTI) refers to the usage of models that could process text input and generate high fidelity images based on text descriptions. Text-to-image generation using neural networks could be traced back to the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Fengxiang Bie , Yibo Yang , Zhongzhu Zhou , Adam Ghanem , Minjia Zhang , Zhewei Yao , Xiaoxia Wu , Connor Holmes , Pareesa Golnari , David A. Clifton , Yuxiong He , Dacheng Tao , Shuaiwen Leon Song

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Image inpainting aims to fill in the missing pixels with visually coherent and semantically plausible content. Despite the great progress brought from deep generative models, this task still suffers from i. the difficulties in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Siyuan Yang , Lu Zhang , Liqian Ma , Yu Liu , JingJing Fu , You He

Recent advancements in large scale text-to-image models have opened new possibilities for guiding the creation of images through human-devised natural language. However, while prior literature has primarily focused on the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Hyeonho Jeong , Gihyun Kwon , Jong Chul Ye

Image fusion aims to combine information from multiple source images into a single one with more comprehensive informational content. Deep learning-based image fusion algorithms face significant challenges, including the lack of a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Haowen Bai , Zixiang Zhao , Jiangshe Zhang , Yichen Wu , Lilun Deng , Yukun Cui , Shuang Xu , Baisong Jiang

The use of denoising diffusion models is becoming increasingly popular in the field of image editing. However, current approaches often rely on either image-guided methods, which provide a visual reference but lack control over semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zhanbo Feng , Zenan Ling , Xinyu Lu , Ci Gong , Feng Zhou , Wugedele Bao , Jie Li , Fan Yang , Robert C. Qiu

Multifocus image fusion is an effective way to overcome the limitation of optical lenses. Many existing methods obtain fused results by generating decision maps. However, such methods often assume that the focused areas of the two source…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Huafeng Li , Dan Wang , Yuxin Huang , Yafei Zhang , Zhengtao Yu

Diffusion generative models have recently greatly improved the power of text-conditioned image generation. Existing image generation models mainly include text conditional diffusion model and cross-modal guided diffusion model, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Wei Li , Xue Xu , Xinyan Xiao , Jiachen Liu , Hu Yang , Guohao Li , Zhanpeng Wang , Zhifan Feng , Qiaoqiao She , Yajuan Lyu , Hua Wu

Image fusion seeks to seamlessly integrate foreground objects with background scenes, producing realistic and harmonious fused images. Unlike existing methods that directly insert objects into the background, adaptive and interactive fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junjia Huang , Pengxiang Yan , Jiyang Liu , Jie Wu , Zhao Wang , Yitong Wang , Liang Lin , Guanbin Li

Advanced image fusion methods are devoted to generating the fusion results by aggregating the complementary information conveyed by the source images. However, the difference in the source-specific manifestation of the imaged scene content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Chunyang Cheng , Tianyang Xu , Xiao-Jun Wu , Hui Li , Xi Li , Zhangyong Tang , Josef Kittler

We present a one-shot text-to-image diffusion model that can generate high-resolution images from natural language descriptions. Our model employs a layered U-Net architecture that simultaneously synthesizes images at multiple resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Emaad Khwaja , Abdullah Rashwan , Ting Chen , Oliver Wang , Suraj Kothawade , Yeqing Li

Existing text-to-image diffusion models excel at generating high-quality images, but face significant efficiency challenges when scaled to high resolutions, like 4K image generation. While previous research accelerates diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Wenkun He , Yuchao Gu , Junyu Chen , Dongyun Zou , Yujun Lin , Zhekai Zhang , Haocheng Xi , Muyang Li , Ligeng Zhu , Jincheng Yu , Junsong Chen , Enze Xie , Song Han , Han Cai

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski

Image diffusion models, trained on massive image collections, have emerged as the most versatile image generator model in terms of quality and diversity. They support inverting real images and conditional (e.g., text) generation, making…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Duygu Ceylan , Chun-Hao Paul Huang , Niloy J. Mitra

Large-scale, big-variant, high-quality data are crucial for developing robust and successful deep-learning models for medical applications since they potentially enable better generalization performance and avoid overfitting. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zheyuan Zhang , Lanhong Yao , Bin Wang , Debesh Jha , Gorkem Durak , Elif Keles , Alpay Medetalibeyoglu , Ulas Bagci

Stereo images are fundamental to numerous applications, including extended reality (XR) devices, autonomous driving, and robotics. Unfortunately, acquiring high-quality stereo images remains challenging due to the precise calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Feng Qiao , Zhexiao Xiong , Eric Xing , Nathan Jacobs

Capturing high dynamic range (HDR) scenes is one of the most important issues in camera design. Majority of cameras use exposure fusion, which fuses images captured by different exposure levels, to increase dynamic range. However, this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Zixuan Chen , Yujin Wang , Xin Cai , Zhiyuan You , Zheming Lu , Fan Zhang , Shi Guo , Tianfan Xue

Current state-of-the-art image generation models such as Latent Diffusion Models (LDMs) have demonstrated the capacity to produce visually striking food-related images. However, these generated images often exhibit an artistic or surreal…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Olivia Markham , Yuhao Chen , Chi-en Amy Tai , Alexander Wong

Image restoration tasks like deblurring, denoising, and dehazing usually need distinct models for each degradation type, restricting their generalization in real-world scenarios with mixed or unknown degradations. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Wenyang Luo , Haina Qin , Zewen Chen , Libin Wang , Dandan Zheng , Yuming Li , Yufan Liu , Bing Li , Weiming Hu