English
Related papers

Related papers: Streamlining Image Editing with Layered Diffusion …

200 papers

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

Images can be viewed as layered compositions, foreground objects over background, with potential occlusions. This layered representation enables independent editing of elements, offering greater flexibility for content creation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingxi Chen , Yixiao Zhang , Xiaoye Qian , Zongxia Li , Cornelia Fermuller , Caren Chen , Yiannis Aloimonos

Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Sherry X. Chen , Yaron Vaxman , Elad Ben Baruch , David Asulin , Aviad Moreshet , Kuo-Chin Lien , Misha Sra , Pradeep Sen

Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yu Shi , Yu Liu , Zhong-Cheng Wu , Juan Cheng , Huafeng Li , Xun Chen

Image denoising is a fundamental problem in computational photography, where achieving high perception with low distortion is highly demanding. Current methods either struggle with perceptual quality or suffer from significant distortion.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Tong Li , Hansen Feng , Lizhi Wang , Zhiwei Xiong , Hua Huang

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain the final output,…

Diffusion-based image editing has made semantic level image manipulation easy for general users, but it also enables realistic local forgeries that are hard to localize. Existing benchmarks mainly focus on the binary detection of generated…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Rui Zhang , Hongxia Wang , Hangqing Liu , Yang Zhou , Qiang Zeng

Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as view-consistent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Zexiang Xu , Matthew Fisher , Paul Henderson , Hakan Bilen , Niloy J. Mitra , Paul Guerrero

Video diffusion models have revolutionized generative video synthesis, but they are imprecise, slow, and can be opaque during generation -- keeping users in the dark for a prolonged period. In this work, we propose DiffusionBrowser, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Susung Hong , Chongjian Ge , Zhifei Zhang , Jui-Hsien Wang

Generating high-quality labeled image datasets is crucial for training accurate and robust machine learning models in the field of computer vision. However, the process of manually labeling real images is often time-consuming and costly. To…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Michael Shenoda , Edward Kim

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

Recent advances in Diffusion Models (DMs) have led to significant progress in visual synthesis and editing tasks, establishing them as a strong competitor to Generative Adversarial Networks (GANs). However, the latent space of DMs is not as…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Theodoros Kouzelis , Manos Plitsis , Mihalis A. Nicolaou , Yannis Panagakis

Traditional point-based image editing methods rely on iterative latent optimization or geometric transformations, which are either inefficient in their processing or fail to capture the semantic relationships within the image. These methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Biao Yang , Muqi Huang , Yuhui Zhang , Yun Xiong , Kun Zhou , Xi Chen , Shiyang Zhou , Huishuai Bao , Chuan Li , Feng Shi , Hualei Liu

Computational imaging is crucial in many disciplines from autonomous driving to life sciences. However, traditional model-driven and iterative methods consume large computational power and lack scalability for imaging. Deep learning (DL) is…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Weiru Fan , Xiaobin Tang , Yiyi Liao , Da-Wei Wang

Diffusion models excel at generating photo-realistic images but come with significant computational costs in both training and sampling. While various techniques address these computational challenges, a less-explored issue is designing an…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Huangjie Zheng , Zhendong Wang , Jianbo Yuan , Guanghan Ning , Pengcheng He , Quanzeng You , Hongxia Yang , Mingyuan Zhou

Hiding data using neural networks (i.e., neural steganography) has achieved remarkable success across both discriminative classifiers and generative adversarial networks. However, the potential of data hiding in diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyu Chen , Yunqiao Yang , Nan Zhong , Kede Ma

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Diffusion models have recently shown the ability to generate high-quality images. However, controlling its generation process still poses challenges. The image style transfer task is one of those challenges that transfers the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Kento Masui , Mayu Otani , Masahiro Nomura , Hideki Nakayama

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai

Denoising Diffusion models are gaining increasing popularity in the field of generative modeling for several reasons, including the simple and stable training, the excellent generative quality, and the solid probabilistic foundation. In…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Andrea Asperti , Davide Evangelista , Samuele Marro , Fabio Merizzi