English
Related papers

Related papers: Memory Efficient Diffusion Probabilistic Models vi…

200 papers

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

Neural-network-based approaches recently emerged in the field of data compression and have already led to significant progress in image compression, especially in achieving a higher compression ratio. In the lossless image compression…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Yuan Lan , Liang Qin , Zhaoyi Sun , Yang Xiang , Jie Sun

Current state-of-the-art methods for video inpainting typically rely on optical flow or attention-based approaches to inpaint masked regions by propagating visual information across frames. While such approaches have led to significant…

Recent advancements in generative models have revolutionized the field of artificial intelligence, enabling the creation of highly-realistic and detailed images. In this study, we propose a novel Mask Conditional Text-to-Image Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Rami Skaik , Leonardo Rossi , Tomaso Fontanini , Andrea Prati

Two-dimensional array-based datasets are pervasive in a variety of domains. Current approaches for generative modeling have typically been limited to conventional image datasets and performed in the pixel domain which do not explicitly…

Machine Learning · Computer Science 2021-07-12 Hoda Shajari , Jaemoon Lee , Sanjay Ranka , Anand Rangarajan

Diffusion-based generative models are machine learning models that use diffusion processes to learn the probability distribution of high-dimensional data. In recent years, they have become extremely successful in generating multimedia…

Disordered Systems and Neural Networks · Physics 2025-02-12 Stefano Bae , Enzo Marinari , Federico Ricci-Tersenghi

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. Typical diffusion models and modern large-scale conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Image generation in the fashion domain has predominantly focused on preserving body characteristics or following input prompts, but little attention has been paid to improving the inherent fashionability of the output images. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Qice Qin , Yuki Hirakawa , Ryotaro Shimizu , Takuya Furusawa , Edgar Simo-Serra

Recent work has showcased the significant potential of diffusion models in pose-guided person image synthesis. However, owing to the inconsistency in pose between the source and target images, synthesizing an image with a distinct pose,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Fei Shen , Hu Ye , Jun Zhang , Cong Wang , Xiao Han , Wei Yang

Deep neural networks have brought remarkable breakthroughs in medical image analysis. However, due to their data-hungry nature, the modest dataset sizes in medical imaging projects might be hindering their full potential. Generating…

Diffusion models have achieved state-of-the-art results on many modalities including images, speech, and video. However, existing models are not tailored to support remote sensing data, which is widely used in important applications…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Samar Khanna , Patrick Liu , Linqi Zhou , Chenlin Meng , Robin Rombach , Marshall Burke , David Lobell , Stefano Ermon

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zakaria Patel , Kirill Serkh

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

Many traditional computer vision algorithms generate realistic images by requiring that each patch in the generated image be similar to a patch in a training image and vice versa. Recently, this classical approach has been replaced by…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Ariel Elnekave , Yair Weiss

Large-scale diffusion models have achieved remarkable success in generating high-quality images from textual descriptions, gaining popularity across various applications. However, the generation of layered content, such as transparent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yusuf Dalva , Yijun Li , Qing Liu , Nanxuan Zhao , Jianming Zhang , Zhe Lin , Pinar Yanardag

Most existing cross-modal generative methods based on diffusion models use guidance to provide control over the latent space to enable conditional generation across different modalities. Such methods focus on providing guidance through…

Machine Learning · Computer Science 2023-05-31 Zizhao Hu , Mohammad Rostami

Neural networks are known to be susceptible to adversarial samples: small variations of natural examples crafted to deliberately mislead the models. While they can be easily generated using gradient-based techniques in digital and physical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haotian Xue , Alexandre Araujo , Bin Hu , Yongxin Chen

Generative adversarial networks (GANs) are frequently utilized in astronomy to construct an emulator of numerical simulations. Nevertheless, training GANs can prove to be a precarious task, as they are prone to instability and often lead to…

Instrumentation and Methods for Astrophysics · Physics 2023-11-14 Xiaosheng Zhao , Yuan-Sen Ting , Kangning Diao , Yi Mao

We argue that diffusion models' success in modeling complex distributions is, for the most part, coming from their input conditioning. This paper investigates the representation used to condition diffusion models from the perspective that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Samuel Lavoie , Michael Noukhovitch , Aaron Courville

Denoising diffusion models have recently achieved state-of-the-art performance in many image-generation tasks. They do, however, require a large amount of computational resources. This limits their application to medical tasks, where we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Florentin Bieder , Julia Wolleb , Alicia Durrer , Robin Sandkühler , Philippe C. Cattin