English
Related papers

Related papers: Controlling the Latent Diffusion Model for Generat…

200 papers

Low-light photography produces images with low signal-to-noise ratios due to limited photons. In such conditions, common approximations like the Gaussian noise model fall short, and many denoising techniques fail to remove noise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Liying Lu , Raphaël Achddou , Sabine Süsstrunk

Unified image restoration is a significantly challenging task in low-level vision. Existing methods either make tailored designs for specific tasks, limiting their generalizability across various types of degradation, or rely on training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Huaqiu Li , Yong Wang , Tongwen Huang , Hailang Huang , Haoqian Wang , Xiangxiang Chu

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Single-image reflection removal is a highly ill-posed problem, where existing methods struggle to reason about the composition of corrupted regions, causing them to fail at recovery and generalization in the wild. This work reframes an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Mingjia Li , Jin Hu , Hainuo Wang , Qiming Hu , Jiarui Wang , Xiaojie Guo

Generating high-resolution images with generative models has recently been made widely accessible by leveraging diffusion models pre-trained on large-scale datasets. Various techniques, such as MultiDiffusion and SyncDiffusion, have further…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Stanislav Frolov , Brian B. Moser , Andreas Dengel

Generative steganography is the process of hiding secret messages in generated images instead of cover images. Existing studies on generative steganography use GAN or Flow models to obtain high hiding message capacity and anti-detection…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Daegyu Kim , Chaehun Shin , Jooyoung Choi , Dahuin Jung , Sungroh Yoon

Generative models now produce images with such stunning realism that they can easily deceive the human eye. While this progress unlocks vast creative potential, it also presents significant risks, such as the spread of misinformation.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yichi Zhang , Xiaogang Xu

Scaling by training on large datasets has been shown to enhance the quality and fidelity of image generation and manipulation with diffusion models; however, such large datasets are not always accessible in medical imaging due to cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yousef Yeganeh , Azade Farshad , Ioannis Charisiadis , Marta Hasny , Martin Hartenberger , Björn Ommer , Nassir Navab , Ehsan Adeli

Controllable image synthesis with user scribbles has gained huge public interest with the recent advent of text-conditioned latent diffusion models. The user scribbles control the color composition while the text prompt provides control…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jaskirat Singh , Stephen Gould , Liang Zheng

Recently, diffusion models have achieved great success in image synthesis. However, when it comes to the layout-to-image generation where an image often has a complex scene of multiple objects, how to make strong control over both the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Guangcong Zheng , Xianpan Zhou , Xuewei Li , Zhongang Qi , Ying Shan , Xi Li

The evolutionary processes of complex systems contain critical information regarding their functional characteristics. The generation time of edges provides insights into the historical evolution of various networked complex systems, such…

Artificial Intelligence · Computer Science 2025-01-14 En Xu , Can Rong , Jingtao Ding , Yong Li

Diffusion models have achieved significant progress in image generation. The pre-trained Stable Diffusion (SD) models are helpful for image deblurring by providing clear image priors. However, directly using a blurry image or pre-deblurred…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Lingshun Kong , Jiawei Zhang , Dongqing Zou , Jimmy Ren , Xiaohe Wu , Jiangxin Dong , Jinshan Pan

Deep learning-based food image classification enables precise identification of food categories, further facilitating accurate nutritional analysis. However, real-world food images often show a skewed distribution, with some food types…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 GaYeon Koh , Hyun-Jic Oh , Jeonghyun Noh , Won-Ki Jeong

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Despite the remarkable generation capabilities of Diffusion Models (DMs), conducting training and inference remains computationally expensive. Previous works have been devoted to accelerating diffusion sampling, but achieving data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yize Li , Yihua Zhang , Sijia Liu , Xue Lin

Diffusion models have achieved remarkable success in image and video generation. In this work, we demonstrate that diffusion models can also \textit{generate high-performing neural network parameters}. Our approach is simple, utilizing an…

Machine Learning · Computer Science 2025-01-03 Kai Wang , Dongwen Tang , Boya Zeng , Yida Yin , Zhaopan Xu , Yukun Zhou , Zelin Zang , Trevor Darrell , Zhuang Liu , Yang You

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

As latent diffusion models (LDMs) democratize image generation capabilities, there is a growing need to detect fake images. A good detector should focus on the generative models fingerprints while ignoring image properties such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Anirudh Sundara Rajan , Utkarsh Ojha , Jedidiah Schloesser , Yong Jae Lee

Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D reconstruction, they…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Fabian Manhardt , Federico Tombari , Paul Henderson

Recently, large-scale diffusion models, e.g., Stable diffusion and DallE2, have shown remarkable results on image synthesis. On the other hand, large-scale cross-modal pre-trained models (e.g., CLIP, ALIGN, and FILIP) are competent for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Runhui Huang , Jianhua Han , Guansong Lu , Xiaodan Liang , Yihan Zeng , Wei Zhang , Hang Xu