English
Related papers

Related papers: Prompt-SID: Learning Structural Representation Pro…

200 papers

When capturing images in low-light conditions, the images often suffer from low visibility, which not only degrades the visual aesthetics of images, but also significantly degenerates the performance of many computer vision algorithms. In…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Lijun Zhang , Xiao Liu , Erik Learned-Miller , Hui Guan

Proteins encode diverse functions within complex three-dimensional structures, yet most deep learning representations remain highly entangled, obscuring the biophysical signals that underlie function. Here we introduce ProtDiS, a…

Biomolecules · Quantitative Biology 2026-05-26 Mingqing Wang , Zhiwei Nie , Athanasios V. Vasilakos , Yonghong He , Zhixiang Ren

We study the problem of self-supervised structured representation learning using autoencoders for downstream tasks such as generative modeling. Unlike most methods which rely on matching an arbitrary, relatively unstructured, prior…

Machine Learning · Computer Science 2024-02-16 Felix Leeb , Guilia Lanzillotta , Yashas Annadani , Michel Besserve , Stefan Bauer , Bernhard Schölkopf

The to-be-denoised positron emission tomography (PET) volumes are inherent with diverse count levels, which imposes challenges for a unified model to tackle varied cases. In this work, we resort to the recently flourished prompt learning to…

Image and Video Processing · Electrical Eng. & Systems 2025-05-07 Xiaofeng Liu , Yongsong Huang , Thibault Marin , Samira Vafay Eslahi , Tiss Amal , Yanis Chemli , Keith Johnson , Georges El Fakhri , Jinsong Ouyang

We describe a novel method for training high-quality image denoising models based on unorganized collections of corrupted images. The training does not need access to clean reference images, or explicit pairs of corrupted images, and can…

Machine Learning · Computer Science 2019-10-29 Samuli Laine , Tero Karras , Jaakko Lehtinen , Timo Aila

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

Image denoising is a well studied problem with an extensive activity that has spread over several decades. Despite the many available denoising algorithms, the quest for simple, powerful and fast denoisers is still an active and vibrant…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Gregory Vaksman , Michael Elad , Peyman Milanfar

Though achieving excellent performance in some cases, current unsupervised learning methods for single image denoising usually have constraints in applications. In this paper, we propose a new approach which is more general and applicable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yutong Xie , Mingze Yuan , Bin Dong , Quanzheng Li

Medical image acquisition is often intervented by unwanted noise that corrupts the information content. This paper introduces an unsupervised medical image denoising technique that learns noise characteristics from the available images and…

Image and Video Processing · Electrical Eng. & Systems 2021-03-12 Swati Rai , Jignesh S. Bhatt , S. K. Patra

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

We consider image denoising using a nonlinear diffusion process, where we solve unsteady partial differential equations with nonlinear coefficients. The noised image is given as an initial condition, and nonlinear coefficients are used to…

Numerical Analysis · Mathematics 2025-05-14 Maria Vasilyeva , Aleksei Krasnikov , Kelum Gajamannage , Mehrube Mehrubeoglu

Self-supervised image denoising methods have traditionally relied on either architectural constraints or specialized loss functions that require prior knowledge of the noise distribution to avoid the trivial identity mapping. Among these,…

Image and Video Processing · Electrical Eng. & Systems 2026-03-30 Brayan Monroy , Jorge Bacca , Julián Tachella

Diffusion models (DMs) can generate realistic images with text guidance using large-scale datasets. However, they demonstrate limited controllability in the output space of the generated images. We propose a novel learning method for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Rumeysa Bodur , Erhan Gundogdu , Binod Bhattarai , Tae-Kyun Kim , Michael Donoser , Loris Bazzani

Intrinsic image decomposition (IID) is an under-constrained problem. Therefore, traditional approaches use hand crafted priors to constrain the problem. However, these constraints are limited when coping with complex scenes. Deep…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Partha Das , Sezer Karaoglu , Arjan Gijsenij , Theo Gevers

Structured illumination (SI) enhances image resolution and contrast by projecting patterned light onto a sample. In two-phase optical-sectioning SI (OS-SI), reduced acquisition time introduces residual artifacts that conventional denoising…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Allison Davis , Yezhi Shen , Xiaoyu Ji , Fengqing Zhu

Few-shot segmentation has garnered significant attention. Many recent approaches attempt to introduce the Segment Anything Model (SAM) to handle this task. With the strong generalization ability and rich object-specific extraction ability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jin Wang , Bingfeng Zhang , Jian Pang , Weifeng Liu , Baodi Liu , Honglong Chen

Learning-based image reconstruction models, such as those based on the U-Net, require a large set of labeled images if good generalization is to be guaranteed. In some imaging domains, however, labeled data with pixel- or voxel-level label…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Sean I. Young , Adrian V. Dalca , Enzo Ferrante , Polina Golland , Christopher A. Metzler , Bruce Fischl , Juan Eugenio Iglesias

Conditional diffusion models have demonstrated impressive performance in image manipulation tasks. The general pipeline involves adding noise to the image and then denoising it. However, this method faces a trade-off problem: adding too…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Luozhou Wang , Shuai Yang , Shu Liu , Ying-cong Chen

Humans can robustly learn novel visual concepts even when images undergo various deformations and lose certain information. Mimicking the same behavior and synthesizing deformed instances of new concepts may help visual recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Zitian Chen , Yanwei Fu , Yu-Xiong Wang , Lin Ma , Wei Liu , Martial Hebert

Significant progress has been made in self-supervised image denoising (SSID) in the recent few years. However, most methods focus on dealing with spatially independent noise, and they have little practicality on real-world sRGB images with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Junyi Li , Zhilu Zhang , Xiaoyu Liu , Chaoyu Feng , Xiaotao Wang , Lei Lei , Wangmeng Zuo