English
Related papers

Related papers: Masked Pre-training Enables Universal Zero-shot De…

200 papers

Input space reconstruction is an attractive representation learning paradigm. Despite interpretability of the reconstruction and generation, we identify a misalignment between learning by reconstruction, and learning for perception. We show…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Randall Balestriero , Yann LeCun

Image denoising is of great importance for medical imaging system, since it can improve image quality for disease diagnosis and downstream image analyses. In a variety of applications, dynamic imaging techniques are utilized to capture the…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Junshen Xu , Elfar Adalsteinsson

Image denoising is a representative image restoration task in computer vision. Recent progress of image denoising from only noisy images has attracted much attention. Deep image prior (DIP) demonstrated successful image denoising from only…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Tsukasa Takagi , Shinya Ishizaki , Shin-ichi Maeda

Modeling the processing chain that has produced a video is a difficult reverse engineering task, even when the camera is available. This makes model based video processing a still more complex task. In this paper we propose a fully blind…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Thibaud Ehret , Axel Davy , Jean-Michel Morel , Gabriele Facciolo , Pablo Arias

Recent advancements in multi-modal large language models have propelled the development of joint probabilistic models capable of both image understanding and generation. However, we have identified that recent methods suffer from loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Jian Yang , Dacheng Yin , Yizhou Zhou , Fengyun Rao , Wei Zhai , Yang Cao , Zheng-Jun Zha

In view of the fact that semi- and self-supervised learning share a fundamental principle, effectively modeling knowledge from unlabeled data, various semi-supervised semantic segmentation methods have integrated representative…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yangyang Li , Xuanting Hao , Ronghua Shang , Licheng Jiao

Recently, masked image modeling (MIM) has gained considerable attention due to its capacity to learn from vast amounts of unlabeled data and has been demonstrated to be effective on a wide variety of vision tasks involving natural images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Zekai Chen , Devansh Agarwal , Kshitij Aggarwal , Wiem Safta , Samit Hirawat , Venkat Sethuraman , Mariann Micsinai Balan , Kevin Brown

An important goal of self-supervised learning is to enable model pre-training to benefit from almost unlimited data. However, one method that has recently become popular, namely masked image modeling (MIM), is suspected to be unable to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhenda Xie , Zheng Zhang , Yue Cao , Yutong Lin , Yixuan Wei , Qi Dai , Han Hu

Blind and universal image denoising consists of using a unique model that denoises images with any level of noise. It is especially practical as noise levels do not need to be known when the model is developed or at test time. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Majed El Helou , Sabine Süsstrunk

When it comes to image compression in digital cameras, denoising is traditionally performed prior to compression. However, there are applications where image noise may be necessary to demonstrate the trustworthiness of the image, such as…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Saeed Ranjbar Alvar , Mateen Ulhaq , Hyomin Choi , Ivan V. Bajić

In supervised learning for image denoising, usually the paired clean images and noisy images are collected or synthesised to train a denoising model. L2 norm loss or other distance functions are used as the objective function for training.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Yutong Xie , Minne Yuan , Bin Dong , Quanzheng Li

Recent advances in deep learning have been pushing image denoising techniques to a new level. In self-supervised image denoising, blind-spot network (BSN) is one of the most common methods. However, most of the existing BSN algorithms use a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Dan Zhang , Fangfang Zhou , Yuwen Jiang , Zhengming Fu

Machine learning techniques work best when the data used for training resembles the data used for evaluation. This holds true for learned single-image denoising algorithms, which are applied to real raw camera sensor readings but, due to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Tim Brooks , Ben Mildenhall , Tianfan Xue , Jiawen Chen , Dillon Sharlet , Jonathan T. Barron

Image denoising is a well-known and well studied problem, commonly targeting a minimization of the mean squared error (MSE) between the outcome and the original image. Unfortunately, especially for severe noise levels, such Minimum MSE…

Image and Video Processing · Electrical Eng. & Systems 2021-09-01 Bahjat Kawar , Gregory Vaksman , Michael Elad

Zero-shot denoisers address the dataset dependency of deep-learning-based denoisers, enabling the denoising of unseen single images. Nonetheless, existing zero-shot methods suffer from long training times and rely on the assumption of noise…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Yanlin Jiang , Yuchen Liu , Mingren Liu

Recently, denoising methods based on supervised learning have exhibited promising performance. However, their reliance on external datasets containing noisy-clean image pairs restricts their applicability. To address this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Jaekyun Ko , Sanghwan Lee

Real noisy-clean pairs on a large scale are costly and difficult to obtain. Meanwhile, supervised denoisers trained on synthetic data perform poorly in practice. Self-supervised denoisers, which learn only from single noisy images, solve…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Zejin Wang , Jiazheng Liu , Guoqing Li , Hua Han

The approximation and convergence properties of implicit neural representations (INRs) are known to be highly sensitive to parameter initialization strategies. While several data-driven initialization methods demonstrate significant…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Kushal Vyas , Alper Kayabasi , Daniel Kim , Vishwanath Saragadam , Ashok Veeraraghavan , Guha Balakrishnan

Multimodal representation learning has shown promising improvements on various vision-language tasks. Most existing methods excel at building global-level alignment between vision and language while lacking effective fine-grained image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zijia Zhao , Longteng Guo , Xingjian He , Shuai Shao , Zehuan Yuan , Jing Liu

While current multi-frame restoration methods combine information from multiple input images using 2D alignment techniques, recent advances in novel view synthesis are paving the way for a new paradigm relying on volumetric scene…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Thomas Tanay , Aleš Leonardis , Matteo Maggioni