English
Related papers

Related papers: Masked Pre-training Enables Universal Zero-shot De…

200 papers

Masked Image Modeling (MIM) has achieved promising progress with the advent of Masked Autoencoders (MAE) and BEiT. However, subsequent works have complicated the framework with new auxiliary tasks or extra pre-trained models, inevitably…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yuan Liu , Songyang Zhang , Jiacheng Chen , Kai Chen , Dahua Lin

Masking strategies commonly employed in natural language processing are still underexplored in vision tasks such as concept learning, where conventional methods typically rely on full images. However, using masked images diversifies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yuwei Sun , Lu Mi , Ippei Fujisawa , Ruiqiao Mei , Jimin Chen , Siyu Zhu , Ryota Kanai

Zero-shot denoising aims to denoise observations without access to training samples or clean reference images. This setting is particularly relevant in practical imaging scenarios involving specialized domains such as medical imaging or…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Ali Zafari , Xi Chen , Shirin Jalali

An important task in image processing and neuroimaging is to extract quantitative information from the acquired images in order to make observations about the presence of disease or markers of development in populations. Having a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Camilo Bermudez , Andrew J. Plassard , Larry T. Davis , Allen T. Newton , Susan M Resnick , Bennett A. Landman

Compressive sensing is a method to recover the original image from undersampled measurements. In order to overcome the ill-posedness of this inverse problem, image priors are used such as sparsity in the wavelet domain, minimum…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Magauiya Zhussip , Shakarim Soltanayev , Se Young Chun

Masked Image Modeling (MIM) has recently been established as a potent pre-training paradigm. A pretext task is constructed by masking patches in an input image, and this masked content is then predicted by a neural network using visible…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Philippe Weinzaepfel , Vincent Leroy , Thomas Lucas , Romain Brégier , Yohann Cabon , Vaibhav Arora , Leonid Antsfeld , Boris Chidlovskii , Gabriela Csurka , Jérôme Revaud

Deep image prior (DIP) is an unsupervised deep learning framework that has been successfully applied to a variety of inverse imaging problems. However, DIP-based methods are inherently prone to overfitting, which leads to performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Panagiotis Gkotsis , Athanasios A. Rontogiannis

Learning-based lossless image compression employs pixel-based or subimage-based auto-regression for probability estimation, which achieves desirable performances. However, the existing works only consider context dependencies in one…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Tiantian Li , Qunbing Xia , Yue Li , Ruixiao Guo , Gaobo Yang

Magnetic particle imaging reconstructs tracer distributions using a system matrix obtained through time-consuming, noise-prone calibration measurements. Methods for addressing imperfections in measured system matrices increasingly rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-03-20 Artyom Tsanda , Sarah Reiss , Konrad Scheffler , Marija Boberg , Tobias Knopp

Image denoising is an essential tool in computational photography. Standard denoising techniques, which use deep neural networks at their core, require pairs of clean and noisy images for its training. If we do not possess the clean…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 David Honzátko , Siavash A. Bigdeli , Engin Türetken , L. Andrea Dunbar

The past year has witnessed a rapid development of masked image modeling (MIM). MIM is mostly built upon the vision transformers, which suggests that self-supervised visual representations can be done by masking input image parts while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yunjie Tian , Lingxi Xie , Jiemin Fang , Mengnan Shi , Junran Peng , Xiaopeng Zhang , Jianbin Jiao , Qi Tian , Qixiang Ye

Masked Image Modeling (MIM) has emerged as a powerful self-supervised learning paradigm for visual representation learning, enabling models to acquire rich visual representations by predicting masked portions of images from their visible…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Jinhong Lin , Cheng-En Wu , Huanran Li , Jifan Zhang , Yu Hen Hu , Pedro Morgado

We present a comprehensive overview of the Deep Image Prior (DIP) framework and its applications to image reconstruction in computed tomography. Unlike conventional deep learning methods that rely on large, supervised datasets, the DIP…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Simon Arridge , Riccardo Barbano , Alexander Denker , Zeljko Kereta

Image denoising is a fundamental challenge in computer vision, with applications in photography and medical imaging. While deep learning-based methods have shown remarkable success, their reliance on specific noise distributions limits…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Dongjin Kim , Jaekyun Ko , Muhammad Kashif Ali , Tae Hyun Kim

As a hybrid imaging technology, photoacoustic microscopy (PAM) imaging suffers from noise due to the maximum permissible exposure of laser intensity, attenuation of ultrasound in the tissue, and the inherent noise of the transducer.…

Image and Video Processing · Electrical Eng. & Systems 2022-01-13 Da He , Jiasheng Zhou , Xiaoyu Shang , Jiajia Luo , Sung-Liang Chen

Image denoising can be described as the problem of mapping from a noisy image to a noise-free image. In another paper, we show that multi-layer perceptrons can achieve outstanding image denoising performance for various types of noise…

Computer Vision and Pattern Recognition · Computer Science 2012-11-08 Harold Christopher Burger , Christian J. Schuler , Stefan Harmeling

Magnetic Particle Imaging (MPI) is an emerging imaging modality based on the magnetic response of superparamagnetic iron oxide nanoparticles to achieve high-resolution and real-time imaging without harmful radiation. One key challenge in…

Numerical Analysis · Mathematics 2025-01-13 Meira Iske , Hannes Albers , Tobias Knopp , Tobias Kluth

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

Model generalizability to unseen datasets, concerned with in-the-wild robustness, is less studied for indoor single-image depth prediction. We leverage gradient-based meta-learning for higher generalizability on zero-shot cross-dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Cho-Ying Wu , Yiqi Zhong , Junying Wang , Ulrich Neumann

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan