English
Related papers

Related papers: Denoising Masked AutoEncoders Help Robust Classifi…

200 papers

Contrastive Masked Autoencoder (CMAE), as a new self-supervised framework, has shown its potential of learning expressive feature representations in visual image recognition. This work shows that CMAE also trivially generalizes well on…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Cheng-Ze Lu , Xiaojie Jin , Zhicheng Huang , Qibin Hou , Ming-Ming Cheng , Jiashi Feng

Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks via randomly masking image patches and reconstruction. However, effective data augmentation strategies for MAE still remain open questions, different…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

Deep convolutional neural networks (CNN) proved to be highly accurate to perform anatomical segmentation of medical images. However, some of the most popular CNN architectures for image segmentation still rely on post-processing strategies…

Image and Video Processing · Electrical Eng. & Systems 2019-06-07 Agostina J. Larrazabal , Cesar Martinez , Enzo Ferrante

Denoising is one of the fundamental steps of the processing pipeline that converts data captured by a camera sensor into a display-ready image or video. It is generally performed early in the pipeline, usually before demosaicking, although…

Image and Video Processing · Electrical Eng. & Systems 2024-12-02 Marco Sánchez-Beeckman , Antoni Buades , Nicola Brandonisio , Bilel Kanoun

Diffusion probabilistic models (DPMs) have shown remarkable results on various image synthesis tasks such as text-to-image generation and image inpainting. However, compared to other generative methods like VAEs and GANs, DPMs lack a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yipeng Leng , Qiangjuan Huang , Zhiyuan Wang , Yangyang Liu , Haoyu Zhang

Noisy images are a challenge to image compression algorithms due to the inherent difficulty of compressing noise. As noise cannot easily be discerned from image details, such as high-frequency signals, its presence leads to extra bits…

Image and Video Processing · Electrical Eng. & Systems 2024-02-09 Yuxin Xie , Li Yu , Farhad Pakdaman , Moncef Gabbouj

Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the…

Signal Processing · Electrical Eng. & Systems 2023-12-07 Michael Baur , Franz Weißer , Benedikt Böck , Wolfgang Utschick

In this paper, we propose a new progressive pre-training method for image understanding tasks which leverages RGB-D datasets. The method utilizes Multi-Modal Contrastive Masked Autoencoder and Denoising techniques. Our proposed approach…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Muhammad Abdullah Jamal , Omid Mohareri

Image denoising is a prerequisite for downstream tasks in many fields. Low-dose and photon-counting computed tomography (CT) denoising can optimize diagnostic performance at minimized radiation dose. Supervised deep denoising methods are…

Machine Learning · Computer Science 2022-01-06 Chuang Niu , Mengzhou Li , Fenglei Fan , Weiwen Wu , Xiaodong Guo , Qing Lyu , Ge Wang

Patient scans from MRI often suffer from noise, which hampers the diagnostic capability of such images. As a method to mitigate such artifact, denoising is largely studied both within the medical imaging community and beyond the community…

Image and Video Processing · Electrical Eng. & Systems 2022-03-25 Hyungjin Chung , Eun Sun Lee , Jong Chul Ye

Representing graph data in a low-dimensional space for subsequent tasks is the purpose of attributed graph embedding. Most existing neural network approaches learn latent representations by minimizing reconstruction errors. Rare work…

Machine Learning · Computer Science 2024-01-15 Bozhen Hu , Zelin Zang , Jun Xia , Lirong Wu , Cheng Tan , Stan Z. Li

Fingerprint image denoising is a very important step in fingerprint identification. to improve the denoising effect of fingerprint image,we have designs a fingerprint denoising algorithm based on deep encoder-decoder network,which encoder…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Weiya Fan

We demonstrate a new deep learning autoencoder network, trained by a nonnegativity constraint algorithm (NCAE), that learns features which show part-based representation of data. The learning algorithm is based on constraining negative…

Machine Learning · Computer Science 2016-01-13 Ehsan Hosseini-Asl , Jacek M. Zurada , Olfa Nasraoui

We extend the blindspot model for self-supervised denoising to handle Poisson-Gaussian noise and introduce an improved training scheme that avoids hyperparameters and adapts the denoiser to the test data. Self-supervised models for…

Image and Video Processing · Electrical Eng. & Systems 2020-11-20 Wesley Khademi , Sonia Rao , Clare Minnerath , Guy Hagen , Jonathan Ventura

Although variational autoencoders (VAEs) represent a widely influential deep generative model, many aspects of the underlying energy function remain poorly understood. In particular, it is commonly believed that Gaussian encoder/decoder…

Machine Learning · Computer Science 2019-10-31 Bin Dai , David Wipf

Masked Autoencoders (MAE) achieve self-supervised learning of image representations by randomly removing a portion of visual tokens and reconstructing the original image as a pretext task, thereby significantly enhancing pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiaxuan Li , Qing Xu , Xiangjian He , Ziyu Liu , Chang Xing , Zhen Chen , Daokun Zhang , Rong Qu , Chang Wen Chen

In this paper, we propose a novel framework for multi-image co-segmentation using class agnostic meta-learning strategy by generalizing to new classes given only a small number of training samples for each new class. We have developed a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sayan Banerjee , S Divakar Bhat , Subhasis Chaudhuri , Rajbabu Velmurugan

In industry, machine anomalous sound detection (ASD) is in great demand. However, collecting enough abnormal samples is difficult due to the high cost, which boosts the rapid development of unsupervised ASD algorithms. Autoencoder (AE)…

Sound · Computer Science 2023-11-16 Yifan Zhou , Dongxing Xu , Haoran Wei , Yanhua Long

This paper presents a novel deep learning-based method for learning a functional representation of mammalian neural images. The method uses a deep convolutional denoising autoencoder (CDAE) for generating an invariant, compact…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Ido Cohen , Eli David , Nathan S. Netanyahu , Noa Liscovitch , Gal Chechik

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel