English
Related papers

Related papers: Latent Denoising Makes Good Tokenizers

200 papers

Use denoising diffusion implicit model for bridge-type innovation. The process of adding noise and denoising to an image can be likened to the process of a corpse rotting and a detective restoring the scene of a victim being killed, to help…

Machine Learning · Computer Science 2024-02-13 Hongjun Zhang

Removing noise from images is a challenging and fundamental problem in the field of computer vision. Images captured by modern cameras are inevitably degraded by noise which limits the accuracy of any quantitative measurements on those…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Nikhil Verma , Deepkamal Kaur , Lydia Chau

Removing the shape noise from the observed weak lensing field, i.e., denoising, enhances the potential of WL by accessing information at small scales where the shape noise dominates without denoising. We utilise two machine learning (ML)…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-13 Shohei D. Aoyama , Ken Osato , Masato Shirasaki

Diffusion models have achieved state-of-the-art synthesis quality on both visual and audio tasks, and recent works further adapt them to textual data by diffusing on the embedding space. In this paper, we conduct systematic studies of the…

Computation and Language · Computer Science 2024-04-23 Zhujin Gao , Junliang Guo , Xu Tan , Yongxin Zhu , Fang Zhang , Jiang Bian , Linli Xu

Existing vision tokenization isolates the optimization of vision tokenizers from downstream training, implicitly assuming the visual tokens can generalize well across various tasks, e.g., image generation and visual question answering. The…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Wenxuan Wang , Fan Zhang , Yufeng Cui , Haiwen Diao , Zhuoyan Luo , Huchuan Lu , Jing Liu , Xinlong Wang

Customized text-to-image generation, which aims to learn user-specified concepts with a few images, has drawn significant attention recently. However, existing methods usually suffer from overfitting issues and entangle the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yufei Cai , Yuxiang Wei , Zhilong Ji , Jinfeng Bai , Hu Han , Wangmeng Zuo

Radiomics is an active area of research in medical image analysis, the low reproducibility of radiomics has limited its applicability to clinical practice. This issue is especially prominent when radiomic features are calculated from noisy…

Quantitative Methods · Quantitative Biology 2021-08-16 Junhua Chen , Chong Zhang , Alberto Traverso , Ivan Zhovannik , Andre Dekker , Leonard Wee , Inigo Bermejo

Image denoising is a well-known and well studied problem, commonly targeting a minimization of the mean squared error (MSE) between the outcome and the original image. Unfortunately, especially for severe noise levels, such Minimum MSE…

Image and Video Processing · Electrical Eng. & Systems 2021-09-01 Bahjat Kawar , Gregory Vaksman , Michael Elad

Recovering a high-quality image from noisy indirect measurements is an important problem with many applications. For such inverse problems, supervised deep convolutional neural network (CNN)-based denoising methods have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2020-09-16 Allard A. Hendriksen , Daniel M. Pelt , K. Joost Batenburg

DeepTensor is a computationally efficient framework for low-rank decomposition of matrices and tensors using deep generative networks. We decompose a tensor as the product of low-rank tensor factors (e.g., a matrix as the outer product of…

Low dose computed tomography (LDCT) is desirable for both diagnostic imaging and image guided interventions. Denoisers are openly used to improve the quality of LDCT. Deep learning (DL)-based denoisers have shown state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2020-12-08 Ti Bai , Biling Wang , Dan Nguyen , Bao Wang , Bin Dong , Wenxiang Cong , Mannudeep K. Kalra , Steve Jiang

Removing noise from images, a.k.a image denoising, can be a very challenging task since the type and amount of noise can greatly vary for each image due to many factors including a camera model and capturing environments. While there have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Changjin Kim , Tae Hyun Kim , Sungyong Baik

As a new paradigm of visual content generation, autoregressive text-to-image models suffer from slow inference due to their sequential token-by-token decoding process, often requiring thousands of model forward passes to generate a single…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Yao Teng , Fuyun Wang , Xian Liu , Zhekai Chen , Han Shi , Yu Wang , Zhenguo Li , Weiyang Liu , Difan Zou , Xihui Liu

The quality of the latent space in visual tokenizers (e.g., VAEs) is crucial for modern generative models. However, the standard reconstruction-based training paradigm produces a latent space that is biased towards low-level information,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jingfeng Yao , Yuda Song , Yucong Zhou , Xinggang Wang

Semantic layouts based Image synthesizing, which has benefited from the success of Generative Adversarial Network (GAN), has drawn much attention in these days. How to enhance the synthesis image equality while keeping the stochasticity of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Ziqiang Zheng , Chao Wang , Zhibin Yu , Haiyong Zheng , Bing Zheng

Image denoising has recently taken a leap forward due to machine learning. However, image denoisers, both expert-based and learning-based, are mostly tested on well-behaved generated noises (usually Gaussian) rather than on real-life…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Florian Lemarchand , Eduardo Fernandes Montesuma , Maxime Pelcat , Erwan Nogues

Low Dose Computed Tomography (LDCT) has offered tremendous benefits in radiation restricted applications, but the quantum noise as resulted by the insufficient number of photons could potentially harm the diagnostic performance. Current…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Xin Yi , Paul Babyn

Lacking realistic ground truth data, image denoising techniques are traditionally evaluated on images corrupted by synthesized i.i.d. Gaussian noise. We aim to obviate this unrealistic setting by developing a methodology for benchmarking…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Tobias Plötz , Stefan Roth

We present a deep neural network to reduce coherent noise in three-dimensional quantitative phase imaging. Inspired by the cycle generative adversarial network, the denoising network was trained to learn a transform between two image…

Image denoising has achieved unprecedented progress as great efforts have been made to exploit effective deep denoisers. To improve the denoising performance in realworld, two typical solutions are used in recent trends: devising better…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Yunhao Zou , Ying Fu