English
Related papers

Related papers: The Surprising Effectiveness of Noise Pretraining …

200 papers

Quantum noise is conventionally viewed as a fundamental obstacle in near-term quantum computing, motivating extensive error correction and mitigation strategies. We present numerical evidence that challenges this consensus. Through…

Quantum Physics · Physics 2026-01-21 Linghua Zhu , Yulong Dong , Ziyu Zhang , Xiaosong Li

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang

What if deep neural networks can learn from sparsity-inducing priors? When the networks are designed by combining layer modules (CNN, RNN, etc), engineers less exploit the inductive bias, i.e., existing well-known rules or prior knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Tomoya Sakai

Neural fields, also known as implicit neural representations (INRs), offer a powerful framework for modeling continuous geometry, but their effectiveness in high-dimensional scientific settings is limited by slow convergence and scaling…

Machine Learning · Computer Science 2026-04-23 Sophia Zorek , Kushal Vyas , Yuhao Liu , David Lenz , Tom Peterka , Guha Balakrishnan

Deep learning algorithms have demonstrated state-of-the-art performance in various tasks of image restoration. This was made possible through the ability of CNNs to learn from large exemplar sets. However, the latter becomes an issue for…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Oleksii Sidorov , Jon Yngve Hardeberg

Diffusion magnetic resonance imaging (dMRI) enables non-invasive investigation of tissue microstructure. The Standard Model (SM) of white matter aims to disentangle dMRI signal contributions from intra- and extra-axonal water compartments.…

Image and Video Processing · Electrical Eng. & Systems 2026-04-15 Tom Hendriks , Gerrit Arends , Edwin Versteeg , Anna Vilanova , Maxime Chamberland , Chantal M. W. Tax

Representing visual signals by implicit representation (e.g., a coordinate based deep network) has prevailed among many vision tasks. This work explores a new intriguing direction: training a stylized implicit representation, using a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhiwen Fan , Yifan Jiang , Peihao Wang , Xinyu Gong , Dejia Xu , Zhangyang Wang

Implicit Neural Representations (INRs) have emerged and shown their benefits over discrete representations in recent years. However, fitting an INR to the given observations usually requires optimization with gradient descent from scratch,…

Machine Learning · Computer Science 2022-08-08 Yinbo Chen , Xiaolong Wang

Ultrasound denoising is essential for mitigating speckle-induced degradations, thereby enhancing image quality and improving diagnostic reliability. Nevertheless, because speckle patterns inherently encode both texture and fine anatomical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zhenyu Bu , Yuanxin Xie , Guang-Quan Zhou

Coordinate-based neural representations have shown significant promise as an alternative to discrete, array-based representations for complex low dimensional signals. However, optimizing a coordinate-based network from randomly initialized…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Matthew Tancik , Ben Mildenhall , Terrance Wang , Divi Schmidt , Pratul P. Srinivasan , Jonathan T. Barron , Ren Ng

Implicit Neural Representations (INRs) based on vanilla Multi-Layer Perceptrons (MLPs) are widely believed to be incapable of representing high-frequency content. This has directed research efforts towards architectural interventions, such…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Julian McGinnis , Florian A. Hölzl , Suprosanna Shit , Florentin Bieder , Paul Friedrich , Mark Mühlau , Björn Menze , Daniel Rueckert , Benedikt Wiestler

Deep learning has been widely adopted to tackle various code-based tasks by building deep code models based on a large amount of code snippets. While these deep code models have achieved great success, even state-of-the-art models suffer…

Software Engineering · Computer Science 2023-08-22 Zhao Tian , Junjie Chen , Xiangyu Zhang

We study the interpolation capabilities of implicit neural representations (INRs) of images. In principle, INRs promise a number of advantages, such as continuous derivatives and arbitrary sampling, being freed from the restrictions of a…

Image and Video Processing · Electrical Eng. & Systems 2024-05-02 Lorenzo Luzi , Daniel LeJeune , Ali Siahkoohi , Sina Alemohammad , Vishwanath Saragadam , Hossein Babaei , Naiming Liu , Zichao Wang , Richard G. Baraniuk

We investigate the learning of implicit neural representation (INR) using an overparameterized multilayer perceptron (MLP) via a novel nonparametric teaching perspective. The latter offers an efficient example selection framework for…

Machine Learning · Computer Science 2024-05-20 Chen Zhang , Steven Tin Sui Luo , Jason Chun Lok Li , Yik-Chung Wu , Ngai Wong

Supervised training for real-world denoising presents challenges due to the difficulty of collecting large datasets of paired noisy and clean images. Recent methods have attempted to address this by utilizing unpaired datasets of clean and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

Learning from unlabeled and noisy data is one of the grand challenges of machine learning. As such, it has seen a flurry of research with new ideas proposed continuously. In this work, we revisit a classical idea: Stein's Unbiased Risk…

Machine Learning · Statistics 2020-07-24 Christopher A. Metzler , Ali Mousavi , Reinhard Heckel , Richard G. Baraniuk

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

Machine learning techniques work best when the data used for training resembles the data used for evaluation. This holds true for learned single-image denoising algorithms, which are applied to real raw camera sensor readings but, due to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Tim Brooks , Ben Mildenhall , Tianfan Xue , Jiawen Chen , Dillon Sharlet , Jonathan T. Barron

Deep neural networks provide excellent performance for inverse problems such as denoising. However, neural networks can be sensitive to adversarial or worst-case perturbations. This raises the question of whether such networks can be…

Machine Learning · Computer Science 2023-07-25 Anselm Krainovic , Mahdi Soltanolkotabi , Reinhard Heckel

Advancements in parallel processing have lead to a surge in multilayer perceptrons' (MLP) applications and deep learning in the past decades. Recurrent Neural Networks (RNNs) give additional representational power to feedforward MLPs by…

Machine Learning · Statistics 2014-10-22 Saahil Ognawala , Justin Bayer