English
Related papers

Related papers: Denoising observational data

200 papers

Training a denoising autoencoder neural network requires access to truly clean data, a requirement which is often impractical. To remedy this, we introduce a method to train an autoencoder using only noisy data, having examples with and…

Neural and Evolutionary Computing · Computer Science 2015-09-24 Dan Stowell , Richard E. Turner

A novel method for noise reduction in the setting of curve time series with error contamination is proposed, based on extending the framework of functional principal component analysis (FPCA). We employ the underlying, finite-dimensional…

Methodology · Statistics 2023-07-06 Cees Diks , Bram Wouters

Learned denoisers play a fundamental role in various signal generation (e.g., diffusion models) and reconstruction (e.g., compressed sensing) architectures, whose success derives from their ability to leverage low-dimensional structure in…

Machine Learning · Computer Science 2025-08-14 Shiyu Wang , Mariam Avagyan , Yihan Shen , Arnaud Lamy , Tingran Wang , Szabolcs Márka , Zsuzsa Márka , John Wright

As parallel codes are scaled to larger computing systems, performance models play a crucial role in identifying potential bottlenecks. However, constructing these models analytically is often challenging. Empirical models based on…

We propose a method called integrated diffusion for combining multimodal datasets, or data gathered via several different measurements on the same system, to create a joint data diffusion operator. As real world data suffers from both local…

Machine Learning · Computer Science 2022-03-07 Manik Kuchroo , Abhinav Godavarthi , Alexander Tong , Guy Wolf , Smita Krishnaswamy

Low-light raw denoising is an important and valuable task in computational photography where learning-based methods trained with paired real data are mainstream. However, the limited data volume and complicated noise distribution have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Hansen Feng , Lizhi Wang , Yuzhi Wang , Hua Huang

When capturing and storing images, devices inevitably introduce noise. Reducing this noise is a critical task called image denoising. Deep learning has become the de facto method for image denoising, especially with the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Haoyu Chen , Jinjin Gu , Yihao Liu , Salma Abdel Magid , Chao Dong , Qiong Wang , Hanspeter Pfister , Lei Zhu

Inferring a process matrix characterizing a quantum channel from experimental measurements is a key issue of quantum information. Sometimes the noise affecting the measured counts brings to matrices very different from the expected ones and…

Quantum Physics · Physics 2024-01-31 Massimiliano Guarneri , Andrea Chiuri

Sound recordings are used in various ecological studies, including acoustic wildlife monitoring. Such surveys require automatic detection of target sound events. However, current detectors, especially those relying on band-limited energy,…

Applications · Statistics 2021-10-13 Julius Juodakis , Stephen Marsland

Acquired images for medical and other purposes can be affected by noise from both the equipment used in the capturing or the environment. This can have adverse effect on the information therein. Thus, the need to restore the image to its…

Image and Video Processing · Electrical Eng. & Systems 2024-01-19 E. G. Onyedinma , I. E. Onyenwe

For submillimeter spectroscopy with ground-based single-dish telescopes, removing noise contribution from the Earth's atmosphere and the instrument is essential. For this purpose, here we propose a new method based on a data-scientific…

Instrumentation and Methods for Astrophysics · Physics 2021-08-20 Akio Taniguchi , Yoichi Tamura , Shiro Ikeda , Tatsuya Takekoshi , Ryohei Kawabe

We consider some iterative methods for finding the best interpolation data in the images compression with noise. The interpolation data consists of the set of pixels and their grey/color values. The aim in the iterative approach is to allow…

Analysis of PDEs · Mathematics 2022-09-30 Zakaria Belhachmi , Thomas Jacumin

Observational data are often accompanied by natural structural indices, such as time stamps or geographic locations, which are meaningful to prediction tasks but are often discarded. We leverage semantically meaningful indexing data while…

Machine Learning · Computer Science 2020-03-16 Esther Rolf , Michael I. Jordan , Benjamin Recht

The leading workhorse of anomaly (and attack) detection in the literature has been residual-based detectors, where the residual is the discrepancy between the observed output provided by the sensors (inclusive of any tampering along the…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Navid Hashemi , Eduardo Verdugo German , Jonatan Pena Ramirez , Justin Ruths

Point cloud source data for surface reconstruction is usually contaminated with noise and outliers. To overcome this deficiency, a density-based point cloud denoising method is presented to remove outliers and noisy points. First,…

Computer Vision and Pattern Recognition · Computer Science 2016-02-18 Faisal Zaman , Ya Ping Wong , Boon Yian Ng

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

Image denoising, one of the essential inverse problems, targets to remove noise/artifacts from input images. In general, digital image denoising algorithms, executed on computers, present latency due to several iterations implemented in,…

Protecting individual privacy is crucial when releasing sensitive data for public use. While data de-identification helps, it is not enough. This paper addresses parameter estimation in scenarios where data are perturbed using the…

Methodology · Statistics 2024-03-13 Qinglong Tian , Jiwei Zhao

Audio denoising has been explored for decades using both traditional and deep learning-based methods. However, these methods are still limited to either manually added artificial noise or lower denoised audio quality. To overcome these…

Sound · Computer Science 2022-10-20 Youshan Zhang , Jialu Li

B-spline models are a powerful way to represent scientific data sets with a functional approximation. However, these models can suffer from spurious oscillations when the data to be approximated are not uniformly distributed. Model…

Numerical Analysis · Mathematics 2023-01-04 David Lenz , Raine Yeh , Vijay Mahadevan , Iulian Grindeanu , Tom Peterka