English
Related papers

Related papers: Adaptive Real-Time Numerical Differentiation with …

200 papers

We propose a sparse grids based adaptive noise reduction strategy for electrostatic particle-in-cell (PIC) simulations. Our approach is based on the key idea of relying on sparse grids instead of a regular grid in order to increase the…

In compressed sensing, measurements are typically contaminated by additive noise, and therefore, information about the noise variance is often needed to design algorithms. In this paper, we propose a method for estimating the unknown noise…

Signal Processing · Electrical Eng. & Systems 2025-03-24 Ryo Hayakawa

Attosecond transient absorption spectroscopy (ATAS) is used to observe photoexcited dynamics with outstanding time resolution. The main experimental challenge of this technique is that high-harmonic generation sources show significant…

In this brief paper, we present a simple approach to estimate the variance of measurement noise with time-varying 1-D signals. The proposed approach exploits the relationship between the noise variance and the variance of the prediction…

Signal Processing · Electrical Eng. & Systems 2021-04-09 Qin Li , Junchan Zhao

A wireless acoustic sensor network records audio signals with sampling time and sampling rate offsets between the audio streams, if the analog-digital converters (ADCs) of the network devices are not synchronized. Here, we introduce a new…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-26 Tobias Gburrek , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

Differential privacy is one of the methods to solve the problem of privacy protection in federated learning. Setting the same privacy budget for each round will result in reduced accuracy in training. The existing methods of the adjustment…

Cryptography and Security · Computer Science 2024-08-20 Zhiqiang Wang , Xinyue Yu , Qianli Huang , Yongguang Gong

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

We propose self-adaptive training---a new training algorithm that dynamically corrects problematic training labels by model predictions without incurring extra computational cost---to improve generalization of deep learning for potentially…

Machine Learning · Computer Science 2020-10-01 Lang Huang , Chao Zhang , Hongyang Zhang

We propose an adaptive (stochastic) gradient perturbation method for differentially private empirical risk minimization. At each iteration, the random noise added to the gradient is optimally adapted to the stepsize; we name this process…

Machine Learning · Computer Science 2021-10-26 Xiaoxia Wu , Lingxiao Wang , Irina Cristali , Quanquan Gu , Rebecca Willett

To protect user privacy in data analysis, a state-of-the-art strategy is differential privacy in which scientific noise is injected into the real analysis output. The noise masks individual's sensitive information contained in the dataset.…

Cryptography and Security · Computer Science 2018-06-20 Xuan-Son Vu , Lili Jiang

We study robust high-dimensional sparse regression under finite-variance heavy-tailed noise, epsilon-contamination, and alpha-mixing dependence via two subsampling estimators: Adaptive Importance Sampling (AIS) and Stratified Sub-sampling…

Statistics Theory · Mathematics 2026-03-11 Prateek Mittal , Joohi Chauhan

Unveiling meaningful geophysical information from seismic data requires to deal with both random and structured "noises". As their amplitude may be greater than signals of interest (primaries), additional prior information is especially…

Geophysics · Physics 2014-09-25 Mai Quyen Pham , Laurent Duval , Caroline Chaux , Jean-Christophe Pesquet

We propose a new grayscale image denoiser, dubbed as Neural Affine Image Denoiser (Neural AIDE), which utilizes neural network in a novel way. Unlike other neural network based image denoising methods, which typically apply simple…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Sungmin Cha , Taesup Moon

Many learning tasks in machine learning can be viewed as taking a gradient step towards minimizing the average loss of a batch of examples in each training iteration. When noise is prevalent in the data, this uniform treatment of examples…

Machine Learning · Computer Science 2021-04-06 Negin Majidi , Ehsan Amid , Hossein Talebi , Manfred K. Warmuth

Imperfect labels are ubiquitous in real-world datasets. Several recent successful methods for training deep neural networks (DNNs) robust to label noise have used two primary techniques: filtering samples based on loss during a warm-up…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Kento Nishi , Yi Ding , Alex Rich , Tobias Höllerer

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

Machine Learning · Computer Science 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

We describe a framework for designing efficient active learning algorithms that are tolerant to random classification noise and are differentially-private. The framework is based on active learning algorithms that are statistical in the…

Machine Learning · Computer Science 2014-11-06 Maria Florina Balcan , Vitaly Feldman

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

In this paper, we propose a framework to enhance the robustness of the neural models by mitigating the effects of process-induced and aging-related variations of analog computing components on the accuracy of the analog neural networks. We…

Machine Learning · Computer Science 2024-09-30 Seyedarmin Azizi , Mohammad Erfan Sadeghi , Mehdi Kamal , Massoud Pedram

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey