Related papers: Hidden outlier noise and its mitigation
In addition to ever-present thermal noise, communication and sensor systems can contain significant amounts of interference with outlier (e.g. impulsive) characteristics. Such outlier interference (including that caused by nonlinear signal…
When interference affecting various communication and sensor systems contains clearly identifiable outliers (e.g. an impulsive component), it can be efficiently mitigated in real time by intermittently nonlinear filters developed in our…
Impulsive noise is a major impediment to orthogonal frequency-division multiplexing (OFDM) based underwater acoustic (UWA) communications. In this work, we evaluate the performance of a memoryless analog nonlinear preprocessor (MANP) that…
An Adaptive Nonlinear Differential Limiter (ANDL) is proposed in this paper to efficiently alleviate the impact of impulsive noise (IN) in a communication system. Unlike existing nonlinear methods, the ANDL is implemented in the analog…
State estimation of dynamical systems from noisy observations is a fundamental task in many applications. It is commonly addressed using the linear Kalman filter (KF), whose performance can significantly degrade in the presence of outliers…
Considering a common case where measurements are obtained from independent sensors, we present a novel outlier-robust filter for nonlinear dynamical systems in this work. The proposed method is devised by modifying the measurement model and…
The accuracy of machine learning interatomic potentials suffers from reference data that contains numerical noise. Often originating from unconverged or inconsistent electronic-structure calculations, this noise is challenging to identify.…
Impulsed noise outliers are data points that differs significantly from other observations.They are generally removed from the data set through local regression or Kalman filter algorithm.However, these methods, or their generalizations,…
Robust fencing is an essential component of intermittently nonlinear filtering for mitigation of outlier interference. In such filtering, the upper and the lower fences establish a robust range that excludes noise outliers while including…
Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…
Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a…
Underwater visual-inertial navigation is challenging due to the poor visibility and presence of outliers in underwater environments. The navigation performance is closely related to outlier detection and elimination. Existing methods assume…
Asynchronous and cyclostationary impulsive noise can severely impact the bit-error-rate (BER) of OFDM-based powerline communication systems. In this paper, we analyze an adaptive nonlinear analog front end filter that mitigates various…
The leading workhorse of anomaly (and attack) detection in the literature has been residual-based detectors, where the residual is the discrepancy between the observed output provided by the sensors (inclusive of any tampering along the…
Outlier detection can serve as an extremely important tool for researchers from a wide range of fields. From the sectors of banking and marketing to the social sciences and healthcare sectors, outlier detection techniques are very useful…
In this article, we consider the problem of outlier-robust state estimation where the measurement noise can be correlated. Outliers in data arise due to many reasons like sensor malfunctioning, environmental behaviors, communication…
Wireless Sensor Networks (WSNs) have recently attracted greater attention worldwide due to their practicality in monitoring, communicating, and reporting specific physical phenomena. The data collected by WSNs is often inaccurate as a…
Nonlinearity in many systems is heavily dependent on component variation and environmental factors such as temperature. This is often overcome by keeping signals close enough to the device's operating point that it appears approximately…
Outlier detection is an important problem occurring in a wide range of areas. Outliers are the outcome of fraudulent behaviour, mechanical faults, human error, or simply natural deviations. Many data mining applications perform outlier…
In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outliers can lead to better datasets by (1) removing noise in…