A New Algorithm to Smooth Quantization Errors
Abstract
We have devised a simple numerical technique to treat rugged data points that arise due to the insufficient gain setting error (or quantization error) of a digital instrument. This is a very wide spread problem that all experimentalists encounter some time or the other and they are forced to deal with it by suitable adjustments of instrument gains and other relevant parameters. But mostly this entails one to repeat the experiment,this may be inconvenient at the least. Here we prescribe a method that would actually attempt to smoothen the data set that is already so obtained. Our method is based on an entirely different algorithm that is not available anywhere else. This method mimics what one would do by intuitive visual inspection and not like the arcane digital filtering, spline fitting etc. that is available in the market. Nor does it depend on any instrumental parameter tweaking. This makes the program totally general purpose and also intellectually more satisfying.
Cite
@article{arxiv.physics/0501010,
title = {A New Algorithm to Smooth Quantization Errors},
author = {Ayan Paul and P. K. Mukhopadhyay},
journal= {arXiv preprint arXiv:physics/0501010},
year = {2010}
}
Comments
This paper has been withdrawn by the authors. 15 pages, 6 figures. Withdrawn pending work