Related papers: Polynomial data compression for large-scale physic…
The volume of radio-astronomical data is a considerable burden in the processing and storing of radio observations with high time and frequency resolutions and large bandwidths. Lossy compression of interferometric radio-astronomical data…
Laser-plasma physics has developed rapidly over the past few decades as high-power lasers have become both increasingly powerful and more widely available. Early experimental and numerical research in this field was restricted to…
Random Number Generators play a critical role in a number of important applications. In practice, statistical testing is employed to gather evidence that a generator indeed produces numbers that appear to be random. In this paper, we…
Several types of binary systems have been detected up to now at high and very high gamma-ray energies, including microquasars, young pulsars around massive stars and colliding wind binaries. The study of the sources already known, and of…
Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…
The Cherenkov Telescope Array (CTA) will be the next generation ground based observatory in very high energy gamma ray astronomy. The facility will achieve a wide energy coverage, starting from a threshold of a few tens of GeV up to…
Future orbiting observatories will survey large areas of sky in order to constrain the physics of dark matter and dark energy using weak gravitational lensing and other methods. Lossy compression of the resultant data will improve the cost…
Recent advances in capsule endoscopy systems have introduced new methods and capabilities. The capsule endoscopy system, by observing the entire digestive tract, has significantly improved diagnosing gastrointestinal disorders and diseases.…
In collider-based particle and nuclear physics experiments, data are produced at such extreme rates that only a subset can be recorded for later analysis. Typically, algorithms select individual collision events for preservation and store…
Scientific computations or measurements may result in huge volumes of data. Often these can be thought of representing a real-valued function on a high-dimensional domain, and can be conceptually arranged in the format of a tensor of high…
The planned Cherenkov Telescope Array (CTA) is a future observatory for very-high-energy (VHE) gamma-ray astronomy composed of one site per hemisphere. It aims at 10 times better sensitivity, a better angular resolution and wider energy…
Compression is a crucial solution for data reduction in modern scientific applications due to the exponential growth of data from simulations, experiments, and observations. Compression with progressive retrieval capability allows users to…
In the next decade, high energy physicists will use very sophisticated equipment to record unprecedented amounts of data in the hope of making major advances in our understanding of particle phenomena. Some of the signals of new physics…
The Cherenkov Telescope Array (CTA) is the next generation high-energy gamma-ray observatory. It will improve the sensitivity of current instruments up to an order of magnitude, while providing energy coverage for photons from 20 GeV to at…
Once completed, the Cherenkov Telescope Array (CTA) will be able to map the gamma-ray sky in a wide energy range from several tens of GeV to some hundreds of TeV and will be more sensitive than previous experiments by an order of magnitude.…
Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize…
Ground-based gamma-ray astronomy has experienced a major breakthrough in the last decade thanks to the advent of new generation instruments such as H.E.S.S., MAGIC, Milagro and VERITAS. A large variety of cosmic particle accelerators has…
The Cherenkov Telescope Array (CTA) will be the world's first observatory for detecting gamma-rays from astrophysical phenomena and is now in its prototyping phase with construction expected to begin in 2015/16. In this work we present the…
The implementation of modern monitoring systems for power quality disturbances have the potential to generate substantial amounts of data, reaching a point where transmission and storage of high-frequency measurements become impractical.…
We suggest a new algorithm to remove systematic effects in a large set of lightcurves obtained by a photometric survey. The algorithm can remove systematic effects, like the ones associated with atmospheric extinction, detector efficiency,…