English
Related papers

Related papers: Understanding GPU-Based Lossy Compression for Extr…

200 papers

The increasing complexity and scale of cosmological N-body simulations, driven by astronomical surveys like Euclid, call for a paradigm shift towards more sustainable and energy-efficient high-performance computing (HPC). The rising energy…

Cosmological measurements require the calculation of nontrivial quantities over large datasets. The next generation of survey telescopes (such as DES, PanSTARRS, and LSST) will yield measurements of billions of galaxies. The scale of these…

Instrumentation and Methods for Astrophysics · Physics 2012-12-10 Deborah Bard , Matthew Bellis , Mark T. Allen , Hasmik Yepremyan , Jan M. Kratochvil

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations.…

Recently, immersive media and autonomous driving applications have significantly advanced through 3D Gaussian Splatting (3DGS), which offers high-fidelity rendering and computational efficiency. Despite these advantages, 3DGS as a…

Graphics · Computer Science 2025-05-27 Kangli Wang , Shihao Li , Qianxi Yi , Wei Gao

In order to evaluate, validate, and refine the design of new quantum algorithms or quantum computers, researchers and developers need methods to assess their correctness and fidelity. This requires the capabilities of quantum circuit…

Quantum Physics · Physics 2018-11-16 Xin-Chuan Wu , Sheng Di , Franck Cappello , Hal Finkel , Yuri Alexeev , Frederic T. Chong

Highly-parallel graphics processing units (GPUs) can improve the speed of micromagnetic simulations significantly as compared to conventional computing using central processing units (CPUs). We present a strategy for performing…

Computational Physics · Physics 2015-12-18 C. L. Jermain , G. E. Rowlands , R. A. Buhrman , D. C. Ralph

We advocate for a new paradigm of cosmological likelihood-based inference, leveraging recent developments in machine learning and its underlying technology, to accelerate Bayesian inference in high-dimensional settings. Specifically, we…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-06 Davide Piras , Alicja Polanska , Alessio Spurio Mancini , Matthew A. Price , Jason D. McEwen

This paper presents a new algorithm for the lossy compression of scalar data defined on 2D or 3D regular grids, with topological control. Certain techniques allow users to control the pointwise error induced by the compression. However, in…

Image and Video Processing · Electrical Eng. & Systems 2018-02-09 Maxime Soler , Melanie Plainchault , Bruno Conche , Julien Tierny

As a fundamental data format representing spatial information, depth map is widely used in signal processing and computer vision fields. Massive amount of high precision depth maps are produced with the rapid development of equipment like…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Yuyang Wu , Wei Gao

Lossy compressors are increasingly adopted in scientific research, tackling volumes of data from experiments or parallel numerical simulations and facilitating data storage and movement. In contrast with the notion of entropy in lossless…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-16 Robert Underwood , Julie Bessac , David Krasowska , Jon C. Calhoun , Sheng Di , Franck Cappello

N-body simulations are essential tools in physical cosmology to understand the large-scale structure (LSS) formation of the Universe. Large-scale simulations with high resolution are important for exploring the substructure of universe and…

Computational Physics · Physics 2020-10-22 Shenggan Cheng , Hao-Ran Yu , Derek Inman , Qiucheng Liao , Qiaoya Wu , James Lin

Modern scientific simulations and instruments generate data volumes that overwhelm memory and storage, throttling scalability. Lossy compression mitigates this by trading controlled error for reduced footprint and throughput gains, yet…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-26 Skyler Ruiter , Jiannan Tian , Fengguang Song

The increasing volume and velocity of science data necessitate the frequent movement of enormous data volumes as part of routine research activities. As a result, limited wide-area bandwidth often leads to bottlenecks in research progress.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-12 Yuanjian Liu , Sheng Di , Kyle Chard , Ian Foster , Franck Cappello

The site conditions that make astronomical observatories in space and on the ground so desirable -- cold and dark -- demand a physical remoteness that leads to limited data transmission capabilities. Such transmission limitations directly…

Artificial Intelligence · Computer Science 2025-06-11 Tuan Truong , Rithwik Sudharsan , Yibo Yang , Peter Xiangyuan Ma , Ruihan Yang , Stephan Mandt , Joshua S. Bloom

We demonstrate a GPU-accelerated nested sampling framework for efficient high-dimensional Bayesian inference in cosmology. Using JAX-based neural emulators and likelihoods for cosmic microwave background and cosmic shear analyses, our…

Cosmology and Nongalactic Astrophysics · Physics 2025-10-08 Toby Lovick , David Yallup , Davide Piras , Alessio Spurio Mancini , Will Handley

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms…

Machine Learning · Computer Science 2022-12-22 Tania Banerjee , Jong Choi , Jaemoon Lee , Qian Gong , Jieyang Chen , Scott Klasky , Anand Rangarajan , Sanjay Ranka

Lossy compression is widely used to reduce storage and I/O costs for large-scale particle datasets in scientific applications such as cosmology, molecular dynamics, and fluid dynamics, where clustering structures (e.g., single-linkage or…

Machine Learning · Computer Science 2026-04-22 Congrong Ren , Sheng Di , Katrin Heitmann , Franck Cappello , Hanqi Guo

Neural scene representations, such as 3D Gaussian Splatting (3DGS), have enabled high-quality neural rendering; however, their large storage and transmission costs hinder deployment in resource-constrained environments. Existing compression…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiaqi Chen , Xinhao Ji , Yuanyuan Gao , Hao Li , Yuning Gong , Yifei Liu , Dan Xu , Zhihang Zhong , Dingwen Zhang , Xiao Sun

Hybrid computational architectures based on the joint power of Central Processing Units and Graphic Processing Units (GPUs) are becoming popular and powerful hardware tools for a wide range of simulations in biology, chemistry, engineering,…

Instrumentation and Methods for Astrophysics · Physics 2015-06-15 Roberto Capuzzo-Dolcetta , Mario Spera

Today's scientific simulations, for example in the high-performance exascale sector, produce huge amounts of data. Due to limited I/O bandwidth and available storage space, there is the necessity to reduce scientific data of high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-25 N. Böing , J. Holke , C. Hergl , L. Spataro , G. Gassner , A. Basermann