English
Related papers

Related papers: Understanding GPU-Based Lossy Compression for Extr…

200 papers

Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors has been used in workflows to reduce storage requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-22 Sian Jin , Jesus Pulido , Pascal Grosset , Jiannan Tian , Dingwen Tao , James Ahrens

Particle-based simulations and point-cloud applications generate massive, irregular datasets that challenge storage, I/O, and real-time analytics. Traditional compression techniques struggle with irregular particle distributions and GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Ruoyu Li , Yafan Huang , Longtao Zhang , Zhuoxun Yang , Sheng Di , Jiajun Huang , Jinyang Liu , Jiannan Tian , Xin Liang , Guanpeng Li , Hanqi Guo , Franck Cappello , Kai Zhao

Error-bounded lossy compression is a state-of-the-art data reduction technique for HPC applications because it not only significantly reduces storage overhead but also can retain high fidelity for postanalysis. Because supercomputers and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-22 Jiannan Tian , Sheng Di , Kai Zhao , Cody Rivera , Megan Hickman Fulp , Robert Underwood , Sian Jin , Xin Liang , Jon Calhoun , Dingwen Tao , Franck Cappello

Data compression is a critical technology for large-scale plasma simulations. Storing complete particle information requires Terabyte-scale data storage, and analysis requires ad-hoc scalable post-processing tools. We propose a…

Computational Engineering, Finance, and Science · Computer Science 2025-04-24 Andong Hu , Luca Pennati , Ivy Peng , Stefano Markidis

Because of the vast volume of data being produced by today's scientific simulations, lossy compression allowing user-controlled information loss can significantly reduce the data size and the I/O burden. However, for large-scale cosmology…

Information Theory · Computer Science 2017-08-08 Dingewn Tao , Sheng Di , Zizhong Chen , Franck Cappello

Today's large-scale scientific applications running on high-performance computing (HPC) systems generate vast data volumes. Thus, data compression is becoming a critical technique to mitigate the storage burden and data-movement cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-04 Boyuan Zhang , Jiannan Tian , Sheng Di , Xiaodong Yu , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce raw data at extremely high throughputs, requiring urgent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Shixun Wu , Jinwen Pan , Jinyang Liu , Jiannan Tian , Ziwei Qiu , Jiajun Huang , Kai Zhao , Xin Liang , Sheng Di , Zizhong Chen , Franck Cappello

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. Compared to CPU-based compressors, GPU-based compressors exhibit substantially higher throughputs, fitting better for today's HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 Jinyang Liu , Jiannan Tian , Shixun Wu , Sheng Di , Boyuan Zhang , Robert Underwood , Yafan Huang , Jiajun Huang , Kai Zhao , Guanpeng Li , Dingwen Tao , Zizhong Chen , Franck Cappello

The torrential influx of floating-point data from domains like IoT and HPC necessitates high-performance lossless compression to mitigate storage costs while preserving absolute data fidelity. Leveraging GPU parallelism for this task…

Databases · Computer Science 2025-11-12 Zheng Li , Weiyan Wang , Ruiyuan Li , Chao Chen , Xianlei Long , Linjiang Zheng , Quanqing Xu , Chuanhui Yang

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) architecture, GPU-accelerated error-bounded compressors (such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Jiannan Tian , Sheng Di , Xiaodong Yu , Cody Rivera , Kai Zhao , Sian Jin , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

Many scientific applications opt for particles instead of meshes as their basic primitives to model complex systems composed of billions of discrete entities. Such applications span a diverse array of scientific domains, including molecular…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-04 Longtao Zhang , Ruoyu Li , Congrong Ren , Sheng Di , Jinyang Liu , Jiajun Huang , Robert Underwood , Pascal Grosset , Dingwen Tao , Xin Liang , Hanqi Guo , Franck Capello , Kai Zhao

In situ lossy compression allowing user-controlled data loss can significantly reduce the I/O burden. For large-scale N-body simulations where only one snapshot can be compressed at a time, the lossy compression ratio is very limited…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-13 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Kinetic plasma simulations solve the Vlasov-Poisson or Vlasov-Maxwell equations to evolve scalar-variable distribution functions in position-velocity phase space and vector-variable electromagnetic fields in physical space. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Andrew Ho , Genia Vogman

Error-bounded lossy compression has been a critical technique to significantly reduce the sheer amounts of simulation datasets for high-performance computing (HPC) scientific applications while effectively controlling the data distortion…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-23 Tripti Agarwal , Sheng Di , Jiajun Huang , Yafan Huang , Ganesh Gopalakrishnan , Robert Underwood , Kai Zhao , Xin Liang , Guanpeng Li , Franck Cappello

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide…

Today's scientific high performance computing (HPC) applications or advanced instruments are producing vast volumes of data across a wide range of domains, which introduces a serious burden on data transfer and storage. Error-bounded lossy…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Xiaodong Yu , Sheng Di , Kai Zhao , jiannan Tian , Dingwen Tao , Xin Liang , Franck Cappello

Error-bounded lossy compression techniques have become vital for scientific data management and analytics, given the ever-increasing volume of data generated by modern scientific simulations and instruments. Nevertheless, assessing data…

Machine Learning · Computer Science 2025-12-29 Khondoker Mirazul Mumenin , Robert Underwood , Dong Dai , Jinzhen Wang , Sheng Di , Zarija Lukić , Franck Cappello

The graphics processing unit (GPU) has emerged as a powerful and cost effective processor for general performance computing. GPUs are capable of an order of magnitude more floating-point operations per second as compared to modern central…

Computation · Statistics 2012-07-24 Mark Franey , Pritam Ranjan , Hugh Chipman

General purpose computing on graphics processing units (GPGPU) is dramatically changing the landscape of high performance computing in astronomy. In this paper, we identify and investigate several key decision areas, with a goal of…

Instrumentation and Methods for Astrophysics · Physics 2011-01-25 Christopher J. Fluke , David G. Barnes , Benjamin R. Barsdell , Amr H. Hassan
‹ Prev 1 2 3 10 Next ›