English
Related papers

Related papers: TopoSZp: Lightweight Topology-Aware Error-controll…

200 papers

Time series data compression is emerging as an important problem with the growth in IoT devices and sensors. Due to the presence of noise in these datasets, lossy compression can often provide significant compression gains without impacting…

Signal Processing · Electrical Eng. & Systems 2020-01-14 Shubham Chandak , Kedar Tatwawadi , Chengtao Wen , Lingyun Wang , Juan Aparicio , Tsachy Weissman

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compressor has been considered one of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-15 Xin Liang , Kai Zhao , Sheng Di , Sihuan Li , Robert Underwood , Ali M. Gok , Jiannan Tian , Junjing Deng , Jon C. Calhoun , Dingwen Tao , Zizhong Chen , Franck Cappello

This research explores a novel paradigm for preserving topological segmentations in existing error-bounded lossy compressors. Today's lossy compressors rarely consider preserving topologies such as Morse-Smale complexes, and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-08 Yuxiao Li , Xin Liang , Bei Wang , Yongfeng Qiu , Lin Yan , Hanqi Guo

Compression of floating-point data will play an important role in high-performance computing as data bandwidth and storage become dominant costs. Lossy compression of floating-point data is powerful, but theoretical results are needed to…

Numerical Analysis · Mathematics 2024-07-03 James Diffenderfer , Alyson Fox , Jeffrey Hittinger , Geoffrey Sanders , Peter Lindstrom

In this paper, we present a novel compression framework, TFZ, that preserves the topology of 2D symmetric and asymmetric second-order tensor fields defined on flat triangular meshes. A tensor field assigns a tensor - a multi-dimensional…

Graphics · Computer Science 2025-08-14 Nathaniel Gorski , Xin Liang , Hanqi Guo , Bei Wang

Lossy compression is widely used to reduce storage and I/O costs for large-scale particle datasets in scientific applications such as cosmology, molecular dynamics, and fluid dynamics, where clustering structures (e.g., single-linkage or…

Machine Learning · Computer Science 2026-04-22 Congrong Ren , Sheng Di , Katrin Heitmann , Franck Cappello , Hanqi Guo

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide…

We explore an error-bounded lossy compression approach for reducing scientific data associated with 2D/3D unstructured meshes. While existing lossy compressors offer a high compression ratio with bounded error for regular grid data,…

Graphics · Computer Science 2024-04-04 Congrong Ren , Xin Liang , Hanqi Guo

Today's large-scale scientific applications running on high-performance computing (HPC) systems generate vast data volumes. Thus, data compression is becoming a critical technique to mitigate the storage burden and data-movement cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-04 Boyuan Zhang , Jiannan Tian , Sheng Di , Xiaodong Yu , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

With the ever-increasing execution scale of high performance computing (HPC) applications, vast amounts of data are being produced by scientific research every day. Error-bounded lossy compression has been considered a very promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Jinyang Liu , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Modern scientific simulations generate massive volumes of data, creating significant challenges for I/O and storage systems. Error-bounded lossy compression (EBLC) offers a solution by reducing data set sizes while preserving data quality…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-16 Grant Wilkins , Sheng Di , Jon C. Calhoun , Robert Underwood , Franck Cappello

Many scientific applications opt for particles instead of meshes as their basic primitives to model complex systems composed of billions of discrete entities. Such applications span a diverse array of scientific domains, including molecular…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-04 Longtao Zhang , Ruoyu Li , Congrong Ren , Sheng Di , Jinyang Liu , Jiajun Huang , Robert Underwood , Pascal Grosset , Dingwen Tao , Xin Liang , Hanqi Guo , Franck Capello , Kai Zhao

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations.…

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

Because of vast volume of data being produced by today's scientific simulations and experiments, lossy data compressor allowing user-controlled loss of accuracy during the compression is a relevant solution for significantly reducing the…

Other Computer Science · Computer Science 2017-11-15 Dingwen Tao , Sheng Di , Hanqi Guo , Zizhong Chen , Franck Cappello

The rapid expansion of computational capabilities and the ever-growing scale of modern HPC systems present formidable challenges in managing exascale scientific data. Faced with such vast datasets, traditional lossless compression…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Wenqi Jia , Sian Jin , Jinzhen Wang , Wei Niu , Dingwen Tao , Miao Yin

The growing volume of scientific simulation data presents a significant challenge for storage and transfer. Error-bounded lossy compression has emerged as a critical solution for mitigating these challenges, providing a means to reduce data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Arshan Khan , Rohit Deshmukh , Ben O'Neill

As HPC systems continue to grow to exascale, the amount of data that needs to be saved or transmitted is exploding. To this end, many previous works have studied using error-bounded lossy compressors to reduce the data size and improve the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-16 Chengming Zhang , Sian Jin , Tong Geng , Jiannan Tian , Ang Li , Dingwen Tao

Lossy compressors are increasingly adopted in scientific research, tackling volumes of data from experiments or parallel numerical simulations and facilitating data storage and movement. In contrast with the notion of entropy in lossless…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-16 Robert Underwood , Julie Bessac , David Krasowska , Jon C. Calhoun , Sheng Di , Franck Cappello

Because of the vast volume of data being produced by today's scientific simulations, lossy compression allowing user-controlled information loss can significantly reduce the data size and the I/O burden. However, for large-scale cosmology…

Information Theory · Computer Science 2017-08-08 Dingewn Tao , Sheng Di , Zizhong Chen , Franck Cappello