English
Related papers

Related papers: FZ-GPU: A Fast and High-Ratio Lossy Compressor for…

200 papers

Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 Sian Jin , Dingwen Tao , Houjun Tang , Sheng Di , Suren Byna , Zarija Lukic , Franck Cappello

Large-scale scientific simulations generate massive datasets, posing challenges for storage and I/O. Traditional lossy compression struggles to advance more in balancing compression ratio, data quality, and adaptability to diverse…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-21 Wenqi Jia , Zhewen Hu , Youyuan Liu , Boyuan Zhang , Jinzhen Wang , Jinyang Liu , Wei Niu , Stavros Kalafatis , Junzhou Huang , Sian Jin , Daoce Wang , Jiannan Tian , Miao Yin

Strong gravitational lensing is a powerful probe of cosmology and the dark matter distribution. Efficient lensing software is already a necessity to fully use its potential and the performance demands will only increase with the upcoming…

Instrumentation and Methods for Astrophysics · Physics 2019-02-12 Markus Rexroth , Christoph Schäfer , Gilles Fourestey , Jean-Paul Kneib

Because of the vast volume of data being produced by today's scientific simulations, lossy compression allowing user-controlled information loss can significantly reduce the data size and the I/O burden. However, for large-scale cosmology…

Information Theory · Computer Science 2017-08-08 Dingewn Tao , Sheng Di , Zizhong Chen , Franck Cappello

GPU-based fast Fourier transform (FFT) is extremely important for scientific computing and signal processing. However, we find the inefficiency of existing FFT libraries and the absence of fault tolerance against soft error. To address…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-10 Shixun Wu , Yujia Zhai , Jinyang Liu , Jiajun Huang , Zizhe Jian , Huangliang Dai , Sheng Di , Franck Cappello , Zizhong Chen

Graph neural networks (GNNs) have seen extensive application in domains such as social networks, bioinformatics, and recommendation systems. However, the irregularity and sparsity of graph data challenge traditional computing methods, which…

Machine Learning · Computer Science 2025-02-25 Ka Wai Wu

The graphics processing unit (GPU) has emerged as a powerful and cost effective processor for general performance computing. GPUs are capable of an order of magnitude more floating-point operations per second as compared to modern central…

Computation · Statistics 2012-07-24 Mark Franey , Pritam Ranjan , Hugh Chipman

Lossy compression, widely used by scientists to reduce data from simulations, experiments, and observations, can distort features of interest even under bounded error. Such distortions may compromise downstream analyses and lead to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Yuxiao Li , Mingze Xia , Xin Liang , Bei Wang , Robert Underwood , Sheng Di , Hemant Sharma , Dishant Beniwal , Franck Cappello , Hanqi Guo

Modern graphics computing units (GPUs) are designed and optimized to perform highly parallel numerical calculations. This parallelism has enabled (and promises) significant advantages, both in terms of energy performance and calculation. In…

Hardware Architecture · Computer Science 2021-10-26 Quentin Gallouédec

Lossless model compression holds tremendous promise for alleviating the memory and bandwidth bottlenecks in bit-exact Large Language Model (LLM) serving. However, existing approaches often result in substantial inference slowdowns due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-19 Ruibo Fan , Xiangrui Yu , Xinglin Pan , Zeyu Li , Weile Luo , Qiang Wang , Wei Wang , Xiaowen Chu

Deep-learning-based compressor has received interests recently due to much improved compression ratio. However, modern approaches suffer from long execution time. To ease this problem, this paper targets on cutting down the execution time…

Machine Learning · Computer Science 2022-04-04 Yu Mao , Yufei Cui , Tei-Wei Kuo , Chun Jason Xue

In the next decade, the demands for computing in large scientific experiments are expected to grow tremendously. During the same time period, CPU performance increases will be limited. At the CERN Large Hadron Collider (LHC), these two…

The recently proposed open-source KAZE image feature detection and description algorithm offers unprecedented performance in comparison to conventional ones like SIFT and SURF as it relies on nonlinear scale spaces instead of Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Ramkumar B , R. S. Hegde , Rob Laber , Hristo Bojinov

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth make it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-02 Jieyang Chen , Lipeng Wan , Xin Liang , Ben Whitney , Qing Liu , David Pugmire , Nicholas Thompson , Matthew Wolf , Todd Munson , Ian Foster , Scott Klasky

This paper explores strategies to transform an existing CPU-based high-performance computational fluid dynamics solver, HyPar, for compressible flow simulations on emerging exascale heterogeneous (CPU+GPU) computing platforms. The…

Computational Engineering, Finance, and Science · Computer Science 2022-12-07 Youngdae Kim , Debojyoti Ghosh , Emil M. Constantinescu , Ramesh Balakrishnan

The emergence of artificial intelligence (AI) accelerators like NVIDIA Tensor Cores offers new opportunities to speed up tensor-heavy scientific computations. However, applying them to quantum chemistry is challenging due to strict accuracy…

Chemical Physics · Physics 2026-04-20 Hua Huang , Wenkai Shao , Jeff Hammond

Lossy compression has become an important technique to reduce data size in many domains. This type of compression is especially valuable for large-scale scientific data, whose size ranges up to several petabytes. Although Autoencoder-based…

Machine Learning · Computer Science 2024-07-03 Hieu Le , Jian Tao

Lossy compression is one of the most important strategies to resolve the big science data issue, however, little work was done to make it resilient against silent data corruptions (SDC). In fact, SDC is becoming non-negligible because of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-08 Sihuan Li , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Today's scientific simulations, for example in the high-performance exascale sector, produce huge amounts of data. Due to limited I/O bandwidth and available storage space, there is the necessity to reduce scientific data of high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-25 N. Böing , J. Holke , C. Hergl , L. Spataro , G. Gassner , A. Basermann

We consider lossless compression based on statistical data modeling followed by prediction-based encoding, where an accurate statistical model for the input data leads to substantial improvements in compression. We propose DZip, a…

Machine Learning · Computer Science 2020-09-21 Mohit Goyal , Kedar Tatwawadi , Shubham Chandak , Idoia Ochoa
‹ Prev 1 3 4 5 6 7 10 Next ›