English
Related papers

Related papers: Implementation and evaluation of data-compression …

200 papers

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…

Currently, the dominating constraint in many high performance computing applications is data capacity and bandwidth, in both inter-node communications and even more-so in on-node data motion. A new approach to address this limitation is to…

Numerical Analysis · Mathematics 2024-07-03 Alyson Fox , James Diffenderfer , Jeffrey Hittinger , Geoffrey Sanders , Peter Lindstrom

Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to address this problem, as it allows for on-demand data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-02 Yanliang Li , Wenbo Li , Qian Gong , Qing Liu , Norbert Podhorszki , Scott Klasky , Xin Liang , Jieyang Chen

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) architecture, GPU-accelerated error-bounded compressors (such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Jiannan Tian , Sheng Di , Xiaodong Yu , Cody Rivera , Kai Zhao , Sian Jin , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

Particle-based simulations and point-cloud applications generate massive, irregular datasets that challenge storage, I/O, and real-time analytics. Traditional compression techniques struggle with irregular particle distributions and GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Ruoyu Li , Yafan Huang , Longtao Zhang , Zhuoxun Yang , Sheng Di , Jiajun Huang , Jinyang Liu , Jiannan Tian , Xin Liang , Guanpeng Li , Hanqi Guo , Franck Cappello , Kai Zhao

Machine-generated data is rapidly growing and poses challenges for data-intensive systems, especially as the growth of data outpaces the growth of storage space. To cope with the storage issue, compression plays a critical role in storage…

Databases · Computer Science 2023-11-27 Jiujing Zhang , Zhitao Shen , Shiyu Yang , Lingkai Meng , Chuan Xiao , Wei Jia , Yue Li , Qinhui Sun , Wenjie Zhang , Xuemin Lin

As HPC systems continue to grow to exascale, the amount of data that needs to be saved or transmitted is exploding. To this end, many previous works have studied using error-bounded lossy compressors to reduce the data size and improve the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-16 Chengming Zhang , Sian Jin , Tong Geng , Jiannan Tian , Ang Li , Dingwen Tao

We explore an error-bounded lossy compression approach for reducing scientific data associated with 2D/3D unstructured meshes. While existing lossy compressors offer a high compression ratio with bounded error for regular grid data,…

Graphics · Computer Science 2024-04-04 Congrong Ren , Xin Liang , Hanqi Guo

Modern HPC applications produce increasingly large amounts of data, which limits the performance of current extreme-scale systems. Data reduction techniques, such as lossy compression, help to mitigate this issue by decreasing the size of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-13 Griffin Dube , Jiannan Tian , Sheng Di , Dingwen Tao , Jon Calhoun , Franck Cappello

In this thesis, we describe a new, practical approach to integrating hardware-based data compression within the memory hierarchy, including on-chip caches, main memory, and both on-chip and off-chip interconnects. This new approach is fast,…

Hardware Architecture · Computer Science 2016-09-08 Gennady Pekhimenko

Sparse Matrix-Vector Multiplication (SpMV) is a critical operation for the iterative solver of Finite Element Methods on computer simulation. Since the SpMV operation is a memory-bound algorithm, the efficiency of data movements heavily…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-15 Chong Chen

Matrix-vector multiplication forms the basis of many iterative solution algorithms and as such is an important algorithm also for hierarchical matrices which are used to represent dense data in an optimized form by applying low-rank…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-30 Ronald Kriemann

The compression-complexity trade-off of lossy compression algorithms that are based on a random codebook or a random database is examined. Motivated, in part, by recent results of Gupta-Verd\'{u}-Weissman (GVW) and their underlying…

Information Theory · Computer Science 2009-04-23 Chris Gioran , Ioannis Kontoyiannis

Recently, graphics processors (GPUs) have been increasingly leveraged in a variety of scientific computing applications. However, architectural differences between CPUs and GPUs necessitate the development of algorithms that take advantage…

Mathematical Software · Computer Science 2015-01-05 Jonathan Wong , Ellen Kuhl , Eric Darve

Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental operation in graph computing and analytics. However, the irregularity of real-world graphs poses significant challenges to achieving efficient SpMM operation for graph data on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-13 Zhonggen Li , Xiangyu Ke , Yifan Zhu , Yunjun Gao , Yaofeng Tu

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

In scientific simulations, observations, and experiments, the cost of transferring data to and from disk and across networks has become a significant bottleneck that particularly impacts subsequent data analysis and visualization. To…

Databases · Computer Science 2023-08-24 Victor A. P. Magri , Peter Lindstrom

The sparse matrix-vector (SpMV) multiplication is an important computational kernel, but it is notoriously difficult to execute efficiently. This paper investigates algorithm performance for unstructured sparse matrices, which are more…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-27 Kobe Bergmans , Karl Meerbergen , Raf Vandebril

A number of known techniques for improving cache performance in scientific computations involve the reordering of the iteration space. Some of these reorderings can be considered coverings of the iteration space with sets having small…

Performance · Computer Science 2009-09-29 Michael Frumkin , Rob F. Van der Wijngaart

This paper investigates hardware-based memory compression designs to increase the memory bandwidth. When lines are compressible, the hardware can store multiple lines in a single memory location, and retrieve all these lines in a single…

Hardware Architecture · Computer Science 2018-07-23 Vinson Young , Sanjay Kariyappa , Moinuddin K. Qureshi
‹ Prev 1 2 3 10 Next ›