English
Related papers

Related papers: Implementation and evaluation of data-compression …

200 papers

Compression is a crucial solution for data reduction in modern scientific applications due to the exponential growth of data from simulations, experiments, and observations. Compression with progressive retrieval capability allows users to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Zhuoxun Yang , Sheng Di , Longtao Zhang , Ruoyu Li , Ximiao Li , Jiajun Huang , Jinyang Liu , Franck Cappello , Kai Zhao

Next-generation wireless communication systems impose much stricter requirements for transmission rate, latency, and reliability. The peak data rate of 6G networks should be no less than 1 Tb/s, which is comparable to existing long-haul…

Information Theory · Computer Science 2024-10-28 Kirill Andreev , Pavel Rybin , Alexey Frolov

The ever-increasing parameter counts of deep learning models necessitate effective compression techniques for deployment on resource-constrained devices. This paper explores the application of information geometry, the study of…

Machine Learning · Computer Science 2025-07-15 Zakhar Shumaylov , Vasileios Tsiaras , Yannis Stylianou

Today's large-scale scientific applications running on high-performance computing (HPC) systems generate vast data volumes. Thus, data compression is becoming a critical technique to mitigate the storage burden and data-movement cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-04 Boyuan Zhang , Jiannan Tian , Sheng Di , Xiaodong Yu , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

The biggest cost of computing with large matrices in any modern computer is related to memory latency and bandwidth. The average latency of modern RAM reads is 150 times greater than a clock step of the processor. Throughput is a little…

Data Structures and Algorithms · Computer Science 2013-03-04 Crysttian Arantes Paixão , Flávio Codeço Coelho

The Massive Parallel Computation (MPC) model is a theoretical framework for popular parallel and distributed platforms such as MapReduce, Hadoop, or Spark. We consider the task of computing a large matching or small vertex cover in this…

Data Structures and Algorithms · Computer Science 2018-07-24 Krzysztof Onak

Sparse matrix-vector multiplication (SpMV) operations are commonly used in various scientific applications. The performance of the SpMV operation often depends on exploiting regularity patterns in the matrix. Various representations have…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-25 Karan Aggarwal , Uday Bondhugula

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth makes it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-28 Jieyang Chen , Lipeng Wan , Xin Liang , Ben Whitney , Qing Liu , Qian Gong , David Pugmire , Nicholas Thompson , Jong Youl Choi , Matthew Wolf , Todd Munson , Ian Foster , Scott Klasky

A tomographic technique called full-waveform inversion has recently shown promise as a fast, affordable, and safe modality to image the brain using ultrasound. However, its high computational cost and memory footprint currently limit its…

Medical Physics · Physics 2021-11-09 Letizia Protopapa , Carlos Cueto

The escalating surge in data generation presents formidable challenges to information technology, necessitating advancements in storage, retrieval, and utilization. With the proliferation of artificial intelligence and big data, the "Data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-19 Xinzhe Chen , Jianjiang Li

Modern compression algorithms exploit complex structures that are present in signals to describe them very efficiently. On the other hand, the field of compressed sensing is built upon the observation that "structured" signals can be…

Information Theory · Computer Science 2016-01-08 Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor

Sparse Matrix-Vector Multiplication (SpMV) is the cornerstone in many iterative workloads, including large-scale graph analytics and sparse iterative solvers. Accelerating SpMV on real-world graphs remains challenging due to highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-11 Qi Zhang , Zhengan Yao , Zhenglu Jiang , Zan-Bo Zhang

Error-bounded lossy compression has been identified as a promising solution for significantly reducing scientific data volumes upon users' requirements on data distortion. For the existing scientific error-bounded lossy compressors, some of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-26 Jinyang Liu , Sheng Di , Kai Zhao , Xin Liang , Sian Jin , Zizhe Jian , Jiajun Huang , Shixun Wu , Zizhong Chen , Franck Cappello

Field Programmable Gate Arrays generate algorithmic specific architectures that improve the code's FLOP per watt ratio. Such devices are re-gaining interest due to the rise of new tools that facilitate their programming, such as OmpSs. The…

Computational Physics · Physics 2021-07-28 Guillermo Oyarzun , Daniel Peyrolon , Carlos Alvarez , Xavier Martorell

The rapid expansion of computational capabilities and the ever-growing scale of modern HPC systems present formidable challenges in managing exascale scientific data. Faced with such vast datasets, traditional lossless compression…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Wenqi Jia , Sian Jin , Jinzhen Wang , Wei Niu , Dingwen Tao , Miao Yin

Sparse matrix-matrix multiplication (SpGEMM) is a critical operation in numerous fields, including scientific computing, graph analytics, and deep learning. These applications exploit the sparsity of matrices to reduce storage and…

Machine Learning · Computer Science 2024-08-30 Sanjali Yadav , Bahar Asgari

Thanks to the rapid proliferation of connected devices, sensor-generated time series constitute a large and growing portion of the world's data. Often, this data is collected from distributed, resource-constrained devices and centralized at…

Performance · Computer Science 2018-08-09 Davis Blalock , Samuel Madden , John Guttag

Scientific applications are generating unprecedented volumes of data that overwhelm storage and transmission systems, posing significant challenges for the design of data management tools and scientific databases. Lossy compression has…

Graphics · Computer Science 2026-04-09 Yuxiao Li , Mingze Xia , Xin Liang , Bei Wang , Hanqi Guo

Matrix Factorization (MF) has been widely applied in machine learning and data mining. A large number of algorithms have been studied to factorize matrices. Among them, stochastic gradient descent (SGD) is a commonly used method.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-30 Yuanhang Yu , Dong Wen , Ying Zhang , Xiaoyang Wang , Wenjie Zhang , Xuemin Lin

A coarse grid correction (CGC) approach is proposed to enhance the efficiency of the matrix exponential and $\varphi$ matrix function evaluations. The approach is intended for iterative methods computing the matrix-vector products with…

Numerical Analysis · Mathematics 2024-04-23 Mike A. Botchev