English
Related papers

Related papers: FCBench: Cross-Domain Benchmarking of Lossless Com…

200 papers

Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 Sian Jin , Dingwen Tao , Houjun Tang , Sheng Di , Suren Byna , Zarija Lukic , Franck Cappello

Lossy compression is one of the most effective methods for reducing the size of scientific data containing multiple data fields. It reduces information density through prediction or transformation techniques to compress the data. Previous…

Machine Learning · Computer Science 2024-09-30 Youyuan Liu , Wenqi Jia , Taolue Yang , Miao Yin , Sian Jin

Federated learning (FL) is a decentralized method enabling hospitals to collaboratively learn a model without sharing private patient data for training. In FL, participant hospitals periodically exchange training results rather than…

Cryptography and Security · Computer Science 2022-08-24 S. Maryam Hosseini , Milad Sikaroudi , Morteza Babaei , H. R. Tizhoosh

Parallel programmers face the often irreconcilable goals of programmability and performance. HPC systems use distributed memory for scalability, thereby sacrificing the programmability advantages of shared memory programming models.…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-21 Bharath Ramesh , Calvin J. Ribbens , Srinidhi Varadarajan

The cost of moving data between the memory units and the compute units is a major contributor to the execution time and energy consumption of modern workloads in computing systems. At the same time, we are witnessing an enormous amount of…

Hardware Architecture · Computer Science 2022-08-19 Gagandeep Singh

Despite decades of research, creating accurate, robust, and efficient lattice Boltzmann methods (LBM) on non-uniform grids with seamless GPU acceleration remains challenging. This work introduces a novel strategy to address this challenge…

Computational Physics · Physics 2026-01-06 Christophe Coreixas , Jonas Latt

Iterative methods are commonly used approaches to solve large, sparse linear systems, which are fundamental operations for many modern scientific simulations. When the large-scale iterative methods are running with a large number of ranks…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-30 Dingwen Tao , Sheng Di , Xin Liang , Zizhong Chen , Franck Cappello

In general, large datasets enable deep learning models to perform with good accuracy and generalizability. However, massive high-fidelity simulation datasets (from molecular chemistry, astrophysics, computational fluid dynamics (CFD), etc.…

Machine Learning · Computer Science 2022-07-27 Wai Tong Chung , Ki Sung Jung , Jacqueline H. Chen , Matthias Ihme

Recent development in lightweight OS-level virtualization, containers, provides a potential solution for running HPC applications on the cloud platform. In this work, we focus on the impact of different layers in a containerized environment…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Daniel Medeiros , Gabin Schieffer , Jacob Wahlgren , Ivy Peng

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…

Frugal computing is becoming an important topic for environmental reasons. In this context, several techniques have been proposed to reduce the storage of scientific data by dedicated compression methods specially tailored for arrays of…

Data Structures and Algorithms · Computer Science 2022-03-01 Matthieu Martel

We propose a practical deep generative approach for lossless point cloud geometry compression, called MSVoxelDNN, and show that it significantly reduces the rate compared to the MPEG G-PCC codec. Our previous work based on autoregressive…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Dat Thanh Nguyen , Maurice Quach , Giuseppe Valenzise , Pierre Duhamel

Learned Compression (LC) is the emerging technology for compressing image and video content, using deep neural networks. Despite being new, LC methods have already gained a compression efficiency comparable to state-of-the-art image…

Multimedia · Computer Science 2023-05-11 Farhad Pakdaman , Moncef Gabbouj

Point-based 3D point cloud models employ computation and memory intensive mapping functions alongside NN layers for classification/segmentation, and are executed on server-grade GPUs. The sparse, and unstructured nature of 3D point cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Amur Saqib Pal , Muhammad Mohsin Ghaffar , Faisal Shafait , Christian Weis , Norbert Wehn

Multiphase compressible flows are often characterized by a broad range of space and time scales. Thus entailing large grids and small time steps, simulations of these flows on CPU-based clusters can thus take several wall-clock days.…

Cyber-physical system (CPS) forecasting models depend on sensor streams with noisy, biased, missing, or temporally misaligned readings, yet standard forecasting evaluation often selects models by nominal error without showing whether they…

Machine Learning · Computer Science 2026-05-12 Alexander Windmann , Philipp Wittenberg , Gianluca Manca , Marcel Dix , Jens U. Brandt , Oliver Niggemann

In conventional federated hyperdimensional computing (HDC), training larger models usually results in higher predictive performance but also requires more computational, communication, and energy resources. If the system resources are…

Machine Learning · Computer Science 2023-06-05 Nikita Zeulin , Olga Galinina , Nageen Himayat , Sergey Andreev

In the burgeoning realm of Internet of Things (IoT) applications on edge devices, data stream compression has become increasingly pertinent. The integration of added compression overhead and limited hardware resources on these devices calls…

Databases · Computer Science 2024-06-18 Xianzhi Zeng , Shuhao Zhang

Data compression is an efficient technique to save data storage and transmission costs. However, traditional data compression methods always ignore the impact of user preferences on the statistical distributions of symbols transmitted over…

Information Theory · Computer Science 2019-04-01 Yawei Lu , Wei Chen , H. Vincent Poor

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello