中文
相关论文

相关论文: Optimizing Huffman Decoding for Error-Bounded Loss…

200 篇论文

Graphs have been extensively used to represent data from various domains. In the era of Big Data, information is being generated at a fast pace, and analyzing the same is a challenge. Various methods have been proposed to speed up the…

信息论 · 计算机科学 2018-06-26 Rushabh Jitendrakumar Shah

The rapid expansion of computational capabilities and the ever-growing scale of modern HPC systems present formidable challenges in managing exascale scientific data. Faced with such vast datasets, traditional lossless compression…

分布式、并行与集群计算 · 计算机科学 2024-04-23 Wenqi Jia , Sian Jin , Jinzhen Wang , Wei Niu , Dingwen Tao , Miao Yin

Training and serving Large Language Models (LLMs) require partitioning data across multiple accelerators, where collective operations are frequently bottlenecked by network bandwidth. Lossless compression using Huffman codes is an effective…

Existing error-bounded lossy compression techniques control the pointwise error during compression to guarantee the integrity of the decompressed data. However, they typically do not explicitly preserve the topological features in data.…

信息论 · 计算机科学 2023-07-31 Lin Yan , Xin Liang , Hanqi Guo , Bei Wang

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…

GPUs have gained significant popularity over the past decade, extending beyond their original role in graphics rendering. This evolution has brought GPU security and reliability to the forefront of concerns. Prior research has shown that…

密码学与安全 · 计算机科学 2026-01-06 Saurabh Singh , Ruobing Han , Jaewon Lee , Seonjin Na , Yonghae Kim , Taesoo Kim , Hyesoon Kim

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compressor has been considered one of…

分布式、并行与集群计算 · 计算机科学 2021-11-15 Xin Liang , Kai Zhao , Sheng Di , Sihuan Li , Robert Underwood , Ali M. Gok , Jiannan Tian , Junjing Deng , Jon C. Calhoun , Dingwen Tao , Zizhong Chen , Franck Cappello

Today's scientific simulations require significant data volume reduction because of the enormous amounts of data produced and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one of the most…

分布式、并行与集群计算 · 计算机科学 2023-12-07 Daoce Wang , Jesus Pulido , Pascal Grosset , Sian Jin , Jiannan Tian , Kai Zhao , James Ahrens , Dingwen Tao

Huffman coding is well known to be useful in certain decision problems involving minimizing the average number of (freely chosen) queries to determine an unknown random variable. However, in problems where the queries are more constrained,…

信息论 · 计算机科学 2022-10-11 Shuyuan Zhang , Jichen Sun , Shengkang Chen

Currently, the size of scientific data is growing at an unprecedented rate. Data in the form of tensors exhibit high-order, high-dimensional, and highly sparse features. Although tensor-based analysis methods are very effective, the large…

分布式、并行与集群计算 · 计算机科学 2022-10-13 Zixuan Li

In recent years, the field of learned video compression has witnessed rapid advancement, exemplified by the latest neural video codecs DCVC-DC that has outperformed the upcoming next-generation codec ECM in terms of compression ratio.…

图像与视频处理 · 电气工程与系统科学 2024-07-24 Zidian Qiu , Zongyao He , Zhi Jin

Lossy compression algorithms aim to compactly encode images in a way which enables to restore them with minimal error. We show that a key limitation of existing algorithms is that they rely on error measures that are extremely sensitive to…

计算机视觉与模式识别 · 计算机科学 2018-04-13 Tamar Rott Shaham , Tomer Michaeli

We introduce a novel, efficient computational method, ZEUS, for numerical optimization, and provide an open-source implementation. It has four key ingredients: (1) particle swarm optimization (PSO), (2) the use of the…

分布式、并行与集群计算 · 计算机科学 2026-04-01 Dominik Soos , Marc Paterno , Desh Ranjan , Mohammad Zubair

Video compression plays a pivotal role in managing and transmitting large-scale display data, particularly given the growing demand for higher resolutions and improved video quality. This paper proposes an optimized memory system…

硬件体系结构 · 计算机科学 2025-02-26 Hannah Yang , Sohyeon Kim , Saeyeon Kim , Jiyoung Lee , Huijin Roh , Ji-Hoon Kim

Iterative methods on irregular grids have been used widely in all areas of comptational science and engineering for solving partial differential equations with complex geometry. They provide the flexibility to express complex shapes with…

数学软件 · 计算机科学 2016-12-05 Naoki Yoshifuji , Ryo Sakamoto , Keigo Nitadori , Jun Makino

Training and serving Large Language Models (LLMs) relies heavily on parallelization and collective operations, which are frequently bottlenecked by network bandwidth. Lossless compression using e.g., Huffman codes can alleviate the issue,…

With the ever-increasing execution scale of high performance computing (HPC) applications, vast amounts of data are being produced by scientific research every day. Error-bounded lossy compression has been considered a very promising…

分布式、并行与集群计算 · 计算机科学 2023-10-24 Jinyang Liu , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Tucker decomposition is one of the SOTA CNN model compression techniques. However, unlike the FLOPs reduction, we observe very limited inference time reduction with Tucker-compressed models using existing GPU software such as cuDNN. To this…

分布式、并行与集群计算 · 计算机科学 2023-01-06 Lizhi Xiang , Miao Yin , Chengming Zhang , Aravind Sukumaran-Rajam , P. Sadayappan , Bo Yuan , Dingwen Tao

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

信息论 · 计算机科学 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

With ever-increasing volumes of scientific floating-point data being produced by high-performance computing applications, significantly reducing scientific floating-point data size is critical, and error-controlled lossy compressors have…

分布式、并行与集群计算 · 计算机科学 2020-01-20 Robert Underwood , Sheng Di , Jon C. Calhoun , Franck Cappello