中文
相关论文

相关论文: Spatiotemporally adaptive compression for scientif…

200 篇论文

With ever-increasing volumes of scientific floating-point data being produced by high-performance computing applications, significantly reducing scientific floating-point data size is critical, and error-controlled lossy compressors have…

分布式、并行与集群计算 · 计算机科学 2020-01-20 Robert Underwood , Sheng Di , Jon C. Calhoun , Franck Cappello

In this work we investigate efficient data compression for spatiotemporal Black, Azov and Marmara Seas temperature tensors that contain significant number of missing values. These tensors have a complex structure influenced by the…

数值分析 · 数学 2025-10-14 Ilya Kosolapov , Tatiana Sheloput , Sergey Matveev

Error-bounded lossy compression is essential for managing the massive data volumes produced by large-scale HPC simulations. While state-of-the-art compressors such as SZ and ZFP provide strong numerical error guarantees, they often fail to…

分布式、并行与集群计算 · 计算机科学 2026-02-20 Tripti Agarwal , Sheng Di , Xin Liang , Zhaoyuan Su , Yuxiao Li , Ganesh Gopalakrishnan , Hanqi Guo , Franck Cappello

Time series data compression is emerging as an important problem with the growth in IoT devices and sensors. Due to the presence of noise in these datasets, lossy compression can often provide significant compression gains without impacting…

信号处理 · 电气工程与系统科学 2020-01-14 Shubham Chandak , Kedar Tatwawadi , Chengtao Wen , Lingyun Wang , Juan Aparicio , Tsachy Weissman

In situ lossy compression allowing user-controlled data loss can significantly reduce the I/O burden. For large-scale N-body simulations where only one snapshot can be compressed at a time, the lossy compression ratio is very limited…

分布式、并行与集群计算 · 计算机科学 2017-11-13 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide…

Lossy compression has become an important technique to reduce data size in many domains. This type of compression is especially valuable for large-scale scientific data, whose size ranges up to several petabytes. Although Autoencoder-based…

机器学习 · 计算机科学 2024-07-03 Hieu Le , Jian Tao

The last decade has seen an explosion in data sources available for the monitoring and prediction of environmental phenomena. While several inferential methods have been developed that make predictions on the underlying process by combining…

统计方法学 · 统计学 2023-03-06 Eun-Hye Yoo , Andrew Zammit-Mangion , Michael G. Chipeta

Error-bounded lossy compression is one of the most efficient solutions to reduce the volume of scientific data. For lossy compression, progressive decompression and random-access decompression are critical features that enable on-demand…

分布式、并行与集群计算 · 计算机科学 2025-09-03 Daoce Wang , Pascal Grosset , Jesus Pulido , Jiannan Tian , Tushar M. Athawale , Jinda Jia , Baixi Sun , Boyuan Zhang , Sian Jin , Kai Zhao , James Ahrens , Fengguang Song

Lossy compression is one of the most important strategies to resolve the big science data issue, however, little work was done to make it resilient against silent data corruptions (SDC). In fact, SDC is becoming non-negligible because of…

分布式、并行与集群计算 · 计算机科学 2020-10-08 Sihuan Li , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

The escalating surge in data generation presents formidable challenges to information technology, necessitating advancements in storage, retrieval, and utilization. With the proliferation of artificial intelligence and big data, the "Data…

分布式、并行与集群计算 · 计算机科学 2023-09-19 Xinzhe Chen , Jianjiang Li

This article introduces novel and practicable Bayesian factor analysis frameworks that are computationally feasible for moderate to large spatiotemporal data. Previous Bayesian analysis of spatiotemporal data has utilized a Bayesian factor…

统计方法学 · 统计学 2025-02-18 Yifan Cheng , Cheng Li

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…

This paper develops a unified and computationally efficient method for change-point estimation along the time dimension in a non-stationary spatio-temporal process. By modeling a non-stationary spatio-temporal process as a piecewise…

统计方法学 · 统计学 2023-10-09 Zifeng Zhao , Ting Fung Ma , Wai Leong Ng , Chun Yip Yau

Many applications such as scientific simulation, sensing, and power grid monitoring tend to generate massive amounts of data, which should be compressed first prior to storage and transmission. These data, mostly comprised of floating-point…

数据库 · 计算机科学 2019-11-19 Dongeun Lee , Alex Sim , Jaesik Choi , Kesheng Wu

Existing error-bounded lossy compression techniques control the pointwise error during compression to guarantee the integrity of the decompressed data. However, they typically do not explicitly preserve the topological features in data.…

信息论 · 计算机科学 2023-07-31 Lin Yan , Xin Liang , Hanqi Guo , Bei Wang

We present a novel method for the classification and reconstruction of time dependent, high-dimensional data using sparse measurements, and apply it to the flow around a cylinder. Assuming the data lies near a low dimensional manifold…

动力系统 · 数学 2015-06-03 Ido Bright , Guang Lin , J. Nathan Kutz

The last two decades have seen tremendous growth in data collections because of the realization of recent technologies, including the internet of things (IoT), E-Health, industrial IoT 4.0, autonomous vehicles, etc. The challenge of data…

信息论 · 计算机科学 2022-10-03 Vidhi Agrawal , Gajraj Kuldeep , Dhananjoy Dey

Topological descriptors such as contour trees are widely utilized in scientific data analysis and visualization, with applications from materials science to climate simulations. It is desirable to preserve topological descriptors when data…

分布式、并行与集群计算 · 计算机科学 2025-08-13 Nathaniel Gorski , Xin Liang , Hanqi Guo , Lin Yan , Bei Wang

Data-driven soft sensors have been widely applied in complex industrial processes. However, the interpretable spatio-temporal features extraction by soft sensors remains a challenge. In this light, this work introduces a novel method termed…

系统与控制 · 电气工程与系统科学 2025-11-04 Qianchao Wang , Peng Sha , Leena Heistrene , Yuxuan Ding , Yaping Du