English
Related papers

Related papers: DeepCQ: General-Purpose Deep-Surrogate Framework f…

200 papers

Scientific applications typically generate large volumes of floating-point data, making lossy compression one of the most effective methods for data reduction, thereby lowering storage requirements and improving performance in large-scale…

Performance · Computer Science 2024-12-11 Youyuan Liu , Taolue Yang , Sian Jin

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Error-bounded lossy compression is one of the most effective techniques for scientific data reduction. However, the traditional trial-and-error approach used to configure lossy compressors for finding the optimal trade-off between…

Databases · Computer Science 2022-05-09 Sian Jin , Sheng Di , Jiannan Tian , Suren Byna , Dingwen Tao , Franck Cappello

In scientific simulations, observations, and experiments, the cost of transferring data to and from disk and across networks has become a significant bottleneck that particularly impacts subsequent data analysis and visualization. To…

Databases · Computer Science 2023-08-24 Victor A. P. Magri , Peter Lindstrom

With the ever-increasing execution scale of high performance computing (HPC) applications, vast amounts of data are being produced by scientific research every day. Error-bounded lossy compression has been considered a very promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Jinyang Liu , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide…

Lossy compressors are increasingly adopted in scientific research, tackling volumes of data from experiments or parallel numerical simulations and facilitating data storage and movement. In contrast with the notion of entropy in lossless…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-16 Robert Underwood , Julie Bessac , David Krasowska , Jon C. Calhoun , Sheng Di , Franck Cappello

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

In the field of neural data compression, the prevailing focus has been on optimizing algorithms for either classical distortion metrics, such as PSNR or SSIM, or human perceptual quality. With increasing amounts of data consumed by machines…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Dan Jacobellis , Daniel Cummings , Neeraja J. Yadwadkar

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…

High-speed flight vehicles, which travel much faster than the speed of sound, are crucial for national defense and space exploration. However, accurately predicting their behavior under numerous, varied flight conditions is a challenge and…

Machine Learning · Computer Science 2024-11-07 Tyler E. Korenyi-Both , Nathan J. Falkiewicz , Matthew C. Jones

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…

The ongoing development of quantum processors is driving breakthroughs in scientific discovery. Despite this progress, the formidable cost of fabricating large-scale quantum processors means they will remain rare for the foreseeable future,…

Quantum Physics · Physics 2025-07-24 Wei-You Liao , Yuxuan Du , Xinbiao Wang , Tian-Ci Tian , Yong Luo , Bo Du , Dacheng Tao , He-Liang Huang

Hyperdimensional Computing (HDC) is emerging as a promising approach for edge AI, offering a balance between accuracy and efficiency. However, current HDC-based applications often rely on high-precision models and/or encoding matrices to…

Machine Learning · Computer Science 2025-05-09 Nilesh Prasad Pandey , Shriniwas Kulkarni , David Wang , Onat Gungor , Flavio Ponzina , Tajana Rosing

Surrogate strategies are used widely for uncertainty quantification of groundwater models in order to improve computational efficiency. However, their application to dynamic multiphase flow problems is hindered by the curse of…

Machine Learning · Statistics 2019-05-02 Shaoxing Mo , Yinhao Zhu , Nicholas Zabaras , Xiaoqing Shi , Jichun Wu

Modern computational methods, involving highly sophisticated mathematical formulations, enable several tasks like modeling complex physical phenomenon, predicting key properties and design optimization. The higher fidelity in these computer…

Computational Engineering, Finance, and Science · Computer Science 2023-04-13 Lele Luan , Nesar Ramachandra , Sandipp Krishnan Ravi , Anindya Bhaduri , Piyush Pandita , Prasanna Balaprakash , Mihai Anitescu , Changjie Sun , Liping Wang

Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors has been used in workflows to reduce storage requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-22 Sian Jin , Jesus Pulido , Pascal Grosset , Jiannan Tian , Dingwen Tao , James Ahrens

Lossy Image compression is necessary for efficient storage and transfer of data. Typically the trade-off between bit-rate and quality determines the optimal compression level. This makes the image quality metric an integral part of any…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Juan Carlos Mier , Eddie Huang , Hossein Talebi , Feng Yang , Peyman Milanfar

We present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a…

Machine Learning · Statistics 2019-01-16 Yibo Yang , Paris Perdikaris

As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce raw data at extremely high throughputs, requiring urgent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Shixun Wu , Jinwen Pan , Jinyang Liu , Jiannan Tian , Ziwei Qiu , Jiajun Huang , Kai Zhao , Xin Liang , Sheng Di , Zizhong Chen , Franck Cappello
‹ Prev 1 2 3 10 Next ›