English
Related papers

Related papers: GraphComp: Extreme Error-bounded Compression of Sc…

200 papers

Scientific datasets present unique challenges for machine learning-driven compression methods, including more stringent requirements on accuracy and mitigation of potential invalidating artifacts. Drawing on results from compressed sensing…

Machine Learning · Computer Science 2024-05-24 Matthias Chung , Rick Archibald , Paul Atzberger , Jack Michael Solomon

Compression is a crucial solution for data reduction in modern scientific applications due to the exponential growth of data from simulations, experiments, and observations. Compression with progressive retrieval capability allows users to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Zhuoxun Yang , Sheng Di , Longtao Zhang , Ruoyu Li , Ximiao Li , Jiajun Huang , Jinyang Liu , Franck Cappello , Kai Zhao

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

Scientific applications are generating unprecedented volumes of data that overwhelm storage and transmission systems, posing significant challenges for the design of data management tools and scientific databases. Lossy compression has…

Graphics · Computer Science 2026-04-09 Yuxiao Li , Mingze Xia , Xin Liang , Bei Wang , Hanqi Guo

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations.…

Representation learning models for graphs are a successful family of techniques that project nodes into feature spaces that can be exploited by other machine learning algorithms. Since many real-world networks are inherently dynamic, with…

Machine Learning · Computer Science 2020-06-26 Simone Piaggesi , André Panisson

Graphs have been extensively used to represent data from various domains. In the era of Big Data, information is being generated at a fast pace, and analyzing the same is a challenge. Various methods have been proposed to speed up the…

Information Theory · Computer Science 2018-06-26 Rushabh Jitendrakumar Shah

The goal of this work is to address two limitations in autoencoder-based models: latent space interpretability and compatibility with unstructured meshes. This is accomplished here with the development of a novel graph neural network (GNN)…

Machine Learning · Computer Science 2023-02-20 Shivam Barwey , Varun Shankar , Venkatasubramanian Viswanathan , Romit Maulik

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) architecture, GPU-accelerated error-bounded compressors (such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Jiannan Tian , Sheng Di , Xiaodong Yu , Cody Rivera , Kai Zhao , Sian Jin , Yunhe Feng , Xin Liang , Dingwen Tao , Franck Cappello

Many real-world datasets are represented as tensors, i.e., multi-dimensional arrays of numerical values. Storing them without compression often requires substantial space, which grows exponentially with the order. While many tensor…

Machine Learning · Computer Science 2023-09-21 Taehyung Kwon , Jihoon Ko , Jinhong Jung , Kijung Shin

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

Graph convolution network (GCN) attracts intensive research interest with broad applications. While existing work mainly focused on designing novel GCN architectures for better performance, few of them studied a practical yet challenging…

Machine Learning · Computer Science 2020-10-16 Xiaoming Liu , Qirui Li , Chao Shen , Xi Peng , Yadong Zhou , Xiaohong Guan

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

The growing volume of scientific simulation data presents a significant challenge for storage and transfer. Error-bounded lossy compression has emerged as a critical solution for mitigating these challenges, providing a means to reduce data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Arshan Khan , Rohit Deshmukh , Ben O'Neill

Graph representation learning has become a hot research topic due to its powerful nonlinear fitting capability in extracting representative node embeddings. However, for sequential data such as speech signals, most traditional methods…

Sound · Computer Science 2024-05-08 Yingxue Gao , Huan Zhao , Zixing Zhang

In this age of information, images are a critical medium for storing and transmitting information. With the rapid growth of image data amount, visual compression and visual data perception are two important research topics attracting a lot…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Yuefeng Zhang , Chuanmin Jia , Jiannhui Chang , Siwei Ma

The rapid expansion of computational capabilities and the ever-growing scale of modern HPC systems present formidable challenges in managing exascale scientific data. Faced with such vast datasets, traditional lossless compression…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Wenqi Jia , Sian Jin , Jinzhen Wang , Wei Niu , Dingwen Tao , Miao Yin

As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce raw data at extremely high throughputs, requiring urgent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Shixun Wu , Jinwen Pan , Jinyang Liu , Jiannan Tian , Ziwei Qiu , Jiajun Huang , Kai Zhao , Xin Liang , Sheng Di , Zizhong Chen , Franck Cappello

Learning-based lossy image compression usually involves the joint optimization of rate-distortion performance. Most existing methods adopt spatially invariant bit length allocation and incorporate discrete entropy approximation to constrain…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Mu Li , Wangmeng Zuo , Shuhang Gu , Jane You , David Zhang

Graph simulation has recently received a surge of attention in graph processing and analytics. In real-life applications, e.g. social science, biology, and chemistry, many graphs are composed of a series of evolving graphs (i.e., temporal…

Machine Learning · Computer Science 2025-10-08 Sheng Xiang , Chenhao Xu , Dawei Cheng , Xiaoyang Wang , Ying Zhang