English
Related papers

Related papers: Exploring Autoencoder-based Error-bounded Compress…

200 papers

Over the past years, the ever-growing trend on data storage demand, more specifically for "cold" data (rarely accessed data), has motivated research for alternative systems of data storage. Because of its biochemical characteristics,…

Image and Video Processing · Electrical Eng. & Systems 2023-06-23 Xavier Pic , Eva Gil San Antonio , Melpomeni Dimopoulou , Marc Antonini

As the resolution of weather and climate simulations increases, the amount of data produced is growing rapidly from hundreds of terabytes to tens of petabytes. The huge size becomes a limiting factor for broader adoption, and its fast…

Computational Engineering, Finance, and Science · Computer Science 2026-02-26 Langwen Huang , Luigi Fusco , Florian Scheidl , Jan Zibell , Michael Armand Sprenger , Sebastian Schemm , Torsten Hoefler

Lossy compression is one of the most effective methods for reducing the size of scientific data containing multiple data fields. It reduces information density through prediction or transformation techniques to compress the data. Previous…

Machine Learning · Computer Science 2024-09-30 Youyuan Liu , Wenqi Jia , Taolue Yang , Miao Yin , Sian Jin

Data management is becoming increasingly important in dealing with the large amounts of data produced by large-scale scientific simulations and instruments. Existing multilevel compression algorithms offer a promising way to manage…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-12 Xin Liang , Ben Whitney , Jieyang Chen , Lipeng Wan , Qing Liu , Dingwen Tao , James Kress , Dave Pugmire , Matthew Wolf , Norbert Podhorszki , Scott Klasky

Modern large-scale machine learning applications require stochastic optimization algorithms to be implemented on distributed compute systems. A key bottleneck of such systems is the communication overhead for exchanging information across…

Machine Learning · Computer Science 2021-03-16 Samuel Horváth , Peter Richtárik

With exponential growth in the use of digital image data, the need for efficient transmission methods has become imperative. Traditional image compression techniques often sacrifice image fidelity for reduced file sizes, challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Aryan Kashyap Naveen , Sunil Thunga , Anuhya Murki , Mahati A Kalale , Shriya Anil

Error-bounded lossy compression is one of the most efficient solutions to reduce the volume of scientific data. For lossy compression, progressive decompression and random-access decompression are critical features that enable on-demand…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Daoce Wang , Pascal Grosset , Jesus Pulido , Jiannan Tian , Tushar M. Athawale , Jinda Jia , Baixi Sun , Boyuan Zhang , Sian Jin , Kai Zhao , James Ahrens , Fengguang Song

An autoencoder is a self-supervised machine-learning network trained to output a quantity identical to the input. Owing to its structure possessing a bottleneck with a lower dimension, an autoencoder works to achieve data compression,…

Fluid Dynamics · Physics 2025-07-02 Koji Fukagata , Kai Fukami

Electron and scanning probe microscopy produce vast amounts of data in the form of images or hyperspectral data, such as EELS or 4D STEM, that contain information on a wide range of structural, physical, and chemical properties of…

Machine Learning · Computer Science 2023-06-09 Arpan Biswas , Maxim Ziatdinov , Sergei V. Kalinin

We present a data compression and dimensionality reduction scheme for data fusion and aggregation applications to prevent data congestion and reduce energy consumption at network connecting points such as cluster heads and gateways. Our…

Networking and Internet Architecture · Computer Science 2014-08-14 Mohammad Abu Alsheikh , Puay Kai Poh , Shaowei Lin , Hwee-Pink Tan , Dusit Niyato

Topological descriptors such as contour trees are widely utilized in scientific data analysis and visualization, with applications from materials science to climate simulations. It is desirable to preserve topological descriptors when data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-13 Nathaniel Gorski , Xin Liang , Hanqi Guo , Lin Yan , Bei Wang

Rapidly increasing data sizes in scientific computing are the driving force behind the need for lossy compression. The main drawback of lossy data compression is the introduction of error. This paper explains why many error-bounded…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-23 Alex Fallin , Martin Burtscher

Compression of floating-point data will play an important role in high-performance computing as data bandwidth and storage become dominant costs. Lossy compression of floating-point data is powerful, but theoretical results are needed to…

Numerical Analysis · Mathematics 2024-07-03 James Diffenderfer , Alyson Fox , Jeffrey Hittinger , Geoffrey Sanders , Peter Lindstrom

For effective human-robot teaming, it is important for the robots to be able to share their visual perception with the human operators. In a harsh remote collaboration setting, data compression techniques such as autoencoder can be utilized…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Hyeonwoo Yu , Jean Oh

Research in the past years introduced Steered Mixture-of-Experts (SMoE) as a framework to form sparse, edge-aware models for 2D- and higher dimensional pixel data, applicable to compression, denoising, and beyond, and capable to compete…

Image and Video Processing · Electrical Eng. & Systems 2023-05-08 Elvira Fleig , Erik Bochinski , Thomas Sikora

Lossy compression algorithms aim to compactly encode images in a way which enables to restore them with minimal error. We show that a key limitation of existing algorithms is that they rely on error measures that are extremely sensitive to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Tamar Rott Shaham , Tomer Michaeli

PDE-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes that are required to accurately compute the PDE solution introduce an enormous number of…

Numerical Analysis · Mathematics 2023-04-12 Jonathan Wittmer , Jacob Badger , Hari Sundar , Tan Bui-Thanh

This paper proposes an autoencoder (AE) that is used for improving the performance of once-class classifiers for the purpose of detecting anomalies. Traditional one-class classifiers (OCCs) perform poorly under certain conditions such as…

Machine Learning · Computer Science 2020-01-01 Kasra Babaei , ZhiYuan Chen , Tomas Maul

Quantum autoencoder is an efficient variational quantum algorithm for quantum data compression. However, previous quantum autoencoders fail to compress and recover high-rank mixed states. In this work, we discuss the fundamental properties…

Quantum Physics · Physics 2021-05-07 Chenfeng Cao , Xin Wang

Autoencoders are composed of coding and decoding units, hence they hold the inherent potential of high-performance data compression and signal compressed sensing. The main disadvantages of current autoencoders comprise the following several…

Machine Learning · Computer Science 2022-07-28 Honggui Li , Dimitri Galayko , Maria Trocan , Mohamad Sawan