English
Related papers

Related papers: Error bounded compression for weather and climate …

200 papers

In communication and storage systems, error correction codes (ECCs) are pivotal in ensuring data reliability. As deep learning's applicability has broadened across diverse domains, there is a growing research focus on neural network-based…

Machine Learning · Computer Science 2023-08-28 Seong-Joon Park , Hee-Youl Kwak , Sang-Hyo Kim , Sunghwan Kim , Yongjune Kim , Jong-Seon No

Error-bounded lossy compression is becoming more and more important to today's extreme-scale HPC applications because of the ever-increasing volume of data generated because it has been widely used in in-situ visualization, data stream…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Baodi Shan , Aabid Shamji , Jiannan Tian , Guanpeng Li , Dingwen Tao

This paper presents a wireless neural recording system featuring energy-efficient data compression and encryption. An ultra-high efficiency is achieved by leveraging compressed sensing (CS) for simultaneous data compression and encryption.…

Signal Processing · Electrical Eng. & Systems 2021-03-02 Xilin Liu , Andrew G. Richardson , Jan Van der Spiegel

The latent representation in learned image compression encompasses channel-wise, local spatial, and global spatial correlations, which are essential for the entropy model to capture for conditional entropy minimization. Efficiently…

Image and Video Processing · Electrical Eng. & Systems 2025-10-29 Wei Jiang , Jiayu Yang , Yongqi Zhai , Feng Gao , Ronggang Wang

Recently, learned image compression has attracted considerable attention due to its superior performance over traditional methods. However, most existing approaches employ a single entropy model to estimate the probability distribution of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Chunhang Zheng , Zichang Ren , Dou Li

Recent works on learned image compression perform encoding and decoding processes in a full-resolution manner, resulting in two problems when deployed for practical applications. First, parallel acceleration of the autoregressive entropy…

Image and Video Processing · Electrical Eng. & Systems 2021-10-12 Yaojun Wu , Xin Li , Zhizheng Zhang , Xin Jin , Zhibo Chen

The growing resolution and volume of climate data from remote sensing and simulations pose significant storage, processing, and computational challenges. Traditional compression or subsampling methods often compromise data fidelity,…

Atmospheric and Oceanic Physics · Physics 2025-07-22 Aashish Panta , Amy Gooch , Giorgio Scorzelli , Michela Taufer , Valerio Pascucci

The expanding instrumentation of processes throughout society with sensors yields a proliferation of time series data that may in turn enable important applications, e.g., related to transportation infrastructures or power grids.…

Databases · Computer Science 2024-10-29 Hao Miao , Ziqiao Liu , Yan Zhao , Chenjuan Guo , Bin Yang , Kai Zheng , Christian S. Jensen

The availability of reliable, high-resolution climate and weather data is important to inform long-term decisions on climate adaptation and mitigation and to guide rapid responses to extreme events. Forecasting models are limited by…

When applying integrated sensing and communications (ISAC) in future mobile networks, many sensing tasks have low latency requirements, preferably being implemented at terminals. However, terminals often have limited computing capabilities…

Signal Processing · Electrical Eng. & Systems 2024-08-29 Peng Liu , Zesong Fei , Xinyi Wang , Jingxuan Huang , Jie Hu , J. Andrew Zhang

Communication efficiency is a central challenge in distributed machine learning training, and message compression is a widely used solution. However, standard Error Feedback (EF) methods (Seide et al., 2014), though effective for smooth…

Optimization and Control · Mathematics 2025-10-07 Yuan Gao , Anton Rodomanov , Jeremy Rack , Sebastian Stich

Electroencephalogram (EEG) data compression is necessary for wireless recording applications to reduce the amount of data that needs to be transmitted. In this paper, an asymmetrical sparse autoencoder with a discrete cosine transform (DCT)…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Xin Zhu , Hongyi Pan , Shuaiang Rong , Ahmet Enis Cetin

The paper studies the problem of recovering a spectrally sparse object from a small number of time domain samples. Specifically, the object of interest with ambient dimension $n$ is assumed to be a mixture of $r$ complex multi-dimensional…

Information Theory · Computer Science 2015-01-06 Yuxin Chen , Yuejie Chi

This paper presents a new algorithm for the lossy compression of scalar data defined on 2D or 3D regular grids, with topological control. Certain techniques allow users to control the pointwise error induced by the compression. However, in…

Image and Video Processing · Electrical Eng. & Systems 2018-02-09 Maxime Soler , Melanie Plainchault , Bruno Conche , Julien Tierny

Robust point cloud classification is crucial for real-world applications, as consumer-type 3D sensors often yield partial and noisy data, degraded by various artifacts. In this work we propose a general ensemble framework, based on partial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Meir Yossef Levi , Guy Gilboa

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…

This note presents a novel and efficient Economic Model Predictive Control (EMPC) scheme specifically designed for non-dissipative systems subject to state and input constraints. To address the stability challenge of EMPC for constrained…

Optimization and Control · Mathematics 2026-01-06 Defeng He , Weiliang Xiong , Shaoyuan Li , Haiping Du

Data required to calibrate uncertain GCM parameterizations are often only available in limited regions or time periods, for example, observational data from field campaigns, or data generated in local high-resolution simulations. This…

Applications · Statistics 2022-10-05 Oliver R. A. Dunbar , Michael F. Howland , Tapio Schneider , Andrew M. Stuart

Due to the rapidly changing climate, the frequency and severity of extreme weather is expected to increase over the coming decades. As fully-resolved climate simulations remain computationally intractable, policy makers must rely on…

Atmospheric and Oceanic Physics · Physics 2024-02-29 Benedikt Barthel Sorensen , Alexis Charalampopoulos , Shixuan Zhang , Bryce Harrop , Ruby Leung , Themistoklis Sapsis

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt