English
Related papers

Related papers: Spatiotemporally adaptive compression for scientif…

200 papers

An increasing bottleneck in decentralized optimization is communication. Bigger models and growing datasets mean that decentralization of computation is important and that the amount of information exchanged is quickly growing. While…

Machine Learning · Computer Science 2021-08-19 Tharindu B. Adikari , Stark C. Draper

Recent research has shown that performance in signal processing tasks can often be significantly improved by using signal models based on sparse representations, where a signal is approximated using a small number of elements from a fixed…

Optimization and Control · Mathematics 2011-11-18 Adam S. Charles , Pierre Garrigues , Christopher J. Rozell

New directions in computing and algorithms has lead to some new applications that have tolerance to imprecision. Although, These applications are creating large volumes of data which exceeds the capability of today's computing systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-16 Navid Mirnouri

Effective management of environmental resources and agricultural sustainability heavily depends on accurate soil moisture data. However, datasets like the SMAP/Sentinel-1 soil moisture product often contain missing values across their…

Machine Learning · Computer Science 2023-12-05 Kehui Yao , Jingyi Huang , Jun Zhu

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, through increased stations in the array and frequency span. Two primary problems encountered when processing the resultant…

Instrumentation and Methods for Astrophysics · Physics 2025-07-30 Richard Dodson , Alex Williamson , Qian Gong , Pascal Elahi , Andreas Wicenec , Maria J. Rioja , Jieyang Chen , Norbert Podhorszki , Scott Klasky , Martin Meyer

Four-dimensional scanning transmission electron microscopy (4D-STEM) generates multi-gigabyte datasets, creating a growing mismatch between acquisition rates and practical storage, transfer, and interactive visualization capabilities. We…

Signal Processing · Electrical Eng. & Systems 2026-04-09 Ondrej Dyck , Andrew R. Lupini , Albina Borisevich , Miaofang Chi , Rama K. Vasudevan , Stephen Jesse

We present a new method to obtain spatio-temporal information from aggregated data of stationary traffic detectors, the ``adaptive smoothing method''. In essential, a nonlinear spatio-temporal lowpass filter is applied to the input detector…

Statistical Mechanics · Physics 2007-05-23 Martin Treiber , Dirk Helbing

The use of video-imaging data for in-line process monitoring applications has become more and more popular in the industry. In this framework, spatio-temporal statistical process monitoring methods are needed to capture the relevant…

Applications · Statistics 2020-04-24 Hao Yan , Marco Grasso , Kamran Paynabar , Bianca Maria Colosimo

We propose a framework for discrete scientific data compression based on the tensor-train (TT) decomposition. Our approach is tailored to handle unstructured output data from discrete element method (DEM) simulations, demonstrating its…

Numerical Analysis · Mathematics 2022-10-18 Saibal De , Eduardo Corona , Paramsothy Jayakumar , Shravan Veerapaneni

The construction of highly coherent x-ray sources has enabled new research opportunities across the scientific landscape. The maximum raw data rate per beamline now exceeds 40 GB/s, posing unprecedented challenges for the online processing…

An algorithmic limit of compressed sensing or related variable-selection problems is analytically evaluated when a design matrix is given by an overcomplete random matrix. The replica method from statistical mechanics is employed to derive…

Disordered Systems and Neural Networks · Physics 2018-11-14 Tomoyuki Obuchi , Yoshinori Nakanishi-Ohno , Masato Okada , Yoshiyuki Kabashima

History matching based on monitoring data will enable uncertainty reduction, and thus improved aquifer management, in industrial-scale carbon storage operations. In traditional model-based data assimilation, geomodel parameters are modified…

Machine Learning · Computer Science 2023-10-06 Su Jiang , Louis J. Durlofsky

Large biological datasets are being produced at a rapid pace and create substantial storage challenges, particularly in the domain of high-throughput sequencing (HTS). Most approaches currently used to store HTS data are either unable to…

Quantitative Methods · Quantitative Biology 2014-03-05 Fabien Campagne , Kevin C. Dorff , Nyasha Chambwe , James T. Robinson , Jill P. Mesirov , Thomas D. Wu

This paper investigates trajectory prediction for robotics, to improve the interaction of robots with moving targets, such as catching a bouncing ball. Unexpected, highly-non-linear trajectories cannot easily be predicted with…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Marco Monforte , Ander Arriandiaga , Arren Glover , Chiara Bartolozzi

We study the compressive diffusion strategies over distributed networks based on the diffusion implementation and adaptive extraction of the information from the compressed diffusion data. We demonstrate that one can achieve a comparable…

Systems and Control · Computer Science 2015-06-18 Muhammed O. Sayin , Suleyman S. Kozat

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Numerous renowned algorithms for tackling the compressed sensing problem…

Information Theory · Computer Science 2026-03-11 Xu Zhu , Yufei Ma , Xiaoguang Li , Tiejun Li

Motivated by specific data and accuracy requirements for building numerical databases of turbulent flows, data compression using spatio-temporal sub-sampling and local re-simulation is proposed. Numerical re-simulation experiments for…

Fluid Dynamics · Physics 2020-07-01 Zhao Wu , Tamer A. Zaki , Charles Meneveau

The spatio-temporal relations of impacts of extreme events and their drivers in climate data are not fully understood and there is a need of machine learning approaches to identify such spatio-temporal relations from data. The task,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Mohamad Hakam Shams Eddin , Juergen Gall

This paper investigates the problem of recovering the support of structured signals via adaptive compressive sensing. We examine several classes of structured support sets, and characterize the fundamental limits of accurately recovering…

Statistics Theory · Mathematics 2016-09-05 Rui M. Castro , Ervin Tánczos

The rich spatio-temporal information is crucial to capture the complicated target appearance variations in visual tracking. However, most top-performing tracking algorithms rely on many hand-crafted components for spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Jinxia Xie , Bineng Zhong , Zhiyi Mo , Shengping Zhang , Liangtao Shi , Shuxiang Song , Rongrong Ji