English
Related papers

Related papers: Study on the Real-time Lossless Data Compression M…

200 papers

Liquid argon time projection chambers (LArTPCs) have been proposed as neutrino detectors that combine both large sizes to maximize the number of neutrino interactions and detailed recording of the interaction. The readout of thousands of…

Instrumentation and Detectors · Physics 2021-02-12 J. I. Crespo-Anadón

In view of a possible application as a charge-particle track readout for an Active-Target Time Projection Chamber (AT-TPC), the operational properties and performances of a hybrid Micro-Pattern Gaseous Detector (MPGD) were investigated in…

Instrumentation and Detectors · Physics 2015-12-23 Marco Cortesi , Wolfgang Mittig , Daniel Bazin , Saul Beceiro-Novo , John Yurkon , Rim Soussi Tanani , Michael Wolff , Andreas Stolz

Lightweight Temporal Compression (LTC) is among the lossy stream compression methods that provide the highest compression rate for the lowest CPU and memory consumption. As such, it is well suited to compress data streams in…

Information Theory · Computer Science 2018-11-27 Bo Li , Omid Sarbishei , Hosein Nourani , Tristan Glatard

Compression is a crucial solution for data reduction in modern scientific applications due to the exponential growth of data from simulations, experiments, and observations. Compression with progressive retrieval capability allows users to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Zhuoxun Yang , Sheng Di , Longtao Zhang , Ruoyu Li , Ximiao Li , Jiajun Huang , Jinyang Liu , Franck Cappello , Kai Zhao

Modern smart distribution system requires storage, transmission and processing of big data generated by sensors installed in electric meters. On one hand, this data is essentially required for intelligent decision making by smart grid but…

Signal Processing · Electrical Eng. & Systems 2018-07-19 Syed Muhammad Atif , Anees Ahmed , Sameer Qazi

Smart Grids measure energy usage in real-time and tailor supply and delivery accordingly, in order to improve power transmission and distribution. For the grids to operate effectively, it is critical to collect readings from…

Information Theory · Computer Science 2012-02-24 Sheng Cai , Jihang Ye , Minghua Chen , Jianxin Yan , Sidharth Jaggi

Gas leakage poses a significant hazard that requires prevention. Traditionally, human inspection has been used for detection, a slow and labour-intensive process. Recent research has applied machine learning techniques to this problem, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Wenqi Guo , Yiyang Du , Shan Du

Machine-generated data is rapidly growing and poses challenges for data-intensive systems, especially as the growth of data outpaces the growth of storage space. To cope with the storage issue, compression plays a critical role in storage…

Databases · Computer Science 2023-11-27 Jiujing Zhang , Zhitao Shen , Shiyu Yang , Lingkai Meng , Chuan Xiao , Wei Jia , Yue Li , Qinhui Sun , Wenjie Zhang , Xuemin Lin

In scientific simulations, observations, and experiments, the cost of transferring data to and from disk and across networks has become a significant bottleneck that particularly impacts subsequent data analysis and visualization. To…

Databases · Computer Science 2023-08-24 Victor A. P. Magri , Peter Lindstrom

We consider a monitoring application where sensors periodically report data to a common receiver in a time division multiplex fashion. The sensors are constrained by the limited and unpredictable energy availability provided by Energy…

Information Theory · Computer Science 2017-06-29 Chiara Pielli , Cedomir Stefanovic , Petar Popovski , Michele Zorzi

MicroPattern Gaseous Detectors (MPGD) made of resistive strips have raised as a promising technology for the protection against spark processes having place in the gaseous chamber. The reproduction of the signals and its propagation through…

Instrumentation and Detectors · Physics 2015-06-03 J. Galan

Data compression has been widely applied in many data processing areas. Compression methods use variable-size codes with the shorter codes assigned to symbols or groups of symbols that appear in the data frequently. Fibonacci coding, as a…

Performance · Computer Science 2007-12-19 R. Baca , V. Snasel , J. Platos , M. Kratky , E. El-Qawasmeh

Compressed sensing is a signal processing method that acquires data directly in a compressed form. This allows one to make less measurements than what was considered necessary to record a signal, enabling faster or more precise measurement…

Statistical Mechanics · Physics 2012-08-20 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

Learning and Artificial Intelligence (ML/AI) techniques have become increasingly prevalent in high performance computing (HPC). However, these methods depend on vast volumes of floating point data for training and validation which need…

Machine Learning · Computer Science 2024-03-26 Robert Underwood , Jon C. Calhoun , Sheng Di , Franck Cappello

Micro-Pattern Gaseous Detectors (MPGDs) with resistive anode planes provide intrinsic discharge robustness while maintaining good spatial and time resolutions. Typically read out with 1D strips or pad structures, here the characterisation…

Particle-based simulations and point-cloud applications generate massive, irregular datasets that challenge storage, I/O, and real-time analytics. Traditional compression techniques struggle with irregular particle distributions and GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Ruoyu Li , Yafan Huang , Longtao Zhang , Zhuoxun Yang , Sheng Di , Jiajun Huang , Jinyang Liu , Jiannan Tian , Xin Liang , Guanpeng Li , Hanqi Guo , Franck Cappello , Kai Zhao

Bringing a high-dimensional dataset into science-ready shape is a formidable challenge that often necessitates data compression. Compression has accordingly become a key consideration for contemporary cosmology, affecting public data…

Cosmology and Nongalactic Astrophysics · Physics 2020-08-25 Alan Heavens , Elena Sellentin , Andrew Jaffe

Data management is becoming increasingly important in dealing with the large amounts of data produced by large-scale scientific simulations and instruments. Existing multilevel compression algorithms offer a promising way to manage…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-12 Xin Liang , Ben Whitney , Jieyang Chen , Lipeng Wan , Qing Liu , Dingwen Tao , James Kress , Dave Pugmire , Matthew Wolf , Norbert Podhorszki , Scott Klasky

Data compaction is a new approach for lossless and lossy compression of read-only array data. The biggest advantage over existing approaches is the possibility to access compressed data without any decompression. This makes data compaction…

Data Structures and Algorithms · Computer Science 2014-02-12 Steffen Görzig

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…