English
Related papers

Related papers: Polynomial data compression for large-scale physic…

200 papers

The Cherenkov Telescope Array is the future of ground-based gamma-ray astronomy. Its first prototype telescope built on-site, the Large Size Telescope 1, is currently under commissioning and taking its first scientific data. In this paper,…

Instrumentation and Methods for Astrophysics · Physics 2022-03-10 Mikaël Jacquemont , Thomas Vuillaume , Alexandre Benoit , Gilles Maurin , Patrick Lambert , Giovanni Lamanna

The upcoming Cherenkov Telescope Array (CTA) project is expected to provide unprecedented sensitivity in the low-energy ( <~100 GeV) range for Cherenkov telescopes. In order to exploit fully the potential of the telescopes the standard…

Instrumentation and Methods for Astrophysics · Physics 2019-08-14 Julian Sitarek , Dorota Sobczyńska , Michał Szanecki , Katarzyna Adamczyk

We revisit the popular \emph{delayed deterministic finite automaton} (\ddfa{}) compression algorithm introduced by Kumar~et~al.~[SIGCOMM 2006] for compressing deterministic finite automata (DFAs) used in intrusion detection systems. This…

Data Structures and Algorithms · Computer Science 2024-11-26 Philip Bille , Inge Li Gørtz , Max Rishøj Pedersen

The Cherenkov Telescope Array (CTA) is the next generation observatory for the study of very high-energy gamma rays from about 20 GeV up to 300 TeV. Thanks to the large effective area and field of view, the CTA observatory will be…

Instrumentation and Methods for Astrophysics · Physics 2019-08-14 Andrea Zoli , Andrea Bulgarelli , Adriano De Rosa , Alessio Aboudan , Valentina Fioretti , Giovanni De Cesare , Ramin Marx

Tensors provide a robust framework for managing high-dimensional data. Consequently, tensor analysis has emerged as an active research area in various domains, including machine learning, signal processing, computer vision, graph analysis,…

Computation · Statistics 2025-10-01 Michele Gallo

Due to the substantial scale of Large Language Models (LLMs), the direct application of conventional compression methodologies proves impractical. The computational demands associated with even minimal gradient updates present challenges,…

Machine Learning · Computer Science 2023-12-13 Arnav Chavan , Nahush Lele , Deepak Gupta

We provide a new quantum algorithm that efficiently determines the quality of a least-squares fit over an exponentially large data set by building upon an algorithm for solving systems of linear equations efficiently (Harrow et al., Phys.…

Quantum Physics · Physics 2013-01-10 Nathan Wiebe , Daniel Braun , Seth Lloyd

In many ultrasonic imaging systems, data acquisition and image formation are performed on separate computing devices. Data transmission is becoming a bottleneck, thus, efficient data compression is essential. Compression rates can be…

Image and Video Processing · Electrical Eng. & Systems 2021-09-02 Georgios Pilikos , Lars Horchens , Kees Joost Batenburg , Tristan van Leeuwen , Felix Lucka

Traditional image and video compression algorithms rely on hand-crafted encoder/decoder pairs (codecs) that lack adaptability and are agnostic to the data being compressed. Here we describe the concept of generative compression, the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Shibani Santurkar , David Budden , Nir Shavit

Microarray technology is a new and powerful tool for the concurrent monitoring of a large number of gene expressions. Each microarray experiment produces hundreds of images. Each digital image requires a large storage space. Hence,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Anahita Banaei , Shadrokh Samavi , Ebrahim Nasr Esfahani

Matrices are exceptionally useful in various fields of study as they provide a convenient framework to organize and manipulate data in a structured manner. However, modern matrices can involve billions of elements, making their storage and…

Machine Learning · Computer Science 2023-10-18 Rajarshi Saha , Varun Srivastava , Mert Pilanci

The paper introduces a new technique for compressing Binary Decision Diagrams in those cases where random access is not required. Using this technique, compression and decompression can be done in linear time in the size of the BDD and…

Artificial Intelligence · Computer Science 2008-12-18 Esben Rune Hansen , S. Srinivasa Rao , Peter Tiedemann

For many modern applications in science and engineering, data are collected in a streaming fashion carrying time-varying information, and practitioners need to process them with a limited amount of memory and computational resources in a…

Machine Learning · Statistics 2018-06-13 Laura Balzano , Yuejie Chi , Yue M. Lu

The Square Kilometre Array (SKA) will form the largest radio telescope ever built and such a huge instrument in the desert poses enormous engineering and logistic challenges. Algorithmic and architectural breakthroughs are needed. Data is…

Instrumentation and Methods for Astrophysics · Physics 2014-11-17 Orhan Ocal , Paul Hurley , Giovanni Cherubini , Sanaz Kazemi

Next generation radio interferometric telescopes are entering an era of big data with extremely large data sets. While these telescopes can observe the sky in higher sensitivity and resolution than before, computational challenges in image…

Instrumentation and Methods for Astrophysics · Physics 2019-12-17 Luke Pratley , Jason D. McEwen , Mayeul d'Avezac , Xiaohao Cai , David Perez-Suarez , Ilektra Christidi , Roland Guichard

Assessing whether two datasets are distributionally consistent is central to modern scientific analysis, particularly as generative artificial intelligence produces synthetic data whose fidelity must be validated against real observations…

Information Theory · Computer Science 2026-03-24 Cristiano Fanelli

High energy gamma-ray astronomy is a newly emerging and very successful branch of astronomy and astrophysics. Exciting results have been obtained by the current generation Cherenkov telescope systems such as H.E.S.S., MAGIC, VERITAS and…

Astrophysics · Physics 2019-08-14 G. Hermann , W. Hofmann , T. Schweizer , M. Teshima

We develop a lensless compressive imaging architecture, which consists of an aperture assembly and a single sensor, without using any lens. An anytime algorithm is proposed to reconstruct images from the compressive measurements; the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-17 Xin Yuan , Hong Jiang , Gang Huang , Paul Wilford

We present a data compression and dimensionality reduction scheme for data fusion and aggregation applications to prevent data congestion and reduce energy consumption at network connecting points such as cluster heads and gateways. Our…

Networking and Internet Architecture · Computer Science 2014-08-14 Mohammad Abu Alsheikh , Puay Kai Poh , Shaowei Lin , Hwee-Pink Tan , Dusit Niyato

For the successful development of the astrophysics and, accordingly, for obtaining more complete knowledge of the Universe, it is extremely important to combine and comprehensively analyze information of various types (e.g., about charged…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-16 Alexander Kryukov , Andrey Demichev