English
Related papers

Related papers: Massive Lossless Data Compression and Multiple Par…

200 papers

The rapid expansion in the size of new datasets has created a need for fast and efficient parameter-learning techniques. Compressive learning is a framework that enables efficient processing by using random, non-linear features to project…

Machine Learning · Computer Science 2025-08-18 Daniel Mas Montserrat , David Bonet , Maria Perera , Xavier Giró-i-Nieto , Alexander G. Ioannidis

Understanding how galaxies trace the underlying matter density field is essential for characterizing the influence of the large-scale structure on galaxy formation, being therefore a key ingredient in observational cosmology. This…

We present herein a scheme by which to accurately evaluate the error exponents of a lossy data compression problem, which characterize average probabilities over a code ensemble of compression failure and success above or below a critical…

Statistical Mechanics · Physics 2007-05-23 Tadaaki Hosaka , Yoshiyuki Kabashima

The implementation of modern monitoring systems for power quality disturbances have the potential to generate substantial amounts of data, reaching a point where transmission and storage of high-frequency measurements become impractical.…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Markus Stroot , Stefan Seiler , Philipp Lutat , Andreas Ulbig

A stationary stochastic geometric model is proposed for analyzing the data compression method used in one-bit compressed sensing. The data set is an unconstrained stationary set, for instance all of $\mathbb{R}^n$ or a stationary Poisson…

Probability · Mathematics 2018-10-16 François Baccelli , Eliza O'Reilly

Scalable spatial GPs for massive datasets can be built via sparse Directed Acyclic Graphs (DAGs) where a small number of directed edges is sufficient to flexibly characterize spatial dependence. The DAG can be used to devise fast algorithms…

Methodology · Statistics 2025-03-31 Michele Peruzzi , Sudipto Banerjee , David B. Dunson , Andrew O. Finley

Lossy compressors are increasingly adopted in scientific research, tackling volumes of data from experiments or parallel numerical simulations and facilitating data storage and movement. In contrast with the notion of entropy in lossless…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-16 Robert Underwood , Julie Bessac , David Krasowska , Jon C. Calhoun , Sheng Di , Franck Cappello

The concept of dissipativity, as introduced by Jan Willems, is one of the cornerstones of systems and control theory. Typically, dissipativity properties are verified by resorting to a mathematical model of the system under consideration.…

Optimization and Control · Mathematics 2021-09-07 Henk J. van Waarde , M. Kanat Camlibel , Paolo Rapisarda , Harry L. Trentelman

We study the problem of signal estimation from non-linear observations when the signal belongs to a low-dimensional set buried in a high-dimensional space. A rough heuristic often used in practice postulates that non-linear observations may…

Information Theory · Computer Science 2015-11-17 Yaniv Plan , Roman Vershynin

Learning and compression are driven by the common aim of identifying and exploiting statistical regularities in data, which opens the door for fertile collaboration between these areas. A promising group of compression techniques for…

Machine Learning · Computer Science 2021-02-02 Fernando E. Rosas , Pedro A. M. Mediano , Michael Gastpar

Analyses of peculiar velocity surveys face several challenges, including low signal--to--noise in individual velocity measurements and the presence of small--scale, nonlinear flows. This is the second in a series of papers in which we…

Astrophysics · Physics 2009-11-07 Hume A. Feldman , Richard Watkins , Adrian L. Melott , Scott W. Chambers

Time series data from a variety of sensors and IoT devices need effective compression to reduce storage and I/O bandwidth requirements. While most time series databases and systems rely on lossless compression, lossy techniques offer even…

Databases · Computer Science 2025-01-27 Carlos Enrique Muñiz-Cuza , Matthias Boehm , Torben Bach Pedersen

We present a robust framework to perform linear regression with missing entries in the features. By considering an elliptical data distribution, and specifically a multivariate normal model, we are able to conditionally formulate a…

Machine Learning · Computer Science 2022-11-10 Alireza Aghasi , MohammadJavad Feizollahi , Saeed Ghadimi

This paper proposes a deep learning framework to design distributed compression strategies in which distributed agents need to compress high-dimensional observations of a source, then send the compressed bits via bandwidth limited links to…

Information Theory · Computer Science 2022-03-10 Foad Sohrabi , Tao Jiang , Wei Yu

Achieving high accuracy and precision in stellar parameter and chemical composition determinations is challenging in massive star spectroscopy. On one hand, the target selection for an unbiased sample build-up is complicated by several…

Solar and Stellar Astrophysics · Physics 2017-11-15 Maria-Fernanda Nieva , Norbert Przybilla

We investigate how observations of strong lensing can be used to infer cosmological parameters, in particular the equation of state of dark energy. We focus on the growth of the critical lines of lensing clusters with the source redshift as…

Cosmology and Nongalactic Astrophysics · Physics 2012-04-03 Britta Zieser , Matthias Bartelmann

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, through increased stations in the array and frequency span. Two primary problems encountered when processing the resultant…

Instrumentation and Methods for Astrophysics · Physics 2025-07-30 Richard Dodson , Alex Williamson , Qian Gong , Pascal Elahi , Andreas Wicenec , Maria J. Rioja , Jieyang Chen , Norbert Podhorszki , Scott Klasky , Martin Meyer

We consider regression models involving multilayer perceptrons (MLP) with one hidden layer and a Gaussian noise. The estimation of the parameters of the MLP can be done by maximizing the likelihood of the model. In this framework, it is…

Statistics Theory · Mathematics 2008-02-25 Joseph Rynkiewicz

Randomized smoothing is a recent technique that achieves state-of-art performance in training certifiably robust deep neural networks. While the smoothing family of distributions is often connected to the choice of the norm used for…

Machine Learning · Computer Science 2022-07-06 Motasem Alfarra , Adel Bibi , Philip H. S. Torr , Bernard Ghanem

We present a machine unlearning approach that is both retraining- and label-free. Most existing machine unlearning approaches require a model to be fine-tuned to remove information while preserving performance. This is computationally…

Machine Learning · Computer Science 2024-03-01 Jack Foster , Stefan Schoepf , Alexandra Brintrup