English
Related papers

Related papers: Using data-compressors for statistical analysis of…

200 papers

The development of modern information technologies permits to collect and to analyze huge amounts of statistical data in different spheres of life. The main problem is not to only to collect but to process all relevant information. The…

Information Retrieval · Computer Science 2010-07-08 O. Mryglod , Yu. Holovatch

We show that Kolmogorov complexity and such its estimators as universal codes (or data compression methods) can be applied for hypotheses testing in a framework of classical mathematical statistics. The methods for identity testing and…

Computational Complexity · Computer Science 2007-05-23 Boris Ryabko , Jaakko Astola , Alex Gammerman

Topological data analysis has emerged as a powerful tool for extracting the metric, geometric and topological features underlying the data as a multi-resolution summary statistic, and has found applications in several areas where data…

Probability · Mathematics 2024-02-16 Siddharth Vishwanath , Kenji Fukumizu , Satoshi Kuriki , Bharath Sriperumbudur

Large-scale data analysis poses both statistical and computational problems which need to be addressed simultaneously. A solution is often straightforward if the data are homogeneous: one can use classical ideas of subsampling and mean…

Methodology · Statistics 2014-09-10 Peter Bühlmann , Nicolai Meinshausen

With web and mobile platforms becoming more prominent devices utilized in data analysis, there are currently few systems which are not without flaw. In order to increase the performance of these systems and decrease errors of data…

Databases · Computer Science 2022-05-03 Daniel Szelogowski

Large-sample data became prevalent as data acquisition became cheaper and easier. While a large sample size has theoretical advantages for many statistical methods, it presents computational challenges. Sketching, or compression, is a…

Machine Learning · Statistics 2020-05-11 Alexander F. Lapanowski , Irina Gaynanova

Can machine learning help discover new mathematical structures? In this article we discuss an approach to doing this which one can call "mathematical data science". In this paradigm, one studies mathematical objects collectively rather than…

History and Overview · Mathematics 2025-02-14 Michael R. Douglas , Kyu-Hwan Lee

Computational topology has recently known an important development toward data analysis, giving birth to the field of topological data analysis. Topological persistence, or persistent homology, appears as a fundamental tool in this field.…

Statistics Theory · Mathematics 2013-05-28 Frédéric Chazal , Marc Glisse , Catherine Labruère , Bertrand Michel

The physics of complex systems stands to greatly benefit from the qualitative changes in data availability and advances in data-driven computational methods. Many of these systems can be represented by interacting degrees of freedom on…

Statistical Mechanics · Physics 2024-11-27 Doruk Efe Gökmen , Sounak Biswas , Sebastian D. Huber , Zohar Ringel , Felix Flicker , Maciej Koch-Janusz

We show how binary classification methods developed to work on i.i.d. data can be used for solving statistical problems that are seemingly unrelated to classification and concern highly-dependent time series. Specifically, the problems of…

Machine Learning · Computer Science 2013-06-10 Daniil Ryabko , Jérémie Mary

Many applications from camera arrays to sensor networks require efficient compression and processing of correlated data, which in general is collected in a distributed fashion. While information-theoretic foundations of distributed…

Information Theory · Computer Science 2024-02-14 Ezgi Ozyilkan , Elza Erkip

Robust classification algorithms have been developed in recent years with great success. We take advantage of this development and recast the classical two-sample test problem in the framework of classification. Based on the estimates of…

Statistics Theory · Mathematics 2019-09-18 Haiyan Cai , Bryan Goggin , Qingtang Jiang

In this work we introduce declarative statistics, a suite of declarative modelling tools for statistical analysis. Statistical constraints represent the key building block of declarative statistics. First, we introduce a range of relevant…

Artificial Intelligence · Computer Science 2017-12-29 Roberto Rossi , Özgür Akgün , Steven Prestwich , S. Armagan Tarim

This survey provides an overview of common applications, both implicit and explicit, of "tensors" and "tensor products" in the fields of data science and statistics. One goal is to reconcile seemingly distinct usages of the term "tensor" in…

Applications · Statistics 2022-10-31 William Krinsman

We formulate conditions for convergence of Laws of Large Numbers and show its links with of the parts of mathematical analysis such as summation theory, convergence of orthogonal series. We present also applications of the Law of Large…

Probability · Mathematics 2018-09-07 Paweł J. Szabłowski

The task of compression of data -- as stated by the source coding theorem -- is one of the cornerstones of information theory. Data compression usually exploits statistical redundancies in the data according to its prior distribution.…

Quantum Physics · Physics 2021-01-08 Matheus Capela , Fabio Costa

We survey some results that provide different versions of classical results through different summability methods. Specifically, in order to adapt such classical results, we analyze which properties should satisfy the summability methods.…

This survey articles focuses on emerging connections between the fields of machine learning and data compression. While fundamental limits of classical (lossy) data compression are established using rate-distortion theory, the connections…

Information Theory · Computer Science 2024-06-17 Jun Chen , Yong Fang , Ashish Khisti , Ayfer Ozgur , Nir Shlezinger , Chao Tian

Compression of integer sets and sequences has been extensively studied for settings where elements follow a uniform probability distribution. In addition, methods exist that exploit clustering of elements in order to achieve higher…

Information Theory · Computer Science 2014-02-11 N. Jesper Larsson

Topological data analysis refers to approaches for systematically and reliably computing abstract ``shapes'' of complex data sets. There are various applications of topological data analysis in life and data sciences, with growing interest…

Mesoscale and Nanoscale Physics · Physics 2023-07-26 Daniel Leykam , Dimitris G. Angelakis