English
Related papers

Related papers: Distance Functions and Normalization Under Stream …

200 papers

Given an inverse problem with a normalizing flow prior, we wish to estimate the distribution of the underlying signal conditioned on the observations. We approach this problem as a task of conditional inference on the pre-trained…

Machine Learning · Statistics 2021-06-16 Jay Whang , Erik M. Lindgren , Alexandros G. Dimakis

Stream processing has become a critical component in the architecture of modern applications. With the exponential growth of data generation from sources such as the Internet of Things, business intelligence, and telecommunications,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-27 Dominik Scheinert , Fabian Casares , Morgan K. Geldenhuys , Kevin Styp-Rekowski , Odej Kao

Data depths are score functions that quantify in an unsupervised fashion how central is a point inside a distribution, with numerous applications such as anomaly detection, multivariate or functional data analysis, arising across various…

Machine Learning · Statistics 2025-07-14 Arturo Castellanos , Pavlo Mozharovskyi

An algorithm for sampling exactly from the normal distribution is given. The algorithm reads some number of uniformly distributed random digits in a given base and generates an initial portion of the representation of a normal deviate in…

Computational Physics · Physics 2016-02-01 Charles F. F. Karney

In training neural networks, batch normalization has many benefits, not all of them entirely understood. But it also has some drawbacks. Foremost is arguably memory consumption, as computing the batch statistics requires all instances…

Machine Learning · Computer Science 2024-07-26 Benjamin Berger , Victor Uc Cetina

Statistical relational learning techniques have been successfully applied in a wide range of relational domains. In most of these applications, the human designers capitalized on their background knowledge by following a trial-and-error…

Artificial Intelligence · Computer Science 2011-08-30 Lilyana Mihalkova , Walaa Eldin Moustafa

The signature of a path is an essential object in the theory of rough paths. The signature representation of the data stream can recover standard statistics, e.g. the moments of the data stream. The classification of random walks indicates…

Other Statistics · Statistics 2015-09-14 Hao Ni

The normalized information distance is a universal distance measure for objects of all kinds. It is based on Kolmogorov complexity and thus uncomputable, but there are ways to utilize it. First, compression algorithms can be used to…

Information Retrieval · Computer Science 2008-09-16 Paul M. B. Vitanyi , Frank J. Balbach , Rudi L. Cilibrasi , Ming Li

Imagine a smart camera trap selectively clicking pictures to understand animal movement patterns within a particular habitat. These "snapshots", or pieces of data captured from a data stream at adaptively chosen times, provide a glimpse of…

Machine Learning · Computer Science 2024-12-10 Pramith Devulapalli , Steve Hanneke

Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is…

Methodology · Statistics 2021-12-23 Neda Mohammadi , Victor M. Panaretos

We study the complexity of approximations to the normalized information distance. We introduce a hierarchy of computable approximations by considering the number of oscillations. This is a function version of the difference hierarchy for…

Logic · Mathematics 2019-11-15 Klaus Ambos-Spies , Wolfgang Merkle , Sebastiaan A. Terwijn

Quantitative evaluations of differences and/or similarities between data samples define and shape optimisation problems associated with learning data distributions. Current methods to compare data often suffer from limitations in capturing…

Machine Learning · Computer Science 2024-01-23 Deborah Pelacani Cruz , George Strong , Oscar Bates , Carlos Cueto , Jiashun Yao , Lluis Guasch

Systems biology relies on mathematical models that often involve complex and intractable likelihood functions, posing challenges for efficient inference and model selection. Generative models, such as normalizing flows, have shown…

Quantitative Methods · Quantitative Biology 2023-12-06 Vincent D. Zaballa , Elliot E. Hui

Sharing of telecommunication network data, for example, even at high aggregation levels, is nowadays highly restricted due to privacy legislation and regulations and other important ethical concerns. It leads to scattering data across…

Machine Learning · Computer Science 2022-05-18 Paula Raissa Silva , João Vinagre , João Gama

Understanding what is normal is a key aspect of protecting a domain. Other domains invest heavily in observational science to develop models of normal behavior to better detect anomalies. Recent advances in high performance graph libraries,…

Uncertain data streams have been widely generated in many Web applications. The uncertainty in data streams makes anomaly detection from sensor data streams far more challenging. In this paper, we present a novel framework that supports…

Artificial Intelligence · Computer Science 2016-07-21 Jiangang Ma , Le Sun , Hua Wang , Yanchun Zhang , Uwe Aickelin

An important problem in training deep networks with high capacity is to ensure that the trained network works well when presented with new inputs outside the training dataset. Dropout is an effective regularization technique to boost the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Mostafa Rahmani , George Atia

We propose exploiting symmetries (exact or approximate) of the Standard Model (SM) to search for physics Beyond the Standard Model (BSM) using the data-directed paradigm (DDP). Symmetries are very powerful because they provide two samples…

High Energy Physics - Phenomenology · Physics 2022-06-09 Mattias Birman , Benjamin Nachman , Raphael Sebbah , Gal Sela , Ophir Turetz , Shikma Bressler

We propose a streaming algorithm for the binary classification of data based on crowdsourcing. The algorithm learns the competence of each labeller by comparing her labels to those of other labellers on the same tasks and uses this…

Machine Learning · Statistics 2016-02-24 Thomas Bonald , Richard Combes

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii