English
Related papers

Related papers: Discussion of "Data fission: splitting a single da…

200 papers

Commonalities and differences in correlation analysis in terms of phase space, conditioning and uncorrelatedness are discussed. The Poisson process is not generally appropriate as reference distribution for normalisation and cumulants, so…

High Energy Physics - Experiment · Physics 2007-05-23 H. C. Eggers

This paper analyzes various distributed storage systems that use data fragmentation and dispersal as a way of protection.Existing solutions have been organized into two categories: bitwise and structurewise. Systems from the bitwise…

Cryptography and Security · Computer Science 2017-06-20 Katarzyna Kapusta , Gerard Memmi

Modern scientific computational methods are undergoing a transformative change; big data and statistical learning methods now have the potential to outperform the classical first-principles modeling paradigm. This book bridges this…

Data Analysis, Statistics and Probability · Physics 2018-03-22 John Harlim

Owing to its unparalleled tractability, the Poisson point process (PPP) has emerged as a popular model for the analysis of cellular networks. Considering a stationary point process of users, which is independent of the base station (BS)…

Information Theory · Computer Science 2019-08-29 Praful D. Mankar , Priyabrata Parida , Harpreet S. Dhillon , Martin Haenggi

Gorman and Bedrick (2019) argued for using random splits rather than standard splits in NLP experiments. We argue that random splits, like standard splits, lead to overly optimistic performance estimates. We can also split data in biased or…

Computation and Language · Computer Science 2021-04-27 Anders Søgaard , Sebastian Ebert , Jasmijn Bastings , Katja Filippova

Although machine learning is increasingly applied in control approaches, only few methods guarantee certifiable safety, which is necessary for real world applications. These approaches typically rely on well-understood learning algorithms,…

Machine Learning · Computer Science 2020-06-16 Armin Lederer , Markus Kessler , Sandra Hirche

We study a hypothesis testing problem in which data is compressed distributively and sent to a detector that seeks to decide between two possible distributions for the data. The aim is to characterize all achievable encoding rates and…

Information Theory · Computer Science 2011-02-01 Md. Saifur Rahman , Aaron B. Wagner

Partition-wise models offer a flexible approach for modeling complex and multidimensional data that are capable of producing interpretable results. They are based on partitioning the observed data into regions, each of which is modeled with…

Methodology · Statistics 2017-06-07 Rex C. Y. Cheung , Alexander Aue , Thomas C. M. Lee

In this paper we study the effect of the way that the data is partitioned in distributed optimization. The original DiSCO algorithm [Communication-Efficient Distributed Optimization of Self-Concordant Empirical Loss, Yuchen Zhang and Lin…

Optimization and Control · Mathematics 2015-10-23 Chenxin Ma , Martin Takáč

The Gaussian process is an indispensable tool for spatial data analysts. The onset of the "big data" era, however, has lead to the traditional Gaussian process being computationally infeasible for modern spatial data. As such, various…

Clustering functional data is a challenging task due to intrinsic infinite-dimensionality and the need for stable, data-adaptive partitioning. In this work, we propose a clustering framework based on Random Projections, which simultaneously…

Methodology · Statistics 2025-12-18 Matteo Mori , Laura Anderlucci

The univariate piecing-together approach (PT) fits a univariate generalized Pareto distribution (GPD) to the upper tail of a given distribution function in a continuous manner. We propose a multivariate extension. First it is shown that an…

Statistics Theory · Mathematics 2012-05-09 Stefan Aulbach , Verena Bayer , Michael Falk

This paper presents a new method to estimate systematic errors in the maximum-likelihood regression of count data. The method is applicable in particular to X-ray spectra in situations where the Poisson log-likelihood, or the Cash…

Instrumentation and Methods for Astrophysics · Physics 2023-05-03 M. Bonamente

Simulation studies are commonly used to evaluate the performance of newly developed meta-analysis methods. For methodology that is developed for an aggregated data meta-analysis, researchers often resort to simulation of the aggregated data…

Applications · Statistics 2022-01-19 Edwin R. van den Heuvel , Osama Almalik , Zhuozhao Zhan

We consider random sample splitting for estimation and inference in high dimensional generalized linear models, where we first apply the lasso to select a submodel using one subsample and then apply the debiased lasso to fit the selected…

Methodology · Statistics 2023-03-01 Omar Vazquez , Bin Nan

Protecting the privacy of data-sets has become hugely important these days. Many real-life data-sets like income data, medical data need to be secured before making it public. However, security comes at the cost of losing some useful…

Methodology · Statistics 2018-07-16 Debolina Ghatak , Bimak K Roy

We introduce a few of the key ideas of statistical analysis using two real-world examples to illustrate how these ideas are used in practice.

Methodology · Statistics 2015-04-07 Harrison B. Prosper

Particle splitting methods are considered for the estimation of rare events. The probability of interest is that a Markov process first enters a set $B$ before another set $A$, and it is assumed that this probability satisfies a large…

Probability · Mathematics 2007-11-14 Thomas Dean , Paul Dupuis

A central topic in functional data analysis is how to design an optimaldecision rule, based on training samples, to classify a data function. We exploit the optimal classification problem when data functions are Gaussian processes. Sharp…

Methodology · Statistics 2021-09-14 Shuoyang Wang , Zuofeng Shang , Guanqun Cao , Jun Liu

Phenomenon of stochastic separability was revealed and used in machine learning to correct errors of Artificial Intelligence (AI) systems and analyze AI instabilities. In high-dimensional datasets under broad assumptions each point can be…

Artificial Intelligence · Computer Science 2021-03-04 Bogdan Grechuk , Alexander N. Gorban , Ivan Y. Tyukin