English
Related papers

Related papers: Data fission: splitting a single data point

200 papers

The data association problem is concerned with separating data coming from different generating processes, for example when data come from different data sources, contain significant noise, or exhibit multimodality. We present a fully…

Machine Learning · Statistics 2019-05-07 Markus Kaiser , Clemens Otte , Thomas Runkler , Carl Henrik Ek

We revisit the replica method for analyzing inference and learning in parametric models, considering situations where the data-generating distribution is unknown or analytically intractable. Instead of assuming idealized distributions to…

Disordered Systems and Neural Networks · Physics 2025-11-17 Takashi Takahashi

Many statistical models require an estimation of unknown (co)-variance parameter(s) in a model. The estimation usually obtained by maximizing a log-likelihood which involves log determinant terms. In principle, one requires the…

Computation · Statistics 2016-09-05 Shengxin Zhu , Tongxiang Gu , Xiaowen Xu , Zeyao Mo

In this work, we consider the problem of distributed approximation of functions over multiple-access channels with additive noise. In contrast to previous works, we take fast fading into account and give explicit probability bounds for the…

Information Theory · Computer Science 2021-03-01 Igor Bjelakovic , Matthias Frey , Slawomir Stanczak

We study a fragmentation problem where an initial object of size x is broken into m random pieces provided x>x_0 where x_0 is an atomic cut-off. Subsequently the fragmentation process continues for each of those daughter pieces whose sizes…

Statistical Mechanics · Physics 2009-11-07 David S. Dean , Satya N. Majumdar

Fuzzy data, prevalent in social sciences and other fields, capture uncertainties arising from subjective evaluations and measurement imprecision. Despite significant advancements in fuzzy statistics, a unified inferential regression-based…

Methodology · Statistics 2025-06-05 Antonio Calcagnì , Przemysław Grzegorzewski , Maciej Romaniuk

Nonparametric regression for massive numbers of samples (n) and features (p) is an increasingly important problem. In big n settings, a common strategy is to partition the feature space, and then separately apply simple models to each…

Machine Learning · Statistics 2014-06-10 Rajarshi Guhaniyogi , David B. Dunson

A product of two Gaussians (or normal distributions) is another Gaussian. That's a valuable and useful fact! Here we use it to derive a refactoring of a common product of multivariate Gaussians: The product of a Gaussian likelihood times a…

Computation · Statistics 2020-06-01 David W. Hogg , Adrian M. Price-Whelan , Boris Leistedt

Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted. The corresponding reverse process progressively "denoises"…

Gaussian boson sampling is originally proposed to show quantum advantage with quantum linear optical elements. Recently, several experimental breakthroughs based on Gaussian boson sampling pointing to quantum computing supremacy have been…

Quantum Physics · Physics 2023-01-02 Tian-Yu Yang , Yi-Xin Shen , Zhou-Kai Cao , Xiang-Bin Wang

This study focuses on statistical inference for compound models of the form $X=\xi_1+\ldots+\xi_N$, where $N$ is a random variable denoting the count of summands, which are independent and identically distributed (i.i.d.) random variables…

Statistics Theory · Mathematics 2025-07-22 Denis Belomestny , Ekaterina Morozova , Vladimir Panov

Given a single observation from a Gaussian distribution with unknown mean $\theta$, we design computationally efficient procedures that can approximately generate an observation from a different target distribution $Q_{\theta}$ uniformly…

Statistics Theory · Mathematics 2025-10-09 Mengqi Lou , Guy Bresler , Ashwin Pananjady

Bayesian estimation of Gaussian graphical models has proven to be challenging because the conjugate prior distribution on the Gaussian precision matrix, the G-Wishart distribution, has a doubly intractable partition function. Recent…

Neurons and Cognition · Quantitative Biology 2014-09-10 Max Hinne , Alex Lenkoski , Tom Heskes , Marcel van Gerven

We propose a distributed method for simultaneous inference for datasets with sample size much larger than the number of covariates, i.e., N >> p, in the generalized linear models framework. When such datasets are too big to be analyzed…

Methodology · Statistics 2020-07-23 Lu Tang , Ling Zhou , Peter X. -K. Song

A key tool for building differentially private systems is adding Gaussian noise to the output of a function evaluated on a sensitive dataset. Unfortunately, using a continuous distribution presents several practical challenges. First and…

Data Structures and Algorithms · Computer Science 2024-11-19 Clément L. Canonne , Gautam Kamath , Thomas Steinke

Split sample methods have recently been put forward as a way to reduce the coverage oscillations that haunt confidence intervals for parameters of lattice distributions, such as the binomial and Poisson distributions. We study split sample…

Methodology · Statistics 2015-03-11 Måns Thulin

Gaussian processes with derivative information are useful in many settings where derivative information is available, including numerous Bayesian optimization and regression tasks that arise in the natural sciences. Incorporating derivative…

Machine Learning · Computer Science 2021-07-12 Misha Padidar , Xinran Zhu , Leo Huang , Jacob R. Gardner , David Bindel

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

Even though a train/test split of the dataset randomly performed is a common practice, could not always be the best approach for estimating performance generalization under some scenarios. The fact is that the usual machine learning…

Machine Learning · Computer Science 2022-09-09 Carlos Catania , Jorge Guerra , Juan Manuel Romero , Gabriel Caffaratti , Martin Marchetta

In this work, we propose two different approaches to improve the semantic consistency of Open Set Semantic Segmentation. First, we propose a method called OpenGMM that extends the OpenPCS framework using a Gaussian Mixture of Models to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Ian Nunes , Matheus B. Pereira , Hugo Oliveira , Jefersson A. Dos Santos , Marcus Poggi