English
Related papers

Related papers: The Gaussian data assumption does not always lead …

200 papers

In many structured prediction problems, complex relationships between variables are compactly defined using graphical structures. The most prevalent graphical prediction methods---probabilistic graphical models and large margin…

Machine Learning · Statistics 2018-11-08 Rizal Fathony , Ashkan Rezaei , Mohammad Ali Bashiri , Xinhua Zhang , Brian D. Ziebart

In this paper, we establish the connections of the fundamental limitations in feedback communication, estimation, and feedback control over Gaussian channels, from a unifying perspective for information, estimation, and control. The optimal…

Information Theory · Computer Science 2009-10-05 Jialing Liu , Nicola Elia

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

Machine Learning · Computer Science 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

We investigate the problem of estimating simultaneously multiple parameters encoded in the shape of the modes on which the light is expanded. For this, we generalize the mode-encoded parameter estimation theory as introduced in Ref.[1] to a…

Quantum Physics · Physics 2025-05-23 Alexander Boeschoten , Giacomo Sorelli , Manuel Gessner , Claude Fabre , Nicolas Treps

Consider the Gaussian sequence model under the additional assumption that a fixed fraction of the means is known. We study the problem of variance estimation from a frequentist Bayesian perspective. The maximum likelihood estimator (MLE)…

Statistics Theory · Mathematics 2019-12-19 Gianluca Finocchio , Johannes Schmidt-Hieber

We study the problem of estimating the magnitude of a Gaussian beam displacement using a two pixel or 'split' detector. We calculate the maximum likelihood estimator, and compute its asymptotic mean-squared-error via the Fisher information.…

Instrumentation and Detectors · Physics 2015-09-11 George C. Knee , William J. Munro

Real-world signals typically span across multiple dimensions, that is, they naturally reside on multi-way data structures referred to as tensors. In contrast to standard ``flat-view'' multivariate matrix models which are agnostic to data…

Signal Processing · Electrical Eng. & Systems 2019-12-04 Bruno Scalzo Dees , Anh-Huy Phan , Danilo P. Mandic

We address the discontinuities of the quantum Fisher information (QFI) that may arise when the parameter of interest takes values that change the rank of the quantum statistical model. We revisit the classical and the quantum Cram\'er-Rao…

Quantum Physics · Physics 2025-01-23 Luigi Seveso , Francesco Albarelli , Marco G. Genoni , Matteo G. A. Paris

Many machine learning models appear to deploy effortlessly under distribution shift, and perform well on a target distribution that is considerably different from the training distribution. Yet, learning theory of distribution shift bounds…

Machine Learning · Computer Science 2024-05-30 Robi Bhattacharjee , Nick Rittler , Kamalika Chaudhuri

We demonstrate that two approximations to the chi^2 statistic as popularly employed by observational astronomers for fitting Poisson-distributed data can give rise to intrinsically biased model parameter estimates, even in the high counts…

Astrophysics · Physics 2009-11-13 Philip J. Humphrey , Wenhao Liu , David A. Buote

This paper proposes a Bayesian method for estimating the parameters of a normal distribution when only limited summary statistics (sample mean, minimum, maximum, and sample size) are available. To estimate the parameters of a normal…

Methodology · Statistics 2024-11-21 Tomoki Matsumoto

The standard margin-based structured prediction commonly uses a maximum loss over all possible structured outputs. The large-margin formulation including latent variables not only results in a non-convex formulation but also increases the…

Machine Learning · Computer Science 2019-06-25 Kevin Bello , Jean Honorio

In this paper, we analyze the performance of the estimation of Laplacian matrices under general observation models. Laplacian matrix estimation involves structural constraints, including symmetry and null-space properties, along with matrix…

Machine Learning · Statistics 2025-04-08 Morad Halihal , Tirza Routtenberg , H. Vincent Poor

We examine a new method for peak localization, the centroid of the data raised to some power, which we call the generalized centroid. We derive the peak localization uncertainty for the generalized centroid and compare it with the…

Instrumentation and Methods for Astrophysics · Physics 2018-07-24 Shannon Campbell

Variational inference with a factorized Gaussian posterior estimate is a widely used approach for learning parameters and hidden variables. Empirically, a regularizing effect can be observed that is poorly understood. In this work, we show…

Machine Learning · Computer Science 2019-09-04 Julius Kunze , Louis Kirsch , Hippolyt Ritter , David Barber

We investigate the bias and error in estimates of the cosmological parameter covariance matrix, due to sampling or modelling the data covariance matrix, for likelihood width and peak scatter estimators. We show that these estimators do not…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-18 Andy Taylor , Benjamin Joachimi

This paper proposes a novel approach to the statistical characterization of non-central complex Gaussian quadratic forms (CGQFs). Its key strategy is the generation of an auxiliary random variable (RV) that converges in distribution to the…

Information Theory · Computer Science 2018-06-18 Pablo Ramírez-Espinosa , Laureano Moreno-Pozas , José F. Paris , José A. Cortés , Eduardo Martos-Naya

We derive upper bounds on the quantum Fisher information in interferometry with $N$ subsystems, e.g. two-level atoms or Gaussian modes, in the presence of arbitrarily correlated Gaussian dephasing including independent and collective…

Quantum Physics · Physics 2014-03-06 Katarzyna Macieszczak

Recently, Tian et al. [1] considered joint source-channel coding of transmitting a Gaussian source over $K$-user Gaussian broadcast channel, and derived an outer bound on the admissible distortion region. In [1], they stated "due to its…

Information Theory · Computer Science 2016-11-17 Lei Yu , Houqiang Li , Weiping Li

The dynamics of a one-dimensional stochastic model is studied in presence of an absorbing boundary. The distribution of fluctuations is analytically characterized within the generalized van Kampen expansion, accounting for higher order…

Statistical Mechanics · Physics 2015-05-28 Claudia Cianci , Francesca Di Patti , Duccio Fanelli
‹ Prev 1 8 9 10 Next ›