English
Related papers

Related papers: A Generalized Savage-Dickey Ratio

200 papers

We study the problem of bivariate discrete or continuous probability density estimation under low-rank constraints.For discrete distributions, we assume that the two-dimensional array to estimate is a low-rank probability matrix. In the…

Statistics Theory · Mathematics 2024-10-23 Julien Chhor , Olga Klopp , Alexandre Tsybakov

Binary density ratio estimation (DRE), the problem of estimating the ratio $p_1/p_2$ given their empirical samples, provides the foundation for many state-of-the-art machine learning algorithms such as contrastive representation learning…

Machine Learning · Computer Science 2021-12-08 Lantao Yu , Yujia Jin , Stefano Ermon

When modeling a probability distribution with a Bayesian network, we are faced with the problem of how to handle continuous variables. Most previous work has either solved the problem by discretizing, or assumed that the data are generated…

Machine Learning · Computer Science 2013-02-21 George H. John , Pat Langley

The Regularised Inertial Dean-Kawasaki model (RIDK) -- introduced by the authors and J. Zimmer in earlier works -- is a nonlinear stochastic PDE capturing fluctuations around the mean-field limit for large-scale particle systems in both…

Numerical Analysis · Mathematics 2023-09-19 Federico Cornalba , Tony Shardlow

Divergence estimators based on direct approximation of density-ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution…

Machine Learning · Statistics 2011-06-24 Makoto Yamada , Taiji Suzuki , Takafumi Kanamori , Hirotaka Hachiya , Masashi Sugiyama

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

There is a difficulty in finding an estimate of variance of the profile likelihood estimator in the joint model of longitudinal and survival data. We solve the difficulty by introducing the ``statistical generalized derivative''. The…

Statistics Theory · Mathematics 2018-07-23 Yuichi Hirose , Ivy Liu

The results on the mean-variance hedging problem in Gouri\'eroux, Laurent and Pham (1998), Rheinl\"ander and Schweizer (1997) and Arai (2005) are extended to discontinuous semimartingale models. When the num\'eraire method is used, we only…

Probability · Mathematics 2008-12-10 Jianming Xia

We construct a Lebesgue measure preserving natural extension of the random beta-transformation. This allows us to give a formula for the density of the absolutely continuous invariant probability measure, answering a question of Dajani and…

Dynamical Systems · Mathematics 2013-03-06 Tom Kempton

It is shown that for any $\alpha \in ]\frac12,1[$ there exists a symmetric probability measure $\sigma$ on the torus such that the Hausdorff dimension of the support of $\sigma$ is $\alpha$ and $\sigma*\sigma$ is absolutely continuous with…

Dynamical Systems · Mathematics 2021-05-05 el Houcein el Abdalaoui

In this article we generalize the classical Edgeworth expansion for the probability density function (PDF) of sums of a finite number of symmetric independent identically distributed random variables with a finite variance to sums of…

Statistical Mechanics · Physics 2015-05-20 Netanel Hazut , Shlomi Medalion , David A. Kessler , Eli Barkai

A density estimation method in a Bayesian nonparametric framework is presented when recorded data are not coming directly from the distribution of interest, but from a length biased version. From a Bayesian perspective, efforts to…

Statistics Theory · Mathematics 2015-10-23 Spyridon J. Hatjispyros , Theodoros Nicoleris , Stephen G. Walker

This paper describes a new Bayesian interpretation of a class of skew--Student $t$ distributions. We consider a hierarchical normal model with unknown covariance matrix and show that by imposing different restrictions on the parameter…

Methodology · Statistics 2018-05-25 Abdolnasser Sadeghkhani

We review the problem of how to compute the spectral density of sparse symmetric random matrices, i.e. weighted adjacency matrices of undirected graphs. Starting from the Edwards-Jones formula, we illustrate the milestones of this line of…

Statistical Mechanics · Physics 2021-08-11 Vito A R Susca , Pierpaolo Vivo , Reimer Kühn

We consider, and make precise, a certain extension of the Radon-Nikodym derivative operator, to functions which are additive, but not necessarily sigma-additive, on a subset of a given sigma-algebra. We give applications to probability…

Probability · Mathematics 2022-05-17 Daniel Alpay , Palle Jorgensen

Bayesian optimization has attracted huge attention from diverse research areas in science and engineering, since it is capable of efficiently finding a global optimum of an expensive-to-evaluate black-box function. In general, a…

Machine Learning · Computer Science 2025-07-29 Jungtaek Kim

We consider the problem of estimating the joint distribution $P$ of $n$ independent random variables within the Bayes paradigm from a non-asymptotic point of view. Assuming that $P$ admits some density $s$ with respect to a given reference…

Statistics Theory · Mathematics 2020-03-30 Yannick Baraud , Lucien Birgé

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

Methodology · Statistics 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa

We develop Bayesian models for density regression with emphasis on discrete outcomes. The problem of density regression is approached by considering methods for multivariate density estimation of mixed scale variables, and obtaining…

Methodology · Statistics 2019-08-14 Georgios Papageorgiou

The density ratio of two probability distributions is one of the fundamental tools in mathematical and computational statistics and machine learning, and it has a variety of known applications. Therefore, density ratio estimation from…

Machine Learning · Statistics 2024-06-28 Masanari Kimura , Howard Bondell