English
Related papers

Related papers: On optimal direction gibbs sampling

200 papers

Earlier papers introduced a method of accurately estimating the angular cosmic microwave background (CMB) temperature power spectrum based on Gibbs sampling. Here we extend this framework to polarized data. All advantages of the Gibbs…

Subsampling is an efficient method to deal with massive data. In this paper, we investigate the optimal subsampling for linear quantile regression when the covariates are functions. The asymptotic distribution of the subsampling estimator…

Numerical Analysis · Mathematics 2022-05-06 Qian Yan , Hanyu Li , Chengmei Niu

In this paper we describe how MAP inference can be used to sample efficiently from Gibbs distributions. Specifically, we provide means for drawing either approximate or unbiased samples from Gibbs' distributions by introducing low…

Machine Learning · Computer Science 2013-10-01 Tamir Hazan , Subhransu Maji , Tommi Jaakkola

Optimal transport is the problem of designing a joint distribution for two random variables with fixed marginals. In virtually the entire literature on this topic, the objective is to minimize expected cost. This paper is the first to study…

Econometrics · Economics 2026-02-13 Yinchu Zhu , Ilya O. Ryzhov

Many machine learning applications require operating on a spatially distributed dataset. Despite technological advances, privacy considerations and communication constraints may prevent gathering the entire dataset in a central unit. In…

Machine Learning · Statistics 2024-01-30 Alexandros E. Tzikas , Licio Romao , Mert Pilanci , Alessandro Abate , Mykel J. Kochenderfer

In previous work the authors defined the k-th order simplicial distance between probability distributions which arises naturally from a measure of dispersion based on the squared volume of random simplices of dimension k. This theory is…

Statistics Theory · Mathematics 2018-09-06 Luc Pronzato , Henry Wynn , Anatoly Zhigljavsky

This paper proposes an efficient implementation of the generalized labeled multi-Bernoulli (GLMB) filter by combining the prediction and update into a single step. In contrast to the original approach which involves separate truncations in…

Computation · Statistics 2015-07-06 Hung Gia Hoang , Ba-Tuong Vo , Ba-Ngu Vo

We examine a fundamental problem that models various active sampling setups, such as network tomography. We analyze sampling of a multivariate normal distribution with an unknown expectation that needs to be estimated: in our setup it is…

Machine Learning · Statistics 2012-08-14 Assaf Hallak , Shie Mannor

In this paper, we propose a test for the equality of multiple distributions based on kernel mean embeddings. Our framework provides a flexible way to handle multivariate or even high-dimensional data by virtue of kernel methods and allows…

Statistics Theory · Mathematics 2020-06-08 Ilmun Kim

We present an optimization algorithm that can identify a global minimum of a potentially nonconvex smooth function with high probability, assuming the Gibbs measure of the potential satisfies a logarithmic Sobolev inequality. Our…

Optimization and Control · Mathematics 2025-09-16 Daniel Cortild , Claire Delplancke , Nadia Oudjane , Juan Peypouquet

Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the…

Numerical Analysis · Mathematics 2021-05-19 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

Following the very recent line of work on the ``generalized min-max'' (GMM) kernel, this study proposes the ``generalized intersection'' (GInt) kernel and the related ``normalized generalized min-max'' (NGMM) kernel. In computer vision, the…

Machine Learning · Statistics 2016-12-30 Ping Li

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

We study the generalization error of functions that interpolate prescribed data points and are selected by minimizing a weighted norm. Under natural and general conditions, we prove that both the interpolants and their generalization errors…

Numerical Analysis · Mathematics 2021-02-11 Weilin Li

This paper deals with the problem of estimating predictive densities of a matrix-variate normal distribution with known covariance matrix. Our main aim is to establish some Bayesian predictive densities related to matricial shrinkage…

Statistics Theory · Mathematics 2017-04-03 Hisayuki Tsukuma , Tatsuya Kubokawa

Learning to sample from intractable distributions over discrete sets without relying on corresponding training data is a central problem in a wide range of fields, including Combinatorial Optimization. Currently, popular deep learning-based…

Machine Learning · Computer Science 2025-08-25 Sebastian Sanokowski , Sepp Hochreiter , Sebastian Lehner

Most machine learning methods require tuning of hyper-parameters. For kernel ridge regression with the Gaussian kernel, the hyper-parameter is the bandwidth. The bandwidth specifies the length scale of the kernel and has to be carefully…

Machine Learning · Statistics 2023-12-04 Oskar Allerbo , Rebecka Jörnsten

We develop some theoretical results for a robust similarity measure named "generalized min-max" (GMM). This similarity has direct applications in machine learning as a positive definite kernel and can be efficiently computed via…

Methodology · Statistics 2016-08-02 Ping Li , Cun-Hui Zhang

Gibbs sampling is a Markov Chain Monte Carlo (MCMC) method often used in Bayesian learning. MCMC methods can be difficult to deploy on parallel and distributed systems due to their inherently sequential nature. We study asynchronous Gibbs…

Computation · Statistics 2020-03-03 Alexander Terenin , Daniel Simpson , David Draper

In this paper we study algorithms to find a Gaussian approximation to a target measure defined on a Hilbert space of functions; the target measure itself is defined via its density with respect to a reference Gaussian measure. We employ the…

Numerical Analysis · Mathematics 2014-08-11 Frank J. Pinski , Gideon Simpson , Andrew M. Stuart , Hendrik Weber