English
Related papers

Related papers: Efficient estimation of autocorrelation spectra

200 papers

We consider the efficient use of an approximation within Markov chain Monte Carlo (MCMC), with subsequent importance sampling (IS) correction of the Markov chain inexact output, leading to asymptotically exact inference. We detail…

Computation · Statistics 2019-04-15 Jordan Franks

Any search or sampling algorithm for solution of inverse problems needs guidance to be efficient. Many algorithms collect and apply information about the problem on the fly, and much improvement has been made in this way. However, as a…

Geophysics · Physics 2021-05-19 Sarouyeh Khoshkholgh , Andrea Zunino , Klaus Mosegaard

Many natural phenomena exhibit a stochastic nature that one attempts at modeling by using stochastic processes of different types. In this context, often one is interested in investigating the memory properties of the natural phenomenon at…

Computational Physics · Physics 2023-05-09 Salvatore Miccichè

We present a theoretical analysis of Maximum a Posteriori (MAP) sequence estimation for binary symmetric hidden Markov processes. We reduce the MAP estimation to the energy minimization of an appropriately defined Ising spin model, and…

Artificial Intelligence · Computer Science 2009-06-11 Armen Allahverdyan , Aram Galstyan

Collaborative training can improve the accuracy of a model for a user by trading off the model's bias (introduced by using data from other users who are potentially different) against its variance (due to the limited amount of data on any…

Machine Learning · Computer Science 2022-06-24 El Mahdi Chayti , Sai Praneeth Karimireddy , Sebastian U. Stich , Nicolas Flammarion , Martin Jaggi

Embedding approaches have become one of the most pervasive techniques for multi-label classification. However, the training process of embedding methods usually involves a complex quadratic or semidefinite programming problem, or the model…

Machine Learning · Computer Science 2021-09-01 Xiuwen Gong , Dong Yuan , Wei Bao

Binary optimization has a wide range of applications in combinatorial optimization problems such as MaxCut, MIMO detection, and MaxSAT. However, these problems are typically NP-hard due to the binary constraints. We develop a novel…

Optimization and Control · Mathematics 2023-07-04 Cheng Chen , Ruitao Chen , Tianyou Li , Ruichen Ao , Zaiwen Wen

The existence of galaxy intrinsic clustering severely hampers the weak lensing reconstruction from cosmic magnification. In paper I \citep{Yang2011}, we proposed a minimal variance estimator to overcome this problem. By utilizing the…

Cosmology and Nongalactic Astrophysics · Physics 2016-09-21 Xinjuan Yang , Pengjie Zhang , Jun Zhang , Yu Yu

Markov chain Monte Carlo is widely used in a variety of scientific applications to generate approximate samples from intractable distributions. A thorough understanding of the convergence and mixing properties of these Markov chains can be…

Methodology · Statistics 2023-05-23 Saptarshi Chakraborty , Kshitij Khare

Automatic discovery and curve fitting of absorption bands in hyperspectral data can enable the analyst to identify materials present in a scene by comparison with library spectra. This procedure is common in laboratory spectra, but is…

Instrumentation and Methods for Astrophysics · Physics 2014-01-23 Adrian J. Brown

In this paper we propose new algorithm to reduce autocorrelation in Markov chain Monte-Carlo algorithms for euclidean field theories on the lattice. Our proposing algorithm is the Hybrid Monte-Carlo algorithm (HMC) with restricted Boltzmann…

High Energy Physics - Lattice · Physics 2017-12-13 Akinori Tanaka , Akio Tomiya

This paper proposes a family of weighted batch means variance estimators, which are computationally efficient and can be conveniently applied in practice. The focus is on Markov chain Monte Carlo simulations and estimation of the asymptotic…

Statistics Theory · Mathematics 2018-05-23 Ying Liu , James M. Flegal

Cosmic shear and cosmic magnification reflect the same gravitational lensing field. Each of these two probes are affected by different systematics. We study the auto- and cross-correlations of the cosmic shear from the China Space Survey…

Cosmology and Nongalactic Astrophysics · Physics 2024-06-04 Ye Cao , Bin Hu , Ji Yao , Hu Zhan

We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with continuous shrinkage priors. A common challenge with these algorithms is the choice of the number of iterations to perform. This is…

Methodology · Statistics 2021-07-13 Niloy Biswas , Anirban Bhattacharya , Pierre E. Jacob , James E. Johndrow

It is well-known that exploiting label correlations is crucially important to multi-label learning. Most of the existing approaches take label correlations as prior knowledge, which may not correctly characterize the real relationships…

Machine Learning · Computer Science 2019-02-11 Lei Feng , Bo An , Shuo He

In this paper we develop a general framework for constructing and analysing coupled Markov chain Monte Carlo samplers, allowing for both (possibly degenerate) diffusion and piecewise deterministic Markov processes. For many performance…

Probability · Mathematics 2018-06-29 N. Nuesken , G. A. Pavliotis

Exact solutions for the learning problem of autoassociative networks with binary couplings are determined by a new method. The use of a branch-and-bound algorithm leads to a substantial saving of computational time compared with complete…

Disordered Systems and Neural Networks · Physics 2009-10-30 G. Milde , S. Kobe

In data mining, when binary prediction rules are used to predict a binary outcome, many performance measures are used in a vast array of literature for the purposes of evaluation and comparison. Some examples include classification…

Machine Learning · Statistics 2025-07-08 Zheng Yuan , Wenxin Jiang

Machine learning typically presupposes classical probability theory which implies that aggregation is built upon expectation. There are now multiple reasons to motivate looking at richer alternatives to classical probability theory as a…

Machine Learning · Computer Science 2024-01-30 Christian Fröhlich , Robert C. Williamson

This paper investigates a class of algorithms for numerical integration of a function in d dimensions over a compact domain by Monte Carlo methods. We construct a histogram approximation to the function using a partition of the integration…

Computational Physics · Physics 2015-06-11 Rudy Arthur , A. D. Kennedy