English
Related papers

Related papers: Efficient estimation of autocorrelation spectra

200 papers

Stacking, a potent ensemble learning method, leverages a meta-model to harness the strengths of multiple base models, thereby enhancing prediction accuracy. Traditional stacking techniques typically utilize established learning models, such…

Machine Learning · Computer Science 2024-10-31 Wei Wu , Liang Tang , Zhongjie Zhao , Chung-Piaw Teo

We present a data analysis pipeline for CMB polarization experiments, running from multi-frequency maps to the power spectra. We focus mainly on component separation and, for the first time, we work out the covariance matrix accounting for…

Cosmology and Nongalactic Astrophysics · Physics 2010-06-14 S. Ricciardi , A. Bonaldi , P. Natoli , G. Polenta , C. Baccigalupi , E. Salerno , K. Kayabol , L. Bedini , G. De Zotti

High-dimensional data are routinely collected in many areas. We are particularly interested in Bayesian classification models in which one or more variables are imbalanced. Current Markov chain Monte Carlo algorithms for posterior…

Methodology · Statistics 2024-01-15 Deborshee Sen , Matthias Sachs , Jianfeng Lu , David Dunson

The Chord Length Sampling (CLS) algorithm is a powerful Monte Carlo method that models the effects of stochastic media on particle transport by generating on-the-fly the material interfaces seen by the random walkers during their…

Statistical Mechanics · Physics 2018-03-14 Colline Larmier , Adam Lam , Patrick Brantley , Fausto Malvagi , Todd Palmer , Andrea Zoia

We derive optimal estimators for the two-, three-, and four-point correlators of statistically isotropic scalar fields defined on the sphere, such as the Cosmic Microwave Background temperature fluctuations, allowing for arbitrary (linear)…

Cosmology and Nongalactic Astrophysics · Physics 2023-06-28 Oliver H. E. Philcox

We consider the problem of estimating the measure of subsets in very large networks. A prime tool for this purpose is the Markov Chain Monte Carlo (MCMC) algorithm. This algorithm, while extremely useful in many cases, still often suffers…

Data Structures and Algorithms · Computer Science 2020-09-01 Ahmad Askarian , Rupei Xu , András Faragó

We propose an adaptive estimator for the stationary distribution of a bifurcating Markov Chain on $\mathbb R^d$. Bifurcating Markov chains (BMC for short) are a class of stochastic processes indexed by regular binary trees. A kernel…

Statistics Theory · Mathematics 2017-06-22 S Valere Bitseki Penda , Angelina Roche

Deep learning models are trained to minimize the error between the model's output and the actual values. The typical cost function, the Mean Squared Error (MSE), arises from maximizing the log-likelihood of additive independent, identically…

Machine Learning · Computer Science 2021-05-12 Anand Ramakrishnan , Warren B. Jackson , Kent Evans

The clustering signals of galaxy clusters are known to be powerful tools for self-calibrating the mass-observable relation and are complementary to cluster abundance and lensing. In this work, we explore the possibility of combining three…

Cosmology and Nongalactic Astrophysics · Physics 2023-07-04 Chenxiao Zeng , Andrés N. Salcedo , Hao-Yi Wu , Christopher M. Hirata

A popular approach to semi-supervised learning proceeds by endowing the input data with a graph structure in order to extract geometric information and incorporate it into a Bayesian framework. We introduce new theory that gives appropriate…

Machine Learning · Statistics 2020-01-14 Nicolas Garcia Trillos , Zachary Kaplan , Thabo Samakhoana , Daniel Sanz-Alonso

Markov chain Monte Carlo samplers produce dependent streams of variates drawn from the limiting distribution of the Markov chain. With this as motivation, we introduce novel univariate kernel density estimators which are appropriate for the…

Methodology · Statistics 2016-07-29 Hang J. Kim , Steven N. MacEachern , Yoonsuh Jung

Through the Bayesian lens of data assimilation, uncertainty on model parameters is traditionally quantified through the posterior covariance matrix. However, in modern settings involving high-dimensional and computationally expensive…

Computation · Statistics 2023-11-16 Michael Stanley , Mikael Kuusela , Brendan Byrne , Junjie Liu

There has been considerable interest in making Bayesian inference more scalable. In big data settings, most literature focuses on reducing the computing time per iteration, with less focused on reducing the number of iterations needed in…

Methodology · Statistics 2017-09-28 Leo L. Duan , James E. Johndrow , David B. Dunson

Linear measures such as cross-correlation have been used successfully to determine time delays from the given processes. Such an analysis often precedes identifying possible causal relationships between the observed processes. The present…

Quantitative Methods · Quantitative Biology 2015-05-13 Radhakrishnan Nagarajan

A new method for the experimental study of bin-bin correlations is proposed. It is shown that this method is able to reveal important additional information on bin-bin correlations, beyond that of factorial-correlator measurements.

High Energy Physics - Phenomenology · Physics 2007-05-23 S. V. Chekanov , W. Kittel , V. I. Kuvshinov

Independent component analysis is intended to recover the mutually independent components from their linear mixtures. This technique has been widely used in many fields, such as data analysis, signal processing, and machine learning. To…

Machine Learning · Statistics 2022-07-13 Yunpeng Li , ZhaoHui Ye

The Bin Packing Problem (BPP) is a well-established combinatorial optimization (CO) problem. Since it has many applications in our daily life, e.g. logistics and resource allocation, people are seeking efficient bin packing algorithms. On…

Machine Learning · Computer Science 2023-12-14 Wenjie Wu , Changjun Fan , Jincai Huang , Zhong Liu , Junchi Yan

Markov chain Monte Carlo (MCMC) is one of the main workhorses of probabilistic inference, but it is notoriously hard to measure the quality of approximate posterior samples. This challenge is particularly salient in black box inference…

Machine Learning · Computer Science 2016-06-08 Roger B. Grosse , Siddharth Ancha , Daniel M. Roy

In this paper, we present an algorithm for learning time-correlated measurement covariances for application in batch state estimation. We parameterize the inverse measurement covariance matrix to be block-banded, which conveniently…

Robotics · Computer Science 2023-03-14 David J. Yoon , Timothy D. Barfoot

Spectral clustering is one of the most effective clustering approaches that capture hidden cluster structures in the data. However, it does not scale well to large-scale problems due to its quadratic complexity in constructing similarity…

Machine Learning · Computer Science 2019-11-26 Lingfei Wu , Pin-Yu Chen , Ian En-Hsu Yen , Fangli Xu , Yinglong Xia , Charu Aggarwal