English
Related papers

Related papers: A Divide-and-Conquer Bayesian Approach to Large-Sc…

200 papers

This paper introduces the Bayesian Inference Engine (BIE), a general parallel, optimised software package for parameter inference and model selection. This package is motivated by the analysis needs of modern astronomical surveys and the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-04 Martin D. Weinberg

A crucial task in system identification problems is the selection of the most appropriate model class, and is classically addressed resorting to cross-validation or using asymptotic arguments. As recently suggested in the literature, this…

Numerical Analysis · Mathematics 2015-06-09 Silvia Bonettini , Alessandro Chiuso , Marco Prato

In this work, we propose a framework that combines the approximation-theory-based multifidelity method and Gaussian-process-regression-based multifidelity method to achieve data-model convergence when stochastic simulation models and sparse…

Machine Learning · Statistics 2018-12-10 Xiu Yang , Xueyu Zhu , Jing Li

We introduce an innovative method for incremental nonparametric probabilistic inference in high-dimensional state spaces. Our approach leverages \slices from high-dimensional surfaces to efficiently approximate posterior distributions of…

Artificial Intelligence · Computer Science 2024-05-28 Moshe Shienman , Ohad Levy-Or , Michael Kaess , Vadim Indelman

This work aims to improve the sample efficiency of parallel large-scale ranking and selection (R&S) problems by leveraging correlation information. We modify the commonly used "divide and conquer" framework in parallel computing by adding a…

Methodology · Statistics 2026-02-16 Zishi Zhang , Yijie Peng

A wide range of Bayesian models have been proposed for data that is divided hierarchically into groups. These models aim to cluster the data at different levels of grouping, by assigning a mixture component to each datapoint, and a mixture…

Machine Learning · Computer Science 2015-04-21 Adway Mitra

Deep unfolding networks (DUN) have emerged as a popular iterative framework for accelerated magnetic resonance imaging (MRI) reconstruction. However, conventional DUN aims to reconstruct all the missing information within the entire null…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Chong Wang , Lanqing Guo , Yufei Wang , Hao Cheng , Yi Yu , Bihan Wen

Recently, MapReduce based spatial query systems have emerged as a cost effective and scalable solution to large scale spatial data processing and analytics. MapReduce based systems achieve massive scalability by partitioning the data and…

Databases · Computer Science 2015-09-04 Ablimit Aji , Vo Hoang , Fusheng Wang

Kriging-based surrogate models have become very popular during the last decades to approximate a computer code output from few simulations. In practical applications, it is very common to sequentially add new simulations to obtain more…

Statistics Theory · Mathematics 2012-10-31 Loic Le Gratiet , Claire Cannamela

The information-based optimal subdata selection (IBOSS) is a computationally efficient method to select informative data points from large data sets through processing full data by columns. However, when the volume of a data set is too…

Computation · Statistics 2019-06-27 HaiYing Wang

Large-scale optimization problems that involve thousands of decision variables have extensively arisen from various industrial areas. As a powerful optimization tool for many real-world applications, evolutionary algorithms (EAs) fail to…

Neural and Evolutionary Computing · Computer Science 2023-09-26 Peng Yang , Ke Tang , Xin Yao

We develop a multiscale spatial kernel convolution technique with higher order functions to capture fine scale local features and lower order terms to capture large scale features. To achieve parsimony, the coefficients in the multiscale…

Methodology · Statistics 2018-04-02 Rajarshi Guhaniyogi , Bruno Sanso

We develop a hierarchical Bayesian dynamic game for competitive inventory and pricing under incomplete information. Two firms repeatedly choose order quantities and prices while facing two layers of uncertainty: unknown market demand and…

Methodology · Statistics 2026-03-09 Debashis Chatterjee

We consider bi-objective ranking and selection problems, where the goal is to correctly identify the Pareto optimal solutions among a finite set of candidates for which the two objective outcomes have been observed with uncertainty (e.g.,…

Machine Learning · Statistics 2024-03-29 Sebastian Rojas Gonzalez , Juergen Branke , Inneke van Nieuwenhuyse

This paper studies Bayesian ranking and selection (R&S) problems with correlated prior beliefs and continuous domains, i.e. Bayesian optimization (BO). Knowledge gradient methods [Frazier et al., 2008, 2009] have been widely studied for…

Machine Learning · Statistics 2017-07-28 Jian Wu , Peter I. Frazier

We propose a computationally and statistically efficient divide-and-conquer (DAC) algorithm to fit sparse Cox regression to massive datasets where the sample size $n_0$ is exceedingly large and the covariate dimension $p$ is not small but…

Computation · Statistics 2018-04-04 Yan Wang , Nathan Palmer , Qian Di , Joel Schwartz , Isaac Kohane , Tianxi Cai

A new methodology for model determination in decomposable graphical Gaussian models is developed. The Bayesian paradigm is used and, for each given graph, a hyper inverse Wishart prior distribution on the covariance matrix is considered.…

Computation · Statistics 2015-03-13 Sophie Donnet , Jean-Michel Marin

In this work we propose and analyze a Hessian-based adaptive sparse quadrature to compute infinite-dimensional integrals with respect to the posterior distribution in the context of Bayesian inverse problems with Gaussian prior. Due to the…

Numerical Analysis · Mathematics 2018-02-14 Peng Chen , Umberto Villa , Omar Ghattas

When performing Bayesian computations in practice, one is often faced with the challenge that the constituent model components and/or the data are only available in a distributed fashion, e.g. due to privacy concerns or sheer volume. While…

Computation · Statistics 2022-10-26 Joris Bierkens , Andrew Duncan

Motivation: Surface generation and visualization are some of the most important tasks in biomolecular modeling and computation. Eulerian solvent excluded surface (ESES) software provides analytical solvent excluded surface (SES) in the…

Quantitative Methods · Quantitative Biology 2018-09-13 Rundong Zhao , Menglun Wang , Yiying Tong , Guo-Wei Wei