English
Related papers

Related papers: Sequential Decision Making on Unmatched Data using…

200 papers

Given the joint chances of a pair of random variables one can compute quantities of interest, like the mutual information. The Bayesian treatment of unknown chances involves computing, from a second order prior distribution and the data…

Machine Learning · Computer Science 2007-05-23 Marcus Hutter , Marco Zaffalon

Two non-intrusive uncertainty propagation approaches are proposed for the performance analysis of engineering systems described by expensive-to-evaluate deterministic computer models with parameters defined as interval variables. These…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Alice Cicirello , Filippo Giunta

Bayesian optimization has become a fundamental global optimization algorithm in many problems where sample efficiency is of paramount importance. Recently, there has been proposed a large number of new applications in fields such as…

Artificial Intelligence · Computer Science 2019-02-06 Ruben Martinez-Cantin

Ranking, and inferences based on ranking of a set of entities, are important problems in numerous contexts. This is especially true in small area statistics where there may be only a limited amount of directly observed data from each entity…

Methodology · Statistics 2025-11-26 Snigdhansu Chatterjee , Gauri Sankar Datta , Yiren Hou , Abhyuday Mandal

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian…

Machine Learning · Computer Science 2017-11-21 Shaunak D. Bopardikar , George S. Eskander Ekladious

Dynamic and evolving operational and economic environments present significant challenges for decision-making. We explore a simulation optimization problem characterized by non-stationary input distributions with regime-switching dynamics…

Optimization and Control · Mathematics 2025-08-19 Jianglin Xia , Haowei Wang , Songhao Wang , Szu Hui Ng

We consider the problem of sequentially making decisions that are rewarded by "successes" and "failures" which can be predicted through an unknown relationship that depends on a partially controllable vector of attributes for each instance.…

Machine Learning · Statistics 2017-09-18 Yingfei Wang , Chu Wang , Warren Powell

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian…

Machine Learning · Computer Science 2024-03-26 Yuhao Liu , Marzieh Ajirak , Petar Djuric

We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with respect to the…

Machine Learning · Statistics 2019-10-10 Julius von Kügelgen , Paul K Rubenstein , Bernhard Schölkopf , Adrian Weller

Consider a setting in which a policy maker assigns subjects to treatments, observing each outcome before the next subject arrives. Initially, it is unknown which treatment is best, but the sequential nature of the problem permits learning…

Econometrics · Economics 2020-08-13 Anders Bredahl Kock , David Preinerstorfer , Bezirgen Veliyev

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

Inverse problems and, in particular, inferring unknown or latent parameters from data are ubiquitous in engineering simulations. A predominant viewpoint in identifying unknown parameters is Bayesian inference where both prior information…

Computation · Statistics 2022-08-31 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

The counterfactual distribution models the effect of the treatment in the untreated group. While most of the work focuses on the expected values of the treatment effect, one may be interested in the whole counterfactual distribution or…

Machine Learning · Statistics 2022-11-04 Diego Martinez-Taboada , Dino Sejdinovic

Expectation maximisation (EM) is an unsupervised learning method for estimating the parameters of a finite mixture distribution. It works by introducing "hidden" or "latent" variables via Baum's auxiliary function $Q$ that allow the joint…

Machine Learning · Computer Science 2022-05-19 Graham W. Pulford

The problem of making sequential decisions in unknown probabilistic environments is studied. In cycle $t$ action $y_t$ results in perception $x_t$ and reward $r_t$, where all quantities in general may depend on the complete history. The…

Artificial Intelligence · Computer Science 2007-05-23 Marcus Hutter

Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even…

Machine Learning · Computer Science 2026-02-02 Md Musfiqur Rahman , Ziwei Jiang , Hilaf Hasson , Murat Kocaoglu

Sequential Bayesian inference over predictive functions is a natural framework for continual learning from streams of data. However, applying it to neural networks has proved challenging in practice. Addressing the drawbacks of existing…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Freddie Bickford Smith , Qixuan Feng , Yee Whye Teh , Yarin Gal

Bayesian optimization (BO) based on Gaussian process models is a powerful paradigm to optimize black-box functions that are expensive to evaluate. While several BO algorithms provably converge to the global optimum of the unknown function,…

Machine Learning · Statistics 2019-04-03 Felix Berkenkamp , Angela P. Schoellig , Andreas Krause

Optimal design is a critical yet challenging task within many applications. This challenge arises from the need for extensive trial and error, often done through simulations or running field experiments. Fortunately, sequential optimal…

Machine Learning · Computer Science 2025-03-25 Xubo Yue , Raed Al Kontar , Albert S. Berahas , Yang Liu , Blake N. Johnson