English
Related papers

Related papers: Optimal Observation-Intervention Trade-Off in Opti…

200 papers

In this paper we consider stopping problems with partial observation under a general risk-sensitive optimization criterion for problems with finite and infinite time horizon. Our aim is to maximize the certainty equivalent of the stopping…

Optimization and Control · Mathematics 2017-03-29 Nicole Bäuerle , Ulrich Rieder

Bayesian optimization is a sequential decision making framework for optimizing expensive-to-evaluate black-box functions. Computing a full lookahead policy amounts to solving a highly intractable stochastic dynamic program. Myopic…

Machine Learning · Computer Science 2020-06-30 Shali Jiang , Daniel R. Jiang , Maximilian Balandat , Brian Karrer , Jacob R. Gardner , Roman Garnett

We propose constrained causal Bayesian optimization (cCBO), an approach for finding interventions in a known causal graph that optimize a target variable under some constraints. cCBO first reduces the search space by exploiting the graph…

Machine Learning · Statistics 2023-06-14 Virginia Aglietti , Alan Malek , Ira Ktena , Silvia Chiappa

Bayesian optimization is a popular framework for efficiently tackling black-box search problems. As a rule, these algorithms operate by iteratively choosing what to evaluate next until some predefined budget has been exhausted. We…

Machine Learning · Statistics 2024-12-12 James T. Wilson

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space and costly…

Machine Learning · Statistics 2018-10-11 Ricardo Baptista , Matthias Poloczek

The trade-off between the cost of acquiring and processing data, and uncertainty due to a lack of data is fundamental in machine learning. A basic instance of this trade-off is the problem of deciding when to make noisy and costly…

Machine Learning · Statistics 2017-03-30 Christopher R. Dance , Tomi Silander

While data-driven decision-making is transforming modern operations, most large-scale data is of an observational nature, such as transactional records. These data pose unique challenges in a variety of operational problems posed as…

Optimization and Control · Mathematics 2017-05-23 Dimitris Bertsimas , Nathan Kallus

Bayesian optimization is a methodology to optimize black-box functions. Traditionally, it focuses on the setting where you can arbitrarily query the search space. However, many real-life problems do not offer this flexibility; in…

In this paper, we study a continuous-time discounted jump Markov decision process with both controlled actions and observations. The observation is only available for a discrete set of time instances. At each time of observation, one has to…

Optimization and Control · Mathematics 2019-07-16 Yunhan Huang , Veeraruna Kavitha , Quanyan Zhu

This work introduces a novel blackbox optimization algorithm for computationally expensive constrained multi-fidelity problems. When applying a direct search method to such problems, the scarcity of feasible points may lead to numerous…

Optimization and Control · Mathematics 2025-04-09 Stéphane Alarie , Charles Audet , Miguel Diago , Sébastien Le Digabel , Xavier Lebeuf

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

Machine Learning · Computer Science 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

A challenging category of robotics problems arises when sensing incurs substantial costs. This paper examines settings in which a robot wishes to limit its observations of state, for instance, motivated by specific considerations of energy…

Robotics · Computer Science 2023-09-26 Patrick Zhong , Federico Rossi , Dylan A. Shell

We consider Markov decision processes where the state of the chain is only given at chosen observation times and of a cost. Optimal strategies involve the optimisation of observation times as well as the subsequent action values. We…

Optimization and Control · Mathematics 2025-03-27 Christoph Reisinger , Jonathan Tam

The notion of expense in Bayesian optimisation generally refers to the uniformly expensive cost of function evaluations over the whole search space. However, in some scenarios, the cost of evaluation for black-box objective functions is…

Machine Learning · Computer Science 2019-09-10 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

It is known that from purely observational data, a causal DAG is identifiable only up to its Markov equivalence class, and for many ground truth DAGs, the direction of a large portion of the edges will be remained unidentified. The golden…

Machine Learning · Computer Science 2019-10-15 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash

We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with respect to the…

Machine Learning · Statistics 2019-10-10 Julius von Kügelgen , Paul K Rubenstein , Bernhard Schölkopf , Adrian Weller

In several applications such as databases, planning, and sensor networks, parameters such as selectivity, load, or sensed values are known only with some associated uncertainty. The performance of such a system (as captured by some…

Data Structures and Algorithms · Computer Science 2010-01-28 Sudipto Guha , Kamesh Munagala

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

We investigate a class of optimal stopping problems arising in, for example, studies considering the timing of an irreversible investment when the underlying follows a skew Brownian motion. Our results indicate that the local directional…

Probability · Mathematics 2016-08-17 Luis H. R. Alvarez E. , Paavo Salminen

The widespread applicability of analytics in cyber-physical systems has motivated research into causal inference methods. Predictive estimators are not sufficient when analytics are used for decision making; rather, the flow of causal…

Systems and Control · Computer Science 2017-03-22 Roy Dong , Eric Mazumdar , S. Shankar Sastry