English
Related papers

Related papers: Fast, Optimal, and Targeted Predictions using Para…

200 papers

We propose a new approach to Bayesian prediction that caters for models with a large number of parameters and is robust to model misspecification. Given a class of high-dimensional (but parametric) predictive models, this new approach…

Methodology · Statistics 2022-05-13 David T. Frazier , Ruben Loaiza-Maya , Gael M. Martin , Bonsoo Koo

We are witnessing an increasing use of data-driven predictive models to inform decisions. As decisions have implications for individuals and society, there is increasing pressure on decision makers to be transparent about their decision…

When solving optimization problems under uncertainty with contextual data, utilizing machine learning to predict the uncertain parameters' values is a popular and effective approach. Decision-focused learning (DFL) aims at learning a…

Machine Learning · Computer Science 2026-01-29 Noah Schutte , Grigorii Veviurko , Krzysztof Postek , Neil Yorke-Smith

Bayesian methods have been very successful in quantifying uncertainty in physics-based problems in parameter estimation and prediction. In these cases, physical measurements y are modeled as the best fit of a physics-based model…

Data Analysis, Statistics and Probability · Physics 2015-02-06 Dave Higdon , Jordan D. McDonnell , Nicolas Schunck , Jason Sarich , Stefan M. Wild

Selective classification is a powerful tool for automated decision-making in high-risk scenarios, allowing classifiers to act only when confident and abstain when uncertainty is high. Given a target accuracy, our goal is to minimize…

Statistics Theory · Mathematics 2025-10-28 Mohamed Ndaoud , Peter Radchenko , Bradley Rava

Empirical analysis serves as an important complement to theoretical analysis for studying practical Bayesian optimization. Often empirical insights expose strengths and weaknesses inaccessible to theoretical analysis. We define two metrics…

Machine Learning · Computer Science 2016-04-01 Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , George Ke

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

Subset selection is a valuable tool for interpretable learning, scientific discovery, and data compression. However, classical subset selection is often avoided due to selection instability, lack of regularization, and difficulties with…

Machine Learning · Statistics 2022-02-17 Daniel R. Kowal

Randomized controlled experiments assess new policy impacts on performance metrics to inform launch decisions. Traditional approaches evaluate metrics independently despite correlations, and mixed results (e.g., positive revenue impact,…

Applications · Statistics 2026-01-29 Hoiyi Ng , Guido Imbens

Creating impact in real-world settings requires artificial intelligence techniques to span the full pipeline from data, to predictive models, to decisions. These components are typically approached separately: a machine learning model is…

Machine Learning · Computer Science 2018-11-22 Bryan Wilder , Bistra Dilkina , Milind Tambe

Human motion prediction is an important and challenging topic that has promising prospects in efficient and safe human-robot-interaction systems. Currently, the majority of the human motion prediction algorithms are based on deterministic…

Robotics · Computer Science 2021-07-15 Jie Xu , Xingyu Chen , Xuguang Lan , Nanning Zheng

In traditional machine learning techniques, the degree of closeness between true and predicted values generally measures the quality of predictions. However, these learning algorithms do not consider prescription problems where the…

Machine Learning · Computer Science 2021-01-05 Mehmet Kolcu , Alper E. Murat

AI models that predict the future behavior of a system (a.k.a. predictive AI models) are central to intelligent decision-making. However, decision-making using predictive AI models often results in suboptimal performance. This is primarily…

Artificial Intelligence · Computer Science 2025-01-13 Akhil S Anand , Shambhuraj Sawant , Dirk Reinhardt , Sebastien Gros

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

The most common approaches for solving multistage stochastic programming problems in the research literature have been to either use value functions ("dynamic programming") or scenario trees ("stochastic programming") to approximate the…

Optimization and Control · Mathematics 2022-01-04 Warren B Powell , Saeed Ghadimi

It is well understood that Bayesian decision theory and average case analysis are essentially identical. However, if one is interested in performing uncertainty quantification for a numerical task, it can be argued that standard approaches…

Methodology · Statistics 2020-07-16 Chris. J. Oates , Jon Cockayne , Dennis Prangle , T. J. Sullivan , Mark Girolami

We consider the problem of computationally-efficient prediction from high dimensional and highly correlated predictors in challenging settings where accurate variable selection is effectively impossible. Direct application of penalization…

Statistics Theory · Mathematics 2017-12-08 Minerva Mukhopadhyay , David B. Dunson

In performative prediction, the choice of a model influences the distribution of future data, typically through actions taken based on the model's predictions. We initiate the study of stochastic optimization for performative prediction.…

Machine Learning · Computer Science 2021-02-22 Celestine Mendler-Dünner , Juan C. Perdomo , Tijana Zrnic , Moritz Hardt

Often the goal of model selection is to choose a model for future prediction, and it is natural to measure the accuracy of a future prediction by squared error loss. Under the Bayesian approach, it is commonly perceived that the optimal…

Statistics Theory · Mathematics 2007-06-13 Maria Maddalena Barbieri , James O. Berger

Different machine learning techniques have been proposed and used for modeling individual and group user needs, interests and preferences. In the traditional predictive modeling instances are described by observable variables, called…

Artificial Intelligence · Computer Science 2013-12-24 Indre Zliobaite , Mykola Pechenizkiy