English
Related papers

Related papers: Data-efficient Bayesian-guided design selection fr…

200 papers

We develop a Bayesian framework for variable selection in linear regression with autocorrelated errors, accommodating lagged covariates and autoregressive structures. This setting occurs in time series applications where responses depend on…

Methodology · Statistics 2025-08-18 Alokesh Manna , Sujit K. Ghosh

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that…

Numerical Analysis · Mathematics 2025-03-19 Shane A. McQuarrie , Anirban Chaudhuri , Karen E. Willcox , Mengwu Guo

In this work we introduce a new framework for multi-objective Bayesian optimisation where the multi-objective functions can only be accessed via choice judgements, such as ``I pick options A,B,C among this set of five options A,B,C,D,E''.…

Machine Learning · Statistics 2021-10-18 Alessio Benavoli , Dario Azzimonti , Dario Piga

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

In experimental design, we are given $n$ vectors in $d$ dimensions, and our goal is to select $k\ll n$ of them to perform expensive measurements, e.g., to obtain labels/responses, for a linear regression task. Many statistical criteria have…

Machine Learning · Computer Science 2019-06-11 Michał Dereziński , Feynman Liang , Michael W. Mahoney

While existing mathematical descriptions can accurately account for phenomena at microscopic scales (e.g. molecular dynamics), these are often high-dimensional, stochastic and their applicability over macroscopic time scales of physical…

Machine Learning · Statistics 2016-09-08 P. S. Koutsourelakis , Elias Bilionis

Concurrent multiscale finite element analysis (FE2) is a powerful approach for high-fidelity modeling of materials for which a suitable macroscopic constitutive model is not available. However, the extreme computational effort associated…

Numerical Analysis · Mathematics 2020-07-16 I. B. C. M. Rocha , P. Kerfriden , F. P. van der Meer

The high-fidelity characterization of soft, tissue-like materials under ultra-high-strain-rate conditions is critical in engineering and medicine. Still, it remains challenging due to limited optical access, sensitivity to initial…

Performing reliability analysis on complex systems is often computationally expensive. In particular, when dealing with systems having high input dimensionality, reliability estimation becomes a daunting task. A popular approach to overcome…

Machine Learning · Statistics 2021-12-22 Navaneeth N. , Souvik Chakraborty

The prohibitive cost of performing Uncertainty Quantification (UQ) tasks with a very large number of input parameters can be addressed, if the response exhibits some special structure that can be discovered and exploited. Several physical…

Computational Physics · Physics 2016-02-16 Ilias Bilionis , Rohit Tripathy , Marcial Gonzalez

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from data collected in…

Machine Learning · Statistics 2020-08-17 Steven Kleinegesse , Michael U. Gutmann

The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the…

Machine Learning · Computer Science 2019-01-28 Xi Chen , Mike Hobson

Machine learning has developed a variety of tools for learning and representing high-dimensional distributions with structure. Recent years have also seen big advances in designing multi-item mechanisms. Akin to overfitting, however, these…

Computer Science and Game Theory · Computer Science 2022-04-01 Yang Cai , Constantinos Daskalakis

Advances in predictive modeling across multiple disciplines have yielded generative models capable of high veracity in predicting macroscopic functional responses of materials. Correspondingly, of interest is the inverse problem of finding…

Disordered Systems and Neural Networks · Physics 2020-08-11 Sergei V. Kalinin , Maxim Ziatdinov , Rama K. Vasudevan

The field of optimal design of linear elastic structures has seen many exciting successes that resulted in new architected materials and structural designs. With the availability of cloud computing, including high-performance computing,…

Computational Engineering, Finance, and Science · Computer Science 2021-02-09 Diab W. Abueidda , Seid Koric , Nahil A. Sobh

How should we gather information to make effective decisions? We address Bayesian active learning and experimental design problems, where we sequentially select tests to reduce uncertainty about a set of hypotheses. Instead of minimizing…

Machine Learning · Computer Science 2014-02-25 Shervin Javdani , Yuxin Chen , Amin Karbasi , Andreas Krause , J. Andrew Bagnell , Siddhartha Srinivasa

Well-established methods for the solution of stochastic partial differential equations (SPDEs) typically struggle in problems with high-dimensional inputs/outputs. Such difficulties are only amplified in large-scale applications where even…

Machine Learning · Statistics 2019-09-10 Constantin Grigo , Phaedon-Stelios Koutsourelakis

We present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a…

Machine Learning · Statistics 2019-01-16 Yibo Yang , Paris Perdikaris