English
Related papers

Related papers: Adaptive Sampling-Based Bi-Fidelity Stochastic Tru…

200 papers

We consider convex, black-box objective functions with additive or multiplicative noise with a high-dimensional parameter space and a data space of lower dimension, where gradients of the map exist, but may be inaccessible. We investigate…

Optimization and Control · Mathematics 2021-01-20 Jordan R. Hall , Varis Carey

This paper is concerned with particle filtering for $\alpha$-stable stochastic volatility models. The $\alpha$-stable distribution provides a flexible framework for modeling asymmetry and heavy tails, which is useful when modeling financial…

Computation · Statistics 2014-05-20 Emilian Vankov , Katherine B. Ensor

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

In this paper, we study a fixed-confidence, fixed-tolerance formulation of a class of stochastic bi-level optimization problems, where the upper-level problem selects from a finite set of systems based on a performance metric, and the…

Optimization and Control · Mathematics 2025-01-20 Yuhao Wang , Seong-Hee Kim , Enlu Zhou

Bayesian optimization (BO) is a sequential optimization strategy that is increasingly employed in a wide range of areas including materials design. In real world applications, acquiring high-fidelity (HF) data through physical experiments…

Machine Learning · Computer Science 2023-09-07 Zahra Zanjani Foumani , Amin Yousefpour , Mehdi Shishehbor , Ramin Bostanabad

The objective of this study is to establish a gradient-free topology optimization framework that facilitates more global solution searches to avoid entrapping in undesirable local optima, especially in problems with strong non-linearity.…

Optimization and Control · Mathematics 2025-03-07 Hiroki Kawabe , Kentaro Yaji , Yuichiro Aoki

This study develops a hybrid ensemble-variational approach for solving data assimilation problems. The method, called TR-4D-EnKF, is based on a trust region framework and consists of three computational steps. First an ensemble of model…

Numerical Analysis · Computer Science 2015-02-03 Elias D. Nino , Adrian Sandu

In this paper, a third-order time adaptive algorithm with less computation, low complexity is provided for shale reservoir model based on coupled fluid flow with porous media flow. The algorithm combines the three-step linear time filters…

Numerical Analysis · Mathematics 2024-07-26 Jian Li , Lele Chen , Yi Qin , Zhangxin Chen

Source-free domain adaptation (SFDA) aims to adapt a model trained on labelled data in a source domain to unlabelled data in a target domain without access to the source-domain data during adaptation. Existing methods for SFDA leverage…

Machine Learning · Computer Science 2022-03-18 Cian Eastwood , Ian Mason , Christopher K. I. Williams , Bernhard Schölkopf

We propose a training-free conditional sampling method for flow matching models based on importance sampling. Because a na\"ive application of importance sampling suffers from weight degeneracy in high-dimensional settings, we modify and…

Machine Learning · Statistics 2026-02-16 Qianqian Qu , Jun S. Liu

Solving high-dimensional Fokker-Planck (FP) equations is a challenge in computational physics and stochastic dynamics, due to the curse of dimensionality (CoD) and unbounded domains. Existing deep learning approaches, such as…

Computational Physics · Physics 2026-03-25 Xiaolong Wu , Qifeng Liao

In this paper, we present a novel derivative-free optimization framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning involve settings…

Optimization and Control · Mathematics 2024-04-19 Raghu Bollapragada , Cem Karamanli , Stefan M. Wild

While multifidelity modeling provides a cost-effective way to conduct uncertainty quantification with computationally expensive models, much greater efficiency can be achieved by adaptively deciding the number of required high-fidelity (HF)…

Models of stochastic processes are widely used in almost all fields of science. Theory validation, parameter estimation, and prediction all require model calibration and statistical inference using data. However, data are almost always…

Computation · Statistics 2022-09-07 David J. Warne , Thomas P. Prescott , Ruth E. Baker , Matthew J. Simpson

Bayesian optimization (BO) is increasingly employed in critical applications such as materials design and drug discovery. An increasingly popular strategy in BO is to forgo the sole reliance on high-fidelity data and instead use an ensemble…

Machine Learning · Statistics 2023-03-22 Zahra Zanjani Foumani , Mehdi Shishehbor , Amin Yousefpour , Ramin Bostanabad

Stochastic minimax optimization has drawn much attention over the past decade due to its broad applications in machine learning, signal processing and game theory. In some applications, the probability distribution of uncertainty depends on…

Optimization and Control · Mathematics 2025-09-17 Yan Gao , Yongchao Liu , Zili Luo

In Federated Learning (FL), a number of clients or devices collaborate to train a model without sharing their data. Models are optimized locally at each client and further communicated to a central hub for aggregation. While FL is an…

Machine Learning · Computer Science 2023-07-25 Farshid Varno , Marzie Saghayi , Laya Rafiee Sevyeri , Sharut Gupta , Stan Matwin , Mohammad Havaei

This paper studies the performative prediction problem where a learner aims to minimize the expected loss with a decision-dependent data distribution. Such setting is motivated when outcomes can be affected by the prediction model, e.g., in…

Optimization and Control · Mathematics 2024-05-24 Haitong Liu , Qiang Li , Hoi-To Wai

In this paper, we present and analyze a linear fully discrete second order scheme with variable time steps for the phase field crystal equation. More precisely, we construct a linear adaptive time stepping scheme based on the second order…

Numerical Analysis · Mathematics 2023-05-30 Dianming Hou , Zhonghua Qiao

We present an adaptive trust-region method for unconstrained optimization that allows inexact solutions to the trust-region subproblems. Our method is a simple variant of the classical trust-region method of \citet{sorensen1982newton}. The…

Optimization and Control · Mathematics 2025-08-27 Fadi Hamad , Oliver Hinder