English
Related papers

Related papers: Integration of local and global surrogates for fai…

200 papers

Polynomial chaos expansion is a popular way to develop surrogate models for stochastic systems with arbitrary random variables. Standard techniques such as Galerkin projection, stochastic collocation, and least squares approximation, are…

Optimization and Control · Mathematics 2019-09-10 Vedang M. Deshpande , Raktim Bhattacharya

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to…

Machine Learning · Computer Science 2022-03-15 Morteza Ramezani , Weilin Cong , Mehrdad Mahdavi , Mahmut T. Kandemir , Anand Sivasubramaniam

Theoretical results show that Bayesian methods can achieve lower bounds on regret for online logistic regression. In practice, however, such techniques may not be feasible especially for very large feature sets. Various approximations that,…

Machine Learning · Computer Science 2021-01-29 Gil I. Shamir , Wojciech Szpankowski

We are focusing on bound constrained global optimization problems, whose objective functions are computationally expensive black-box functions and have multiple local minima. The recently popular Metric Stochastic Response Surface (MSRS)…

Machine Learning · Statistics 2014-10-24 Yilun Wang , Christine A. Shoemaker

Gaussian Process (GP) models are popular statistical surrogates used for emulating computationally expensive computer simulators. The quality of a GP model fit can be assessed by a goodness of fit measure based on optimized likelihood.…

Computation · Statistics 2013-09-27 Andrew Butler , Thomas D. Humphries , Pritam Ranjan , Ronald D. Haynes

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

Optimization and Control · Mathematics 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss

We propose a data assimilation scheme that produces the analyses for a global and an embedded limited area model simultaneously, considering forecast information from both models. The purpose of the proposed approach is twofold. First, we…

Chaotic Dynamics · Physics 2011-08-20 Young-noh Yoon , Brian R. Hunt , Edward Ott , Istvan Szunyogh

Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distribution, and Monte Carlo sampling…

Numerical Analysis · Mathematics 2022-09-22 S. Ashwin Renganathan , Vishwas Rao , Ionel M. Navon

For stochastic process models, parameter inference is often severely bottlenecked by computationally expensive likelihood functions. Simulation-based inference (SBI) bypasses this restriction by constructing amortized surrogate likelihoods,…

Machine Learning · Statistics 2026-05-26 Alexander Shen , Mikael Kuusela

A surrogate-based topology optimisation algorithm for linear elastic structures under parametric loads and boundary conditions is proposed. Instead of learning the parametric solution of the state (and adjoint) problems or the optimisation…

Numerical Analysis · Mathematics 2025-11-04 Matteo Giacomini , Antonio Huerta

We introduce the concept of Hybrid Surrogate Models (HSMs) -- combining multivariate polynomials with Heavyside functions -- as approximates of functions with finitely many jump discontinuities. We exploit the HSMs for formulating a…

Numerical Analysis · Mathematics 2024-08-06 Juan-Esteban Suarez Cardona , Shashank Reddy , Michael Hecht

We study a family of algorithms, which we refer to as local update methods, that generalize many federated learning and meta-learning algorithms. We prove that for quadratic objectives, local update methods perform stochastic gradient…

Machine Learning · Computer Science 2020-07-03 Zachary Charles , Jakub Konečný

Locality-sensitive hashing (LSH) is a fundamental technique for similarity search and similarity estimation in high-dimensional spaces. The basic idea is that similar objects should produce hash collisions with probability significantly…

Computational Geometry · Computer Science 2017-09-25 Joachim Gudmundsson , Rasmus Pagh

In recent years, surrogate models have been successfully used in likelihood-free inference to decrease the number of simulator evaluations. The current state-of-the-art performance for this task has been achieved by Bayesian Optimization…

Machine Learning · Computer Science 2021-10-06 Alexander Aushev , Henri Pesonen , Markus Heinonen , Jukka Corander , Samuel Kaski

Surrogate models are used for global approximation of responses generated by expensive computer experiments like CFD applications. In this paper, we make use of structural similarities which are shared by a class of related problems. We…

Numerical Analysis · Mathematics 2012-06-20 Benjamin Rosenbaum , Volker Schulz

Deploying large language model (LLM) inference at scale requires jointly selecting base models, provisioning heterogeneous GPUs, configuring parallelism, and distributing workloads under tight latency, accuracy, and budget constraints.…

Machine Learning · Computer Science 2026-04-10 Jiaming Cheng , Duong Tung Nguyen

We introduce a novel machine learning method called the Penalized Profile Support Vector Machine based on the Gabriel edited set for the computation of the probability of failure for a complex system as determined by a threshold condition…

Machine Learning · Statistics 2026-01-30 Jacob Zhu , Donald Estep

The field of simulation optimization (SO) encompasses various methods developed to optimize complex, expensive-to-sample stochastic systems. Established methods include, but are not limited to, ranking-and-selection for finite alternatives…

Machine Learning · Statistics 2025-11-04 Haoting Zhang , Haoxian Chen , Donglin Zhan , Hanyang Zhao , Henry Lam , Wenpin Tang , David Yao , Zeyu Zheng

We propose a stochastic trust-region method for unconstrained nonconvex optimization that incorporates stochastic variance-reduced gradients (SVRG) to accelerate convergence. Unlike classical trust-region methods, the proposed algorithm…

Optimization and Control · Mathematics 2026-01-22 Yuchen Fang , Xinshou Zheng , Javad Lavaei

The goal of this article is to make automatic data assimilation for a landslide tsunami model, given by the coupling between a non-hydrostatic multi-layer shallow-water and a Savage-Hutter granular landslide model for submarine avalanches.…