English
Related papers

Related papers: A new gradient-free active subspace estimation met…

200 papers

We study nonlinear constrained optimization problems in which only function evaluations of the objective and constraints are available. Existing zeroth-order methods rely on noisy gradient and Jacobian surrogates in high dimensions, making…

Optimization and Control · Mathematics 2026-04-03 Runyu Zhang , Gioele Zardini

We propose randomized subspace gradient methods for high-dimensional constrained optimization. While there have been similarly purposed studies on unconstrained optimization problems, there have been few on constrained optimization problems…

Optimization and Control · Mathematics 2023-07-10 Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

The estimation of rare event or failure probabilities in high dimensions is of interest in many areas of science and technology. We consider problems where the rare event is expressed in terms of a computationally costly numerical model.…

Computation · Statistics 2020-06-11 Felipe Uribe , Iason Papaioannou , Youssef M. Marzouk , Daniel Straub

To address the challenges of reliability analysis in high-dimensional probability spaces, this paper proposes a new metamodeling method that couples active subspace, heteroscedastic Gaussian process, and active learning. The active subspace…

Applications · Statistics 2024-04-11 Jungho Kim , Ziqi Wang , Junho Song

We introduce a novel enhanced sampling approach named OPES flooding for calculating the kinetics of rare events from atomistic molecular dynamics simulation. This method is derived from the On-the-fly-Probability-Enhanced-Sampling (OPES)…

Chemical Physics · Physics 2022-10-31 Dhiman Ray , Narjes Ansari , Valerio Rizzi , Michele Invernizzi , Michele Parrinello

The paper presents a novel methodology to build surrogate models of complicated functions by an active learning-based sequential decomposition of the input random space and construction of localized polynomial chaos expansions, referred to…

Machine Learning · Computer Science 2023-09-19 Lukáš Novák , Michael D. Shields , Václav Sadílek , Miroslav Vořechovský

In this work we propose an adaptive multilevel version of subset simulation to estimate the probability of rare events for complex physical systems. Given a sequence of nested failure domains of increasing size, the rare event probability…

Numerical Analysis · Mathematics 2023-12-13 Daniel Elfverson , Robert Scheichl , Simon Weissmann , F. Alejandro DiazDelaO

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile method to estimate rare events probabilities. It is an iterative procedure on an interacting particle system, where at each step, the $k$ less well-adapted…

Probability · Mathematics 2014-05-07 Charles-Edouard Bréhier , Tony Lelievre , Mathias Rousset

The prohibitive cost of performing Uncertainty Quantification (UQ) tasks with a very large number of input parameters can be addressed, if the response exhibits some special structure that can be discovered and exploited. Several physical…

Computational Physics · Physics 2016-02-16 Ilias Bilionis , Rohit Tripathy , Marcial Gonzalez

We propose a method for the accurate estimation of rare event or failure probabilities for expensive-to-evaluate numerical models in high dimensions. The proposed approach combines ideas from large deviation theory and adaptive importance…

Computation · Statistics 2023-03-28 Shanyin Tong , Georg Stadler

We develop a novel computational method for evaluating the extreme excursion probabilities arising from random initialization of nonlinear dynamical systems. The method uses excursion probability theory to formulate a sequence of Bayesian…

Computational Physics · Physics 2020-06-08 Vishwas Rao , Romit Maulik , Emil Constantinescu , Mihai Anitescu

A probabilistic performance-oriented control design optimization approach is introduced for flight systems. Aiming at estimating rare-event probabilities accurately and efficiently, subset simulation is combined with surrogate modeling…

Systems and Control · Electrical Eng. & Systems 2021-04-20 Dalong Shi , Florian Holzapfel

Although many computational methods for rare event sampling exist, this type of calculation is not usually practical for general nonequilibrium conditions, with macroscopically irreversible dynamics and away from both stationary and…

Mesoscale and Nanoscale Physics · Physics 2015-05-18 Joshua T. Berryman , Tanja Schilling

In this paper, we introduce a new algorithm for rare event estimation based on adaptive importance sampling. We consider a smoothed version of the optimal importance sampling density, which is approximated by an ensemble of interacting…

Computation · Statistics 2023-04-19 Konstantin Althaus , Iason Papaioannou , Elisabeth Ullmann

Estimating the probability of rare failure events is an essential step in the reliability assessment of engineering systems. Computing this failure probability for complex non-linear systems is challenging, and has recently spurred the…

Machine Learning · Computer Science 2022-02-10 P. -R. Wagner , S. Marelli , I. Papaioannou , D. Straub , B. Sudret

Two-Stage Robust Optimization (2RO) with discrete uncertainty is challenging, often rendering exact solutions prohibitive. Scenario reduction alleviates this issue by selecting a small, representative subset of scenarios to enable tractable…

Artificial Intelligence · Computer Science 2026-05-15 Tianjue Lin , Jianan Zhou , Jieyi Bi , Yaoxin Wu , Wen Song , Zhiguang Cao , Jie Zhang

In the field of reliability engineering, the Active learning reliability method combining Kriging and Monte Carlo Simulation (AK-MCS) has been developed and demonstrated to be effective in reliability analysis. However, the performance of…

Computational Engineering, Finance, and Science · Computer Science 2025-05-20 Wenxiong Li , Rong Geng , Suiyin Chen

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

The growing penetration of renewable energy sources (RESs) in active distribution networks (ADNs) leads to complex and uncertain operation scenarios, resulting in significant deviations and risks for the ADN operation. In this study, a…

Neural and Evolutionary Computing · Computer Science 2024-12-12 Ruizhe Yang , Zhongkai Yi , Ying Xu , Dazhi Yang , Zhenghong Tu

Variance reduction methods such as SVRG and SpiderBoost use a mixture of large and small batch gradients to reduce the variance of stochastic gradients. Compared to SGD, these methods require at least double the number of operations per…

Machine Learning · Computer Science 2020-01-28 Melih Elibol , Lihua Lei , Michael I. Jordan