English
Related papers

Related papers: Certifiable Deep Importance Sampling for Rare-Even…

200 papers

Recently, there has been growth in providers of speech transcription services enabling others to leverage technology they would not normally be able to use. As a result, speech-enabled solutions have become commonplace. Their success…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-17 Alexandros Kastanos , Anton Ragni , Mark Gales

Several scenarios require the optimization of non-convex black-box functions, that are noisy expensive to evaluate functions with unknown analytical expression, whose gradients are hence not accessible. For example, the hyper-parameter…

Machine Learning · Computer Science 2025-02-12 Eduardo C. Garrido-Merchán

Simulation based or dynamic probabilistic risk assessment methodologies were primarily developed for proving a more realistic and complete representation of complex systems accident response. Such simulation based methodologies have proven…

Systems and Control · Electrical Eng. & Systems 2021-09-30 Parhizkar Tarannom , Mosleh Ali

To reduce the cost of estimating the probability of a rare event involving a very large number of random parameters, we propose a new strategy for dimension reduction coupled with a surrogate model for the expensive part of the algorithm.…

Computation · Statistics 2026-04-01 Valentin Breaz , Miguel Munoz Zuniga , Olivier Zahm , Richard Wilkinson

Transition path sampling is a method for estimating the rates of rare events in molecular systems based on the gradual transformation of a path distribution containing a small fraction of reactive trajectories into a biased distribution in…

Statistical Mechanics · Physics 2015-10-28 Pierre Terrier , Mihai-Cosmin Marinica , Manuel Athènes

This paper addresses risk averse constrained optimization problems where the objective and constraint functions can only be computed by a blackbox subject to unknown uncertainties. To handle mixed aleatory/epistemic uncertainties, the…

Optimization and Control · Mathematics 2023-10-18 Charles Audet , Jean Bigeon , Romain Couderc , Michael Kokkolaras

Decision support systems are essential for maintaining grid stability in low-carbon power systems, such as wind power plants, by providing real-time alerts to control room operators regarding potential events, including Wind Power Ramp…

As black box models and pretrained models gain traction in time series applications, understanding and explaining their predictions becomes increasingly vital, especially in high-stakes domains where interpretability and trust are…

Machine Learning · Computer Science 2026-01-16 Khalid Oublal , Quentin Bouniot , Qi Gan , Stephan Clémençon , Zeynep Akata

Despite our best efforts, deep learning models remain highly vulnerable to even tiny adversarial perturbations applied to the inputs. The ability to extract information from solely the output of a machine learning model to craft adversarial…

Machine Learning · Computer Science 2023-03-27 Viet Quoc Vo , Ehsan Abbasnejad , Damith C. Ranasinghe

In this paper, we employ a Bayesian approach to uncertainty quantification of computer simulations used to assess the probability of rare events. As a case study, we assess the reliability of an Earth reentry capsule for sample return…

Applications · Statistics 2025-07-11 Dawn L. Sanderson , Amy Braverman , Giuseppe Cataldo , Ralph C. Smith , Richard L. Smith

Rare events in molecular dynamics are often related to noise-induced transitions between different macroscopic states (e.g., in protein folding). A common feature of these rare transitions is that they happen on timescales that are on…

Probability · Mathematics 2026-01-06 Carsten Hartmann , Annika Jöster , Christof Schütte , Alexander Sikorski , Marcus Weber

This paper presents a novel method for rare event detection from an image pair with class-imbalanced datasets. A straightforward approach for event detection tasks is to train a detection network from a large-scale dataset in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Ryuhei Hamaguchi , Ken Sakurada , Ryosuke Nakamura

Note: This paper describes an older version of DeepLIFT. See https://arxiv.org/abs/1704.02685 for the newer version. Original abstract follows: The purported "black box" nature of neural networks is a barrier to adoption in applications…

Machine Learning · Computer Science 2017-04-12 Avanti Shrikumar , Peyton Greenside , Anna Shcherbina , Anshul Kundaje

Impulsive signature enhancement (ISE) is an important topic in the monitoring of rotating machinery and many different methods have been proposed. Even though, the topic of how to leverage these ISE techniques to improve the data quality in…

Applications · Statistics 2018-08-13 Xiaodong Jia , Ming Zhao , Haoshu Cai , Jay Lee

This is a method for discrete event simulation specified by survival analysis. It presents a sequence of steps. First, hazard rates from survival analysis specify the rates of a set of counting processes. Second, those counting processes…

Computation · Statistics 2016-10-14 Andrew J. Dolgert

This article provides a critical review of the main methods used to produce conservative estimators of probabilities of rare events, or critical failures, for reliability and certification studies in the broadest sense. These probabilities…

Statistics Theory · Mathematics 2024-03-27 Nicolas Bousquet

In this paper, we propose a sequential directional importance sampling (SDIS) method for rare event estimation. SDIS expresses a small failure probability in terms of a sequence of auxiliary failure probabilities, defined by magnifying the…

Computation · Statistics 2022-02-14 Kai Cheng , Iason Papaioannou , Zhenzhou Lu , Xiaobo Zhang , Yanping Wang

Disaggregated evaluation -- estimation of performance of a machine learning model on different subpopulations -- is a core task when assessing performance and group-fairness of AI systems. A key challenge is that evaluation data is scarce,…

Machine Learning · Computer Science 2024-11-18 Mikhail Khodak , Lester Mackey , Alexandra Chouldechova , Miroslav Dudík

The ability of neural networks to perform robotic perception and control tasks such as depth and optical flow estimation, simultaneous localization and mapping (SLAM), and automatic control has led to their widespread adoption in recent…

Machine Learning · Computer Science 2025-04-29 Amogh Joshi , Adarsh Kumar Kosta , Kaushik Roy

We develop a new algorithm for the estimation of rare event probabilities associated with the steady-state of a Markov stochastic process with continuous state space $\mathbb R^d$ and discrete time steps (i.e. a discrete-time $\mathbb…

Probability · Mathematics 2019-04-09 Krzysztof Bisewski , Daan Crommelin , Michel Mandjes