English
Related papers

Related papers: Rare event failure test case generation in Learnin…

200 papers

Although an ever-growing number of applications employ deep learning based systems for prediction, decision-making, or state estimation, almost no certification processes have been established that would allow such systems to be deployed in…

Machine Learning · Computer Science 2024-03-25 Romeo Valentin

The performance of coverage-based fault localization greatly depends on the quality of test cases being executed. These test cases execute some lines of the given program and determine whether the underlying tests are passed or failed. In…

Software Engineering · Computer Science 2020-06-17 Shuvalaxmi Dass , Xiaozhen Xue , Akbar Siami Namin

This paper addresses the problem of evaluating learning systems in safety critical domains such as autonomous driving, where failures can have catastrophic consequences. We focus on two problems: searching for scenarios when learned agents…

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

This study proposes a safe and sample-efficient reinforcement learning (RL) framework to address two major challenges in developing applicable RL algorithms: satisfying safety constraints and efficiently learning with limited samples. To…

Machine Learning · Computer Science 2023-03-28 Hongyi Chen , Changliu Liu

This paper investigates search in model-based reinforcement learning (RL). Conventional wisdom holds that long-term predictions and compounding errors are the primary obstacles for model-based RL. We challenge this view, showing that search…

Machine Learning · Computer Science 2026-05-25 Wei-Di Chang , Mikael Henaff , Brandon Amos , Gregory Dudek , Scott Fujimoto

The inherent ambiguity of cause and effect boundaries poses a challenge in evaluating causal event extraction tasks. Traditional metrics like Exact Match and BertScore poorly reflect model performance, so we trained evaluation models to…

Computation and Language · Computer Science 2024-06-28 Italo Luis da Silva , Hanqi Yan , Lin Gui , Yulan He

Regions of high-dimensional input spaces that are underrepresented in training datasets reduce machine-learnt classifier performance, and may lead to corner cases and unwanted bias for classifiers used in decision making systems. When these…

Machine Learning · Computer Science 2021-07-08 Colin Paterson , Radu Calinescu , Chiara Picardi

High-fidelity simulation models are widely used to analyze complex stochastic systems, but their high computational cost motivates the development of cheaper surrogate models that approximate the simulation model's input-output…

Machine Learning · Statistics 2026-05-28 Mohammadmahdi Ghasemloo , David J. Eckman , Yaxian Li

Operating under real world conditions is challenging due to the possibility of a wide range of failures induced by execution errors and state uncertainty. In relatively benign settings, such failures can be overcome by retrying or executing…

Robotics · Computer Science 2023-03-10 Shivam Vats , Maxim Likhachev , Oliver Kroemer

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

While multifidelity modeling provides a cost-effective way to conduct uncertainty quantification with computationally expensive models, much greater efficiency can be achieved by adaptively deciding the number of required high-fidelity (HF)…

Class-conditional generative models hold promise to overcome the shortcomings of their discriminative counterparts. They are a natural choice to solve discriminative tasks in a robust manner as they jointly optimize for predictive…

Machine Learning · Computer Science 2020-02-18 Ethan Fetaya , Jörn-Henrik Jacobsen , Will Grathwohl , Richard Zemel

Achieving robust performance is crucial when applying deep reinforcement learning (RL) in safety critical systems. Some of the state of the art approaches try to address the problem with adversarial agents, but these agents often require…

Machine Learning · Computer Science 2022-02-18 Yeeho Song , Jeff Schneider

Solving decision problems in complex, stochastic environments is often achieved by estimating the expected outcome of decisions via Monte Carlo sampling. However, sampling may overlook rare, but important events, which can severely impact…

Machine Learning · Statistics 2023-05-16 Lachlan Gibson , Marcus Hoerger , Dirk Kroese

Traditionally, research in Business Process Management has put a strong focus on centralized and intra-organizational processes. However, today's business processes are increasingly distributed, deviating from a centralized layout, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-10 Michael Borkowski , Walid Fdhila , Matteo Nardelli , Stefanie Rinderle-Ma , Stefan Schulte

Rare events are events that are expected to occur infrequently, or more technically, those that have low probabilities (say, order of $10^{-3}$ or less) of occurring according to a probability model. In the context of uncertainty…

Computation · Statistics 2015-08-21 James L. Beck , Konstantin M. Zuev

Controlling the generative model to adapt a new domain with limited samples is a difficult challenge and it is receiving increasing attention. Recently, methods based on meta-learning have shown promising results for few-shot domain…

Computation and Language · Computer Science 2023-09-07 Pengsen Cheng , Jinqiao Dai , Jiamiao Liu , Jiayong Liu , Peng Jia

We study how a Reinforcement Learning (RL) system can remain sample-efficient when learning from an imperfect model of the environment. This is particularly challenging when the learning system is resource-constrained and in continual…

Machine Learning · Computer Science 2024-07-01 Bradley Burega , John D. Martin , Luke Kapeluck , Michael Bowling

Resource-constrained classification tasks are common in real-world applications such as allocating tests for disease diagnosis, hiring decisions when filling a limited number of positions, and defect detection in manufacturing settings…

Machine Learning · Computer Science 2023-11-22 Danit Shifman Abukasis , Izack Cohen , Xiaochen Xian , Kejun Huang , Gonen Singer