English
Related papers

Related papers: Evolutionary learning of fire fighting strategies

200 papers

We tackle the problem of policy learning from expert demonstrations without a reward function. A central challenge in this space is that these policies fail upon deployment due to issues of distributional shift, environment stochasticity,…

Machine Learning · Computer Science 2024-08-19 Victor Kolev , Rafael Rafailov , Kyle Hatch , Jiajun Wu , Chelsea Finn

We study automated intrusion response and formulate the interaction between an attacker and a defender as an optimal stopping game where attack and defense strategies evolve through reinforcement learning and self-play. The game-theoretic…

Computer Science and Game Theory · Computer Science 2024-04-23 Kim Hammar , Rolf Stadler

Evolution Strategies (ESs) have recently become popular for training deep neural networks, in particular on reinforcement learning tasks, a special form of controller design. Compared to classic problems in continuous direct search, deep…

Neural and Evolutionary Computing · Computer Science 2018-07-03 Nils Müller , Tobias Glasmachers

The observed cooperation on the level of genes, cells, tissues, and individuals has been the object of intense study by evolutionary biologists, mainly because cooperation often flourishes in biological systems in apparent contradiction to…

Populations and Evolution · Quantitative Biology 2010-10-21 Dimitris Iliopoulos , Arend Hintze , Christoph Adami

How should dispersal strategies be chosen to increase the likelihood of survival of a species? We obtain the answer for the spatially extended versions of three well-known models of two competing species with unequal diffusivities. Though…

Populations and Evolution · Quantitative Biology 2020-07-08 Tapas Singha , Prasad Perlekar , Mustansir Barma

Suppose we have a network that is represented by a graph $G$. Potentially a fire (or other type of contagion) might erupt at some vertex of $G$. We are able to respond to this outbreak by establishing a firebreak at $k$ other vertices of…

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

In statistical modelling the biggest threat is concept drift which makes the model gradually showing deteriorating performance over time. There are state of the art methodologies to detect the impact of concept drift, however general…

Machine Learning · Computer Science 2018-10-09 Kumarjit Pathak , Jitin Kapila

The vulnerability of deep neural network models to adversarial example attacks is a practical challenge in many artificial intelligence applications. A recent line of work shows that the use of randomization in adversarial training is the…

Machine Learning · Computer Science 2023-06-30 Jiahao Xie , Chao Zhang , Weijie Liu , Wensong Bai , Hui Qian

Over the past decades, the increase in both frequency and intensity of large-scale wildfires due to climate change has emerged as a significant natural threat. The pressing need to design resilient landscapes capable of withstanding such…

There are two distinct approaches to solving reinforcement learning problems, namely, searching in value function space and searching in policy space. Temporal difference methods and evolutionary algorithms are well-known examples of these…

Machine Learning · Computer Science 2011-06-02 J. J. Grefenstette , D. E. Moriarty , A. C. Schultz

The performance of evolutionary algorithms can be heavily undermined when constraints limit the feasible areas of the search space. For instance, while Covariance Matrix Adaptation Evolution Strategy is one of the most efficient algorithms…

Neural and Evolutionary Computing · Computer Science 2018-10-08 A. Maesani , G. Iacca , D. Floreano

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

In the Firefighter problem, a fire breaks out at a vertex of a graph and at each subsequent time step, the firefighter chooses a vertex to protect and then the fire spreads from each burned vertex to every unprotected neighbour. The problem…

Combinatorics · Mathematics 2021-08-03 Margaret-Ellen Messinger , Spencer Yarnell

A dynamic graph algorithm is a data structure that answers queries about a property of the current graph while supporting graph modifications such as edge insertions and deletions. Prior work has shown strong conditional lower bounds for…

Data Structures and Algorithms · Computer Science 2023-01-30 Monika Henzinger , Ami Paz , A. R. Sricharan

We consider a perimeter defense problem in a rooted full tree graph environment in which a single defending vehicle seeks to defend a set of specified vertices, termed as the perimeter from mobile intruders that enter the environment…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Richard L. Frost , Shaunak D. Bopardikar

Existing drift detection methods focus on designing sensitive test statistics. They treat the detection threshold as a fixed hyperparameter, set once to balance false alarms and late detections, and applied uniformly across all datasets and…

Machine Learning · Computer Science 2025-11-14 Pengqian Lu , Jie Lu , Anjin Liu , En Yu , Guangquan Zhang

We discuss a new optimization strategy, which considerably improves the effectivity of evolutionary algorithms applied to a certain class of optimization problems. The basic principle is to solve first a simpler related problem, which is…

Disordered Systems and Neural Networks · Physics 2007-05-23 Volkhard Buchholtz , Thorsten Poeschel

In recent years, significant progress has been made on algorithms for learning optimal decision trees, primarily in the context of binary features. Extending these methods to continuous features remains substantially more challenging due to…

Machine Learning · Computer Science 2026-01-22 Harold Kiossou , Pierre Schaus , Siegfried Nijssen

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt