English
Related papers

Related papers: Deep Surrogate Assisted Generation of Environments

200 papers

Diffusion planners are a strong approach for offline reinforcement learning, but they can fail when value-guided selection favours trajectories that score well yet are locally inconsistent with the environment dynamics, resulting in brittle…

Machine Learning · Computer Science 2026-03-04 Yuan Lu , Dongqi Han , Yansen Wang , Dongsheng Li

Sample efficiency in the face of computationally expensive simulations is a common concern in surrogate modeling. Current strategies to minimize the number of samples needed are not as effective in simulated environments with wide state…

Machine Learning · Computer Science 2025-09-03 Julen Cestero , Marco Quartulli , Marcello Restelli

Recently, multiagent deep reinforcement learning (DRL) has received increasingly wide attention. Existing multiagent DRL algorithms are inefficient when facing with the non-stationarity due to agents update their policies simultaneously in…

Multiagent Systems · Computer Science 2018-04-17 Yan Zheng , Jianye Hao , Zongzhang Zhang

Deep reinforcement learning (RL) algorithms frequently require prohibitive interaction experience to ensure the quality of learned policies. The limitation is partly because the agent cannot learn much from the many low-quality trials in…

Machine Learning · Computer Science 2020-04-24 Keting Lu , Shiqi Zhang , Xiaoping Chen

Physical models classically involved Partial Differential equations (PDE) and depending of their underlying complexity and the level of accuracy required, and known to be computationally expensive to numerically solve them. Thus, an idea…

Machine Learning · Computer Science 2025-05-14 Chetra Mang , Axel TahmasebiMoradi , David Danan , Mouadh Yagoubi

Query rewriting is pivotal for enhancing dense retrieval, yet current methods demand large-scale supervised data or suffer from inefficient reinforcement learning (RL) exploration. In this work, we first establish that guiding Large…

Artificial Intelligence · Computer Science 2025-07-29 Teng Wang , Hailei Gong , Changwang Zhang , Jun Wang

We study the problem of generating arbitrarily large environments to improve the throughput of multi-robot systems. Prior work proposes Quality Diversity (QD) algorithms as an effective method for optimizing the environments of automated…

Robotics · Computer Science 2023-10-31 Yulun Zhang , Matthew C. Fontaine , Varun Bhatt , Stefanos Nikolaidis , Jiaoyang Li

Simulation of population dynamics is a central research theme in computational biology, which contributes to understanding the interactions between predators and preys. Conventional mathematical tools of this theme, however, are incapable…

Multiagent Systems · Computer Science 2020-02-11 Jun Yamada , John Shawe-Taylor , Zafeirios Fountas

Many physics and engineering applications demand Partial Differential Equations (PDE) property evaluations that are traditionally computed with resource-intensive high-fidelity numerical solvers. Data-driven surrogate models provide an…

Machine Learning · Computer Science 2023-12-18 Raphaël Pestourie , Youssef Mroueh , Chris Rackauckas , Payel Das , Steven G. Johnson

DBSCAN, a well-known density-based clustering algorithm, has gained widespread popularity and usage due to its effectiveness in identifying clusters of arbitrary shapes and handling noisy data. However, it encounters challenges in producing…

Machine Learning · Computer Science 2025-05-09 Hao Peng , Xiang Huang , Shuo Sun , Ruitong Zhang , Philip S. Yu

Generative models can serve as surrogates for some real data sources by creating synthetic training datasets, but in doing so they may transfer biases to downstream tasks. We focus on protecting quality and diversity when generating…

Computers and Society · Computer Science 2025-09-08 Allen Chang , Matthew C. Fontaine , Serena Booth , Maja J. Matarić , Stefanos Nikolaidis

The development of a reliable and robust surrogate model is often constrained by the dimensionality of the problem. For a system with high-dimensional inputs/outputs (I/O), conventional approaches usually use a low-dimensional manifold to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-01 Xihaier Luo , Ahsan Kareem

Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training.…

Machine Learning · Computer Science 2024-06-17 Samuel Garcin , James Doran , Shangmin Guo , Christopher G. Lucas , Stefano V. Albrecht

World models are increasingly pivotal in interpreting and simulating the rules and actions of complex environments. Genie, a recent model, excels at learning from visually diverse environments but relies on costly human-collected data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Naser Kazemi , Nedko Savov , Danda Paudel , Luc Van Gool

Many environments contain numerous available niches of variable value, each associated with a different local optimum in the space of behaviors (policy space). In such situations it is often difficult to design a learning process capable of…

Artificial Intelligence · Computer Science 2023-02-06 Peter Sunehag , Alexander Sasha Vezhnevets , Edgar Duéñez-Guzmán , Igor Mordach , Joel Z. Leibo

Learning robust manipulation policies typically requires large and diverse datasets, the collection of which is time-consuming, labor-intensive, and often impractical for dynamic environments. In this work, we introduce DynaMimicGen (D-MG),…

We introduce Diffusion Augmented Agents (DAAG), a novel framework that leverages large language models, vision language models, and diffusion models to improve sample efficiency and transfer learning in reinforcement learning for embodied…

Machine Learning · Computer Science 2024-07-31 Norman Di Palo , Leonard Hasenclever , Jan Humplik , Arunkumar Byravan

In many mechanistic medical, biological, physical and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs) can make simulations impractically slow. Biological models require the…

Soft Condensed Matter · Physics 2021-02-11 J. Quetzalcóatl Toledo-Marín , Geoffrey Fox , James P. Sluka , James A. Glazier

Solving sequential decision prediction problems, including those in imitation learning settings, requires mitigating the problem of covariate shift. The standard approach, DAgger, relies on capturing expert behaviour in all states that the…

Machine Learning · Computer Science 2019-06-20 Paul Budnarain , Renato Ferreira Pinto Junior , Ilan Kogan

With the breakthrough of AlphaGo, deep reinforcement learning becomes a recognized technique for solving sequential decision-making problems. Despite its reputation, data inefficiency caused by its trial and error learning mechanism makes…

Machine Learning · Computer Science 2024-04-01 Qiyue Yin , Tongtong Yu , Shengqi Shen , Jun Yang , Meijing Zhao , Kaiqi Huang , Bin Liang , Liang Wang