English
Related papers

Related papers: Deep Surrogate Assisted Generation of Environments

200 papers

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

Machine Learning · Computer Science 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Agent decision making using Reinforcement Learning (RL) heavily relies on either a model or simulator of the environment (e.g., moving in an 8x8 maze with three rooms, playing Chess on an 8x8 board). Due to this dependence, small changes in…

Artificial Intelligence · Computer Science 2023-09-20 Wenjun Li , Pradeep Varakantham , Dexun Li

Discrete-action algorithms have been central to numerous recent successes of deep reinforcement learning. However, applying these algorithms to high-dimensional action tasks requires tackling the combinatorial increase of the number of…

Machine Learning · Computer Science 2019-01-28 Arash Tavakoli , Fabio Pardo , Petar Kormushev

Oilfield development related decisions are made using reservoir simulation-based optimization study in which different production scenarios and well controls are compared. Such simulations are computationally expensive and so surrogate…

Machine Learning · Computer Science 2022-03-01 Ajitabh Kumar

Recently, intelligent scheduling approaches using surrogate models have been proposed to efficiently allocate volatile tasks in heterogeneous fog environments. Advances like deterministic surrogate models, deep neural networks (DNN) and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-17 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

Designing autonomous driving systems requires efficient exploration of large hardware/software configuration spaces under diverse environmental conditions, e.g., with varying traffic, weather, and road layouts. Traditional design space…

Robotics · Computer Science 2025-12-10 Po-An Shih , Shao-Hua Wang , Yung-Che Li , Chia-Heng Tu , Chih-Han Chang

Long-horizon LM agents learn from multi-turn interaction, where a single early mistake can alter the subsequent state distribution and derail the whole trajectory. Existing recipes fall short in complementary ways: supervised fine-tuning…

Machine Learning · Computer Science 2026-05-14 Changhao Li , Rushi Qiang , Jiawei Huang , Chenxiao Gao , Chao Zhang , Niao He , Bo Dai

When designing robots to assist in everyday human activities, it is crucial to enhance user requests with visual cues from their surroundings for improved intent understanding. This process is defined as a multimodal classification task.…

Computation and Language · Computer Science 2025-06-18 Shang-Chi Tsai , Seiya Kawano , Angel Garcia Contreras , Koichiro Yoshino , Yun-Nung Chen

Deep reinforcement learning is a technique for solving problems in a variety of environments, ranging from Atari video games to stock trading. This method leverages deep neural network models to make decisions based on observations of a…

Machine Learning · Computer Science 2022-09-13 Anthony Dowling

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

Live fire creates a dynamic, rapidly changing environment that presents a worthy challenge for deep learning and artificial intelligence methodologies to assist firefighters with scene comprehension in maintaining their situational…

Artificial Intelligence · Computer Science 2021-07-23 Manish Bhattarai , Manel Martinez-Ramon

While deep learning approaches have shown remarkable performance in many imaging tasks, most of these methods rely on availability of large quantities of data. Medical image data, however, is scarce and fragmented. Generative Adversarial…

Image and Video Processing · Electrical Eng. & Systems 2022-06-07 Padmaja Jonnalagedda , Brent Weinberg , Jason Allen , Taejin L. Min , Shiv Bhanu , Bir Bhanu

In differentiable neural architecture search (NAS) algorithms like DARTS, the training set used to update model weight and the validation set used to update model architectures are sampled from the same data distribution. Thus, the uncommon…

Machine Learning · Computer Science 2021-12-02 Ruisi Zhang , Youwei Liang , Sai Ashish Somayajula , Pengtao Xie

Applying deep reinforcement learning (RL) on real systems suffers from slow data sampling. We propose an enhanced generative adversarial network (EGAN) to initialize an RL agent in order to achieve faster learning. The EGAN utilizes the…

Artificial Intelligence · Computer Science 2017-05-30 Vincent Huang , Tobias Ley , Martha Vlachou-Konchylaki , Wenfeng Hu

Surrogate modeling is of great practical significance for parametric differential equation systems. In contrast to classical numerical methods, using physics-informed deep learning methods to construct simulators for such systems is a…

Numerical Analysis · Mathematics 2025-01-03 Xili Wang , Kejun Tang , Jiayu Zhai , Xiaoliang Wan , Chao Yang

Simulation models are widely used in practice to facilitate decision-making in a complex, dynamic and stochastic environment. But they are computationally expensive to execute and optimize, due to lack of analytical tractability. Simulation…

Optimization and Control · Mathematics 2021-06-14 L. Jeff Hong , Xiaowei Zhang

Deep generative models (DGMs) have the potential to revolutionize diagnostic imaging. Generative adversarial networks (GANs) are one kind of DGM which are widely employed. The overarching problem with deploying GANs, and other DGMs, in any…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Rucha Deshpande , Mark A. Anastasio , Frank J. Brooks

Reinforcement learning has steadily improved and outperform human in lots of traditional games since the resurgence of deep neural network. However, these success is not easy to be copied to autonomous driving because the state spaces in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Sen Wang , Daoyuan Jia , Xinshuo Weng

In recent years, increasingly complex computational models are being built to describe physical systems which has led to increased use of surrogate models to reduce computational cost. In problems related to Structural Health Monitoring…

Machine Learning · Computer Science 2024-07-08 Nicholas E. Silionis , Theodora Liangou , Konstantinos N. Anyfantis