English
Related papers

Related papers: Learning Neural Hybrid Surrogates for Gradient-Bas…

200 papers

In physics and engineering, many processes are modeled using non-differentiable black-box simulators, making the optimization of such functions particularly challenging. To address such cases, inspired by the Gradient Theorem, we propose…

We propose a novel method for gradient-based optimization of black-box simulators using differentiable local surrogate models. In fields such as physics and engineering, many processes are modeled with non-differentiable simulators with…

Machine Learning · Computer Science 2020-09-30 Sergey Shirobokov , Vladislav Belavin , Michael Kagan , Andrey Ustyuzhanin , Atılım Güneş Baydin

This paper proposes a technique for training a neural network by minimizing a surrogate loss that approximates the target evaluation metric, which may be non-differentiable. The surrogate is learned via a deep embedding where the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yash Patel , Tomas Hodan , Jiri Matas

We propose a methodology for falsifying safety properties in robotic vehicle systems through property-guided reduction and surrogate execution. By isolating only the control logic and physical dynamics relevant to a given specification, we…

Cryptography and Security · Computer Science 2025-12-03 Nazmus Shakib Sayom , Luis Garcia

We present an algorithm that quickly finds falsifying inputs for hybrid systems, i.e., inputs that steer the system towards violation of a given temporal logic requirement. Our method is based on a probabilistically directed search of an…

Systems and Control · Computer Science 2018-12-12 Gidon Ernst , Sean Sedwards , Zhenya Zhang , Ichiro Hasuo

Bayesian Optimization is a popular tool for tuning algorithms in automatic machine learning (AutoML) systems. Current state-of-the-art methods leverage Random Forests or Gaussian processes to build a surrogate model that predicts algorithm…

Machine Learning · Computer Science 2021-01-08 Jeroen van Hoof , Joaquin Vanschoren

Simulation-based falsification is a practical testing method to increase confidence that the system will meet safety requirements. Because full-fidelity simulations can be computationally demanding, we investigate the use of simulators with…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

Optimization and control of complex unsteady flows remains an important challenge due to the large cost of performing a function evaluation, i.e. a full computational fluid dynamics (CFD) simulation. Reducing the number of required function…

Fluid Dynamics · Physics 2023-01-31 A. Quirós Rodríguez , M. Fosas de Pando , T. Sayadi

Training spiking neural networks to approximate universal functions is essential for studying information processing in the brain and for neuromorphic computing. Yet the binary nature of spikes poses a challenge for direct gradient-based…

Neural and Evolutionary Computing · Computer Science 2024-11-19 Julia Gygax , Friedemann Zenke

The discovery of conservation laws is a cornerstone of scientific progress. However, identifying these invariants from observational data remains a significant challenge. We propose a hybrid framework to automate the discovery of conserved…

Machine Learning · Computer Science 2025-11-04 Vivan Doshi

Crash simulations play an essential role in improving vehicle safety, design optimization, and injury risk estimation. Unfortunately, numerical solutions of such problems using state-of-the-art high-fidelity models require significant…

Machine Learning · Computer Science 2024-02-16 Jonas Kneifl , Jörg Fehr , Steven L. Brunton , J. Nathan Kutz

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

We present a hybrid sampling-surrogate approach for reducing the computational expense of uncertainty quantification in nonlinear dynamical systems. Our motivation is to enable rapid uncertainty quantification in complex mechanical systems…

Computation · Statistics 2022-01-27 Hang Yang , Yuji Fujii , K. W. Wang , Alex A. Gorodetsky

Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Michael Fischer , Tobias Ritschel

The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the…

Machine Learning · Computer Science 2019-01-28 Xi Chen , Mike Hobson

Recent works in learning-integrated optimization have shown promise in settings where the optimization problem is only partially observed or where general-purpose optimizers perform poorly without expert tuning. By learning an optimizer…

Machine Learning · Computer Science 2023-11-06 Arman Zharmagambetov , Brandon Amos , Aaron Ferber , Taoan Huang , Bistra Dilkina , Yuandong Tian

High-fidelity models are essential for accurately capturing nonlinear system dynamics. However, simulation of these models is often computationally too expensive and, due to their complexity, they are not directly suitable for analysis,…

Systems and Control · Electrical Eng. & Systems 2025-09-05 E. Javier Olucha , Rajiv Singh , Amritam Das , Roland Tóth

Reduced-order models that accurately abstract high fidelity models and enable faster simulation is vital for real-time, model-based diagnosis applications. In this paper, we outline a novel hybrid modeling approach that combines machine…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Ion Matei , Johan de Kleer , Alexander Feldman , Rahul Rai , Souma Chowdhury

Dynamics model learning deals with the task of inferring unknown dynamics from measurement data and predicting the future behavior of the system. A typical approach to address this problem is to train recurrent models. However, predictions…

Machine Learning · Computer Science 2024-01-31 Katharina Ensinger , Sebastian Ziesche , Sebastian Trimpe

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke