English
Related papers

Related papers: Learning Neural Hybrid Surrogates for Gradient-Bas…

200 papers

As data collection and simulation capabilities advance, multi-modal learning, the task of learning from multiple modalities and sources of data, is becoming an increasingly important area of research. Surrogate models that learn from data…

Machine Learning · Statistics 2026-05-13 Ian Taylor , Juliane Mueller , Julie Bessac

Many real-world systems are modelled using complex ordinary differential equations (ODEs). However, the dimensionality of these systems can make them challenging to analyze. Dimensionality reduction techniques like Proper Orthogonal…

Computational Engineering, Finance, and Science · Computer Science 2025-02-26 Abhishek Ajayakumar , Soumyendu Raha

Gradient-based optimization of engineering designs is limited by non-differentiable components in the typical computer-aided engineering (CAE) workflow, which calculates performance metrics from design parameters. While gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-11-17 Andrin Rehmann , Nolan Black , Josiah Bjorgaard , Alessandro Angioi , Andrei Paleyes , Niklas Heim , Dion Häfner , Alexander Lavin

A surrogate model that accurately predicts distribution system voltages is crucial for reliable smart grid planning and operation. This letter proposes a fixed-point data-driven surrogate modeling method that employs a limited dataset to…

Systems and Control · Electrical Eng. & Systems 2024-01-01 Hoang Tien Nguyen , Young-Jin Kim , Dae-Hyun Choi

We present a numerically tractable formulation for computing the optimal control of the class of hybrid dynamical systems whose trajectories are continuous. Our formulation, an extension of existing relaxed-control techniques for switched…

Optimization and Control · Mathematics 2016-05-26 Tyler Westenbroek , Humberto Gonzalez

We propose a novel family of decision-aware surrogate losses, called Perturbation Gradient (PG) losses, for the predict-then-optimize framework. The key idea is to connect the expected downstream decision loss with the directional…

Machine Learning · Computer Science 2024-11-01 Michael Huang , Vishal Gupta

The basis generation in reduced order modeling usually requires multiple high-fidelity large-scale simulations that could take a huge computational cost. In order to accelerate these numerical simulations, we introduce a FOM/ROM hybrid…

Numerical Analysis · Mathematics 2021-03-17 Lihong Feng , Guosheng Fu , Zhu Wang

Natural gradient methods have been used to optimise the parameters of probability distributions in a variety of settings, often resulting in fast-converging procedures. Unfortunately, for many distributions of interest, computing the…

Machine Learning · Statistics 2024-05-28 Jonathan So , Richard E. Turner

The requirement for identifying accurate system representations has not only been a challenge to fulfill, but it has compromised the scalability of formal methods, as the resulting models are often too complex for effective decision making…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Oliver Schön , Sofie Haesaert , Sadegh Soudjani

One way to analyze Cyber-Physical Systems is by modeling them as hybrid automata. Since reachability analysis for hybrid nonlinear automata is a very challenging and computationally expensive problem, in practice, engineers try to solve the…

Systems and Control · Computer Science 2018-02-15 Shakiba Yaghoubi , Georgios Fainekos

In this paper we solve the problem of finding a trajectory that shows that a given hybrid dynamical system with deterministic evolution leaves a given set of states considered to be safe. The algorithm combines local with global search for…

Systems and Control · Computer Science 2014-06-25 Jan Kuřátko , Stefan Ratschan

We present a data-driven, space-time continuous framework to learn surrogate models for complex physical systems described by advection-dominated partial differential equations. Those systems have slow-decaying Kolmogorov n-width that…

Machine Learning · Computer Science 2023-02-08 Zhong Yi Wan , Leonardo Zepeda-Núñez , Anudhyan Boral , Fei Sha

We present an approach for constructing a surrogate from ensembles of information sources of varying cost and accuracy. The multifidelity surrogate encodes connections between information sources as a directed acyclic graph, and is trained…

Machine Learning · Computer Science 2021-08-25 Alex Gorodetsky , John D. Jakeman , Gianluca Geraci

High-performance scientific simulations, important for comprehension of complex systems, encounter computational challenges especially when exploring extensive parameter spaces. There has been an increasing interest in developing deep…

Machine Learning · Computer Science 2024-07-15 Pradeep Bajracharya , Javier Quetzalcóatl Toledo-Marín , Geoffrey Fox , Shantenu Jha , Linwei Wang

A multi-fidelity surrogate model for highly nonlinear multiscale problems is proposed. It is based on the introduction of two different surrogate models and an adaptive on-the-fly switching. The two concurrent surrogates are built…

Computational Physics · Physics 2019-05-03 Felix Fritzen , Mauricio Fernández , Fredrik Larsson

This paper investigates a sample-based solution to the hybrid mode control problem across non-differentiable and algorithmic hybrid modes. Our approach reasons about a set of hybrid control modes as an integer-based optimization problem…

Robotics · Computer Science 2026-03-09 Yilang Liu , Haoxiang You , Ian Abraham

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

Derivative-Free Optimization (DFO) involves methods that rely solely on evaluations of the objective function. One of the earliest strategies for designing DFO methods is to adapt first-order methods by replacing gradients with…

Optimization and Control · Mathematics 2025-02-12 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

In this paper we propose a hybrid model of a neural oscillator, obtained by partially discretizing a well-known continuous model. Our construction points out that in this case the standard techniques, based on replacing sigmoids with step…

Computational Engineering, Finance, and Science · Computer Science 2012-08-21 Alberto Casagrande , Tommaso Dreossi , Carla Piazza