English
Related papers

Related papers: Unifying physical systems' inductive biases in neu…

200 papers

This work presents a novel approach for the optimization of dynamic systems on finite-dimensional Lie groups. We rephrase dynamic systems as so-called neural ordinary differential equations (neural ODEs), and formulate the optimization…

Optimization and Control · Mathematics 2024-09-18 Yannik P. Wotte , Federico Califano , Stefano Stramigioli

This work proposes an extension of neural ordinary differential equations (NODEs) by introducing an additional set of ODE input parameters to NODEs. This extension allows NODEs to learn multiple dynamics specified by the input parameter…

Computational Physics · Physics 2021-11-17 Kookjin Lee , Eric J. Parish

Forecasting system behaviour near and across bifurcations is crucial for identifying potential shifts in dynamical systems. While machine learning has recently been used to learn critical transitions and bifurcation structures from data,…

Machine Learning · Computer Science 2025-11-14 Eva van Tegelen , George van Voorn , Ioannis Athanasiadis , Peter van Heijster

We introduce a method for training exactly conservative physics-informed neural networks and physics-informed deep operator networks for dynamical systems. The method employs a projection-based technique that maps a candidate solution…

Machine Learning · Computer Science 2023-11-27 Elsa Cardoso-Bihlo , Alex Bihlo

Much recent interest has focused on the design of optimization algorithms from the discretization of an associated optimization flow, i.e., a system of differential equations (ODEs) whose trajectories solve an associated optimization…

Optimization and Control · Mathematics 2022-02-02 Pedro Cisneros-Velarde , Francesco Bullo

Deep learning has been widely used within learning algorithms for robotics. One disadvantage of deep networks is that these networks are black-box representations. Therefore, the learned approximations ignore the existing knowledge of…

Machine Learning · Computer Science 2023-03-20 Michael Lutter , Jan Peters

The last decade has shown a tremendous success in solving various computer vision problems with the help of deep learning techniques. Lately, many works have demonstrated that learning-based approaches with suitable network architectures…

Machine Learning · Computer Science 2019-08-21 Michael Moeller , Thomas Möllenhoff , Daniel Cremers

For any given neural network architecture a permutation of weights and biases results in the same functional network. This implies that optimization algorithms used to `train' or `learn' the network are faced with a very large number (in…

Optimization and Control · Mathematics 2022-02-22 Harbir Antil , Thomas S. Brown , Rainald Löhner , Fumiya Togashi , Deepanshu Verma

We propose a neural control method to provide guaranteed stabilization for mechanical systems using a novel negative imaginary neural ordinary differential equation (NINODE) controller. Specifically, we employ neural networks with desired…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Kanghong Shi , Ruigang Wang , Ian R. Manchester

Optimal Power Flow (OPF) is a core optimization problem in power system operation and planning, aiming to minimize generation costs while satisfying physical constraints such as power flow equations, generator limits, and voltage limits.…

Machine Learning · Computer Science 2025-12-02 Xuezhi Liu

As power systems transition toward renewable-rich and inverter-dominated operations, accurate time-domain dynamic analysis becomes increasingly critical. Such analysis supports key operational tasks, including transient stability…

Artificial Intelligence · Computer Science 2026-04-17 Haoran Li , Lihao Mai , Chenhan Xiao , Erik Blasch , Yang Weng

Conventional deep learning prioritizes unconstrained optimization, yet biological systems operate under strict metabolic constraints. We propose that these physical constraints shape dynamics to function not as limitations, but as a…

Machine Learning · Computer Science 2026-01-23 Xia Chen

Stable concurrent learning and control of dynamical systems is the subject of adaptive control. Despite being an established field with many practical applications and a rich theory, much of the development in adaptive control for nonlinear…

Optimization and Control · Mathematics 2023-10-03 Nicholas M. Boffi , Jean-Jacques E. Slotine

The article discusses the development of various methods and techniques for initializing and training neural networks with a single hidden layer, as well as training a separable physics-informed neural network consisting of neural networks…

Numerical Analysis · Mathematics 2025-07-08 Vasiliy A. Es'kin , Alexey O. Malkhanov , Mikhail E. Smorkalov

In future power systems, the detailed structure and dynamics may not always be fully known. This is due to an increasing number of distributed energy resources, such as photovoltaic generators, battery storage systems, heat pumps and…

Systems and Control · Electrical Eng. & Systems 2024-11-14 Hannes M. H. Wolf , Christian A. Hans

The time evolution of dynamical systems is frequently described by ordinary differential equations (ODEs), which must be solved for given initial conditions. Most standard approaches numerically integrate ODEs producing a single solution…

Machine Learning · Computer Science 2020-06-26 Cedric Flamant , Pavlos Protopapas , David Sondak

We present a conservative/dissipative time integration scheme for nonlinear mechanical systems. Starting from a weak form, we derive algorithmic forces and velocities that guarantee the desired conservation/dissipation properties. Our…

Numerical Analysis · Mathematics 2019-11-01 Cristian G. Gebhardt , Ignacio Romero , Raimund Rolfes

This paper proposes a neural network hybrid modeling framework for dynamics learning to promote an interpretable, computationally efficient way of dynamics learning and system identification. First, a low-level model will be trained to…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Yejiang Yang , Zihao Mo , Weiming Xiang

Continuous normalizing flows (CNFs) construct invertible mappings between an arbitrary complex distribution and an isotropic Gaussian distribution using Neural Ordinary Differential Equations (neural ODEs). It has not been tractable on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shian Du , Yihong Luo , Wei Chen , Jian Xu , Delu Zeng

Binarized Neural Networks (BNNs) can significantly reduce the inference latency and energy consumption in resource-constrained devices due to their pure-logical computation and fewer memory accesses. However, training BNNs is difficult…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Ruizhou Ding , Ting-Wu Chin , Zeye Liu , Diana Marculescu