English
Related papers

Related papers: Neural ODEs with stochastic vector field mixtures

200 papers

Control problems frequently arise in scientific and industrial applications, where the objective is to steer a dynamical system from an initial state to a desired target state. Recent advances in deep learning and automatic differentiation…

Systems and Control · Electrical Eng. & Systems 2026-01-09 Lucas Böttcher

Neural ordinary differential equations (NODEs) presented a new paradigm to construct (continuous-time) neural networks. While showing several good characteristics in terms of the number of parameters and the flexibility in constructing…

Machine Learning · Computer Science 2021-06-01 Sheo Yon Jhin , Minju Jo , Taeyong Kong , Jinsung Jeon , Noseong Park

Neural ordinary differential equations (Neural ODEs) is a class of machine learning models that approximate the time derivative of hidden states using a neural network. They are powerful tools for modeling continuous-time dynamical systems,…

Machine Learning · Statistics 2024-07-16 Wenbo Hao

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

We propose a new method to ensure neural ordinary differential equations (ODEs) satisfy output specifications by using invariance set propagation. Our approach uses a class of control barrier functions to transform output specifications…

Machine Learning · Computer Science 2023-06-01 Wei Xiao , Tsun-Hsuan Wang , Ramin Hasani , Mathias Lechner , Yutong Ban , Chuang Gan , Daniela Rus

Neural Combinatorial Optimization approaches have recently leveraged the expressiveness and flexibility of deep neural networks to learn efficient heuristics for hard Combinatorial Optimization (CO) problems. However, most of the current…

Machine Learning · Computer Science 2022-10-04 Sahil Manchanda , Sofia Michel , Darko Drakulic , Jean-Marc Andreoli

Artificial neural networks, widely recognised for their role in machine learning, are now transforming the study of ordinary differential equations (ODEs), bridging data-driven modelling with classical dynamical systems and enabling the…

Optimization and Control · Mathematics 2025-04-15 Dario Izzo , Sebastien Origer , Giacomo Acciarini , Francesco Biscani

Neural networks have recently been used to analyze diverse physical systems and to identify the underlying dynamics. While existing methods achieve impressive results, they are limited by their strong demand for training data and their weak…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Florian Hofherr , Lukas Koestler , Florian Bernard , Daniel Cremers

To derive the hidden dynamics from observed data is one of the fundamental but also challenging problems in many different fields. In this study, we propose a new type of interpretable network called the ordinary differential equation…

Dynamical Systems · Mathematics 2020-10-19 Pipi Hu , Wuyue Yang , Yi Zhu , Liu Hong

We develop and analyze stochastic approximation algorithms for solving nested compositional bi-level optimization problems. These problems involve a nested composition of $T$ potentially non-convex smooth functions in the upper-level, and a…

Optimization and Control · Mathematics 2023-07-12 Xuxing Chen , Krishnakumar Balasubramanian , Saeed Ghadimi

Spectral methods are an important part of scientific computing's arsenal for solving partial differential equations (PDEs). However, their applicability and effectiveness depend crucially on the choice of basis functions used to expand the…

Numerical Analysis · Mathematics 2021-11-10 Brek Meuris , Saad Qadeer , Panos Stinis

Neural or cortical fields are continuous assemblies of mesoscopic models, also called neural masses, of neural populations that are fundamental in the modeling of macroscopic parts of the brain. Neural fields are described by nonlinear…

Dynamical Systems · Mathematics 2010-09-22 Romain Veltz , Olivier Faugeras

Pre-trained vision foundation models have transformed many computer vision tasks. Despite their strong ability to learn discriminative and generalizable features crucial for out-of-distribution (OOD) detection, their impact on this task…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Shizhen Zhao , Jiahui Liu , Xin Wen , Haoru Tan , Xiaojuan Qi

We aim to build the simplest possible model capable of detecting long, noisy contours in a cluttered visual scene. For this, we model the neural dynamics in the primate primary visual cortex in terms of a continuous director field that…

Neurons and Cognition · Quantitative Biology 2014-10-21 Vijay Singh , Martin Tchernookov , Rebecca Butterfield , Ilya Nemenman

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay

Stochastic blockmodels have been proposed as a tool for detecting community structure in networks as well as for generating synthetic networks for use as benchmarks. Most blockmodels, however, ignore variation in vertex degree, making them…

Physics and Society · Physics 2011-03-02 Brian Karrer , M. E. J. Newman

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

Neural operators have emerged as promising surrogate models for solving partial differential equations (PDEs), but struggle to generalise beyond training distributions and are often constrained to a fixed temporal discretisation. This work…

Many scientific problems focus on observed patterns of change or on how to design a system to achieve particular dynamics. Those problems often require fitting differential equation models to target trajectories. Fitting such models can be…

Quantitative Methods · Quantitative Biology 2023-12-27 Steven A. Frank

Accurately following a geometric desired path in a two-dimensional space is a fundamental task for many engineering systems, in particular mobile robots. When the desired path is occluded by obstacles, it is necessary and crucial to…

Systems and Control · Electrical Eng. & Systems 2022-05-26 Weijia Yao , Bohuan Lin , Brian D. O. Anderson , Ming Cao