English
Related papers

Related papers: Semantic Segmentation using Neural Ordinary Differ…

200 papers

We analyze Neural Ordinary Differential Equations (NODEs) from a control theoretical perspective to address some of the main properties and paradigms of Deep Learning (DL), in particular, data classification and universal approximation.…

Optimization and Control · Mathematics 2021-04-13 Domènec Ruiz-Balet , Enrique Zuazua

A method for approximating sixth-order ordinary differential equations is proposed, which utilizes a deep learning feedforward artificial neural network, referred to as a neural solver. The efficacy of this unsupervised machine learning…

Numerical Analysis · Mathematics 2025-09-16 Janavi Bhalala , B. Veena S. N. Rao

In response to the growing importance of geospatial data, its analysis including semantic segmentation becomes an increasingly popular task in computer vision today. Convolutional neural networks are powerful visual models that yield…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Alexey Bokhovkin , Evgeny Burnaev

Recent research in deep learning has shown that neural networks can learn differential equations governing dynamical systems. In this paper, we adapt this concept to Virtual Analog (VA) modeling to learn the ordinary differential equations…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-09 Jan Wilczek , Alec Wright , Vesa Välimäki , Emanuël Habets

In recent years, deep neural networks have defined the state-of-the-art in semantic segmentation where their predictions are constrained to a predefined set of semantic classes. They are to be deployed in applications such as automated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Kira Maag , Tobias Riedlinger

Semantic segmentation is a vital problem in computer vision. Recently, a common solution to semantic segmentation is the end-to-end convolution neural network, which is much more accurate than traditional methods.Recently, the decoders…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Hao Guo , Hongbiao Si , Guilin Jiang , Wei Zhang , Zhiyan Liu , Xuanyi Zhu , Xulong Zhang , Yang Liu

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

Machine Learning · Computer Science 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

In this work, we investigate a method for simulation-free training of Neural Ordinary Differential Equations (NODEs) for learning deterministic mappings between paired data. Despite the analogy of NODEs as continuous-depth residual…

Machine Learning · Computer Science 2024-10-31 Semin Kim , Jaehoon Yoo , Jinwoo Kim , Yeonwoo Cha , Saehoon Kim , Seunghoon Hong

Classical close-set semantic segmentation networks have limited ability to detect out-of-distribution (OOD) objects, which is important for safety-critical applications such as autonomous driving. Incrementally learning these OOD objects…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Jun Cen , Peng Yun , Junhao Cai , Michael Yu Wang , Ming Liu

Neural differential equations may be trained by backpropagating gradients via the adjoint method, which is another differential equation typically solved using an adaptive-step-size numerical differential equation solver. A proposed step is…

Machine Learning · Computer Science 2021-05-11 Patrick Kidger , Ricky T. Q. Chen , Terry Lyons

Ordinary differential equation (ODE) models of gradient-based optimization methods can provide insights into the dynamics of learning and inspire the design of new algorithms. Unfortunately, this thought-provoking perspective is weakened by…

Optimization and Control · Mathematics 2019-11-14 Antonio Orvieto , Aurelien Lucchi

Research in quantum machine learning has recently proliferated due to the potential of quantum computing to accelerate machine learning. An area of machine learning that has not yet been explored is neural ordinary differential equation…

Quantum Physics · Physics 2025-06-27 Nicholas S. DiBrita , Jason Han , Tirthak Patel

Semantic segmentation methods can not directly identify abnormal objects in images. Anomaly Segmentation algorithm from this realistic setting can distinguish between in-distribution objects and Out-Of-Distribution (OOD) objects and output…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Yiqing Hao , Yi Jin , Gaoyun An

We propose heavy ball neural ordinary differential equations (HBNODEs), leveraging the continuous limit of the classical momentum accelerated gradient descent, to improve neural ODEs (NODEs) training and inference. HBNODEs have two…

Machine Learning · Computer Science 2021-10-12 Hedi Xia , Vai Suliafu , Hangjie Ji , Tan M. Nguyen , Andrea L. Bertozzi , Stanley J. Osher , Bao Wang

We propose an algebraic method that finds a sequence of functions that exponentially approach the solution of any second-order ordinary differential equation (ODE) with any boundary conditions. We define an extended ODE (eODE) composed of a…

Numerical Analysis · Mathematics 2022-06-07 Pedro L. Garrido

Neural Ordinary Differential Equations (NODEs) are a new class of models that transform data continuously through infinite-depth architectures. The continuous nature of NODEs has made them particularly suitable for learning the dynamics of…

Machine Learning · Computer Science 2020-10-22 Alexander Norcliffe , Cristian Bodnar , Ben Day , Nikola Simidjievski , Pietro Liò

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

Methodology · Statistics 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

We present a novel model Graph Neural Stochastic Differential Equations (Graph Neural SDEs). This technique enhances the Graph Neural Ordinary Differential Equations (Graph Neural ODEs) by embedding randomness into data representation using…

Machine Learning · Computer Science 2023-08-25 Richard Bergna , Felix Opolka , Pietro Liò , Jose Miguel Hernandez-Lobato

Inspired by the ubiquitous use of differential equations to model continuous dynamics across diverse scientific and engineering domains, we propose a novel and intuitive approach to continuous sequence modeling. Our method interprets…

Machine Learning · Computer Science 2025-02-03 Macheng Shen , Chen Cheng

Semantic segmentation and instance level segmentation made substantial progress in recent years due to the emergence of deep neural networks (DNNs). A number of deep architectures with Convolution Neural Networks (CNNs) were proposed that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Pulak Purkait , Christopher Zach , Ian Reid