English
Related papers

Related papers: Neural SDEs as a Unified Approach to Continuous-Do…

200 papers

Accurate forecasting of spatiotemporal data remains challenging due to complex spatial dependencies and temporal dynamics. The inherent uncertainty and variability in such data often render deterministic models insufficient, prompting a…

Machine Learning · Computer Science 2024-11-05 Mingze Gong , Lei Chen , Jia Li

Neural Processes combine the strengths of neural networks and Gaussian processes to achieve both flexible learning and fast prediction in stochastic processes. However, a large class of problems comprises underlying temporal dependency…

Machine Learning · Computer Science 2019-10-29 Gautam Singh , Jaesik Yoon , Youngsung Son , Sungjin Ahn

The neural ordinary differential equation (neural ODE) model has attracted increasing attention in time series analysis for its capability to process irregular time steps, i.e., data are not observed over equally-spaced time intervals. In…

Machine Learning · Computer Science 2021-07-23 Mingyuan Bai , S. T. Boris Choy , Junping Zhang , Junbin Gao

Stochastic Differential Equations (SDEs) serve as a powerful modeling tool in various scientific domains, including systems science, engineering, and ecological science. While the specific form of SDEs is typically known for a given…

Methodology · Statistics 2024-02-27 Xin Cai , Jingyu Yang , Zhibao Li , Hongqiao Wang , Miao Huang

There has been an increasing interest in modeling continuous-time dynamics of temporal graph data. Previous methods encode time-evolving relational information into a low-dimensional representation by specifying discrete layers of neural…

Machine Learning · Computer Science 2022-06-01 Jin Guo , Zhen Han , Zhou Su , Jiliang Li , Volker Tresp , Yuyi Wang

Continuous-depth neural networks can be viewed as deep limits of discrete neural networks whose dynamics resemble a discretization of an ordinary differential equation (ODE). Although important steps have been taken to realize the…

Neural and Evolutionary Computing · Computer Science 2020-12-09 François-Xavier Vialard , Roland Kwitt , Susan Wei , Marc Niethammer

Modeling dynamical systems is crucial across the science and engineering fields for accurate prediction, control, and decision-making. Recently, machine learning (ML) approaches, particularly neural ordinary differential equations (NODEs),…

Systems and Control · Electrical Eng. & Systems 2026-04-20 Fatima Al-Janahi , Min-Seung Ko , Hao Zhu

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

Event cameras, with their high dynamic range and temporal resolution, are ideally suited for object detection, especially under scenarios with motion blur and challenging lighting conditions. However, while most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ziming Wang , Ziling Wang , Huaning Li , Lang Qin , Runhao Jiang , De Ma , Huajin Tang

We develop data-driven models to predict the dynamics of a freely settling sphere in a quiescent Newtonian fluid using experimentally obtained trajectories. Particle tracking velocimetry was used to obtain a comprehensive dataset of…

Stochastic differential equations (SDEs) are used to describe a wide variety of complex stochastic dynamical systems. Learning the hidden physics within SDEs is crucial for unraveling fundamental understanding of these systems' stochastic…

Machine Learning · Computer Science 2022-07-26 Jared O'Leary , Joel A. Paulson , Ali Mesbah

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

The unprecedented availability of large-scale datasets in neuroscience has spurred the exploration of artificial deep neural networks (DNNs) both as empirical tools and as models of natural neural systems. Their appeal lies in their ability…

Computational Engineering, Finance, and Science · Computer Science 2024-03-22 Ahmed ElGazzar , Marcel van Gerven

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

Machine Learning · Computer Science 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

We study how stochastic differential equation (SDE) based ideas can inspire new modifications to existing algorithms for a set of problems in computer vision. Loosely speaking, our formulation is related to both explicit and implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Zihang Meng , Vikas Singh , Sathya N. Ravi

There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). In this paper, we introduce a deep recurrent framework for solving time-dependent PDEs without generating large scale data…

Numerical Analysis · Mathematics 2021-04-21 Cheng Chang , Liu Liu , Tieyong Zeng

Uncertainty quantification is a fundamental yet unsolved problem for deep learning. The Bayesian framework provides a principled way of uncertainty estimation but is often not scalable to modern deep neural nets (DNNs) that have a large…

Machine Learning · Computer Science 2020-08-25 Lingkai Kong , Jimeng Sun , Chao Zhang

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measurements from multiple…

The fields of neural computation and artificial neural networks have developed much in the last decades. Most of the works in these fields focus on implementing and/or learning discrete functions or behavior. However, technical, physical,…

Neural and Evolutionary Computing · Computer Science 2016-06-15 Frieder Stolzenburg , Florian Ruh

Stable diffusion models have ushered in a new era of advancements in image generation, currently reigning as the state-of-the-art approach, exhibiting unparalleled performance. The process of diffusion, accompanied by denoising through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Andras Horvath