English
Related papers

Related papers: Wavelet-Enhanced Neural ODE and Graph Attention fo…

200 papers

Air Quality Monitoring and Forecasting has been a popular research topic in recent years. Recently, data-driven approaches for air quality forecasting have garnered significant attention, owing to the availability of well-established data…

Machine Learning · Computer Science 2023-08-01 Jingwei Zuo , Wenbin Li , Michele Baldo , Hakim Hacid

The Optimal Power Flow (OPF) problem is pivotal for power system operations, guiding generator output and power distribution to meet demand at minimized costs, while adhering to physical and engineering constraints. The integration of…

Machine Learning · Computer Science 2023-11-27 Chen Li , Alexander Kies , Kai Zhou , Markus Schlott , Omar El Sayed , Mariia Bilousova , Horst Stoecker

In this paper, we implement Neural Ordinary Differential Equations in a Variational Autoencoder setting for generative time series modeling. An object-oriented approach to the code was taken to allow for easier development and research and…

Machine Learning · Computer Science 2022-01-14 M. L. Garsdal , V. Søgaard , S. M. Sørensen

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

The neural ordinary differential equation (ODE) framework has emerged as a powerful tool for developing accelerated surrogate models of complex physical systems governed by partial differential equations (PDEs). A popular approach for PDE…

Fluid Dynamics · Physics 2025-03-26 Ashish S. Nair , Shivam Barwey , Pinaki Pal , Jonathan F. MacArt , Troy Arcomano , Romit Maulik

Session-based recommendation (SBR) aims to predict the user next action based on the ongoing sessions. Recently, there has been an increasing interest in modeling the user preference evolution to capture the fine-grained user interests.…

Information Retrieval · Computer Science 2022-08-23 Jiayan Guo , Peiyan Zhang , Chaozhuo Li , Xing Xie , Yan Zhang , Sunghun Kim

Accurate electricity demand forecasting is essential for several reasons, especially as the integration of renewable energy sources and the transition to a decentralized network paradigm introduce greater complexity and uncertainty. The…

Machine Learning · Computer Science 2026-05-12 Eloi Campagne , Yvenn Amara-Ouali , Yannig Goude , Argyris Kalogeratos

Extreme hazard events such as wildfires and hurricanes increasingly threaten power systems, causing widespread outages and disrupting critical services. Recently, predict-then-optimize approaches have gained traction in grid operations,…

Machine Learning · Computer Science 2026-04-15 Shuyi Chen , Ferdinando Fioretto , Feng Qiu , Shixiang Zhu

Time-series data in real-world settings typically exhibit long-range dependencies and are observed at non-uniform intervals. In these settings, traditional sequence-based recurrent models struggle. To overcome this, researchers often…

Machine Learning · Statistics 2025-01-14 Fernando Moreno-Pino , Álvaro Arroyo , Harrison Waldon , Xiaowen Dong , Álvaro Cartea

Residual networks are an Euler discretization of solutions to Ordinary Differential Equations (ODE). This paper explores a deeper relationship between Transformer and numerical ODE methods. We first show that a residual block of layers in…

Computation and Language · Computer Science 2022-04-13 Bei Li , Quan Du , Tao Zhou , Yi Jing , Shuhan Zhou , Xin Zeng , Tong Xiao , JingBo Zhu , Xuebo Liu , Min Zhang

Accurate power load forecasting is crucial for improving energy efficiency and ensuring power supply quality. Considering the power load forecasting problem involves not only dynamic factors like historical load variations but also static…

Machine Learning · Computer Science 2024-09-27 Chao Min , Yijia Wang , Bo Zhang , Xin Ma , Junyi Cui

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Operational weather prediction has long relied on physics-based numerical weather prediction (NWP), whose accuracy comes at the cost of substantial compute and complex simulation workflows. Recent transformer-based forecasters offer…

Machine Learning · Computer Science 2026-05-01 Hira Saleem , Flora Salim , Cormac Purcell

Dynamic graphs with ordered sequences of events between nodes are prevalent in real-world industrial applications such as e-commerce and social platforms. However, representation learning for dynamic graphs has posed great computational…

Machine Learning · Computer Science 2021-12-16 Xinshi Chen , Yan Zhu , Haowen Xu , Mengyang Liu , Liang Xiong , Muhan Zhang , Le Song

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

As a crucial technique for developing a smart city, traffic forecasting has become a popular research focus in academic and industrial communities for decades. This task is highly challenging due to complex and dynamic spatial-temporal…

Machine Learning · Computer Science 2024-01-29 Jiajia Wu , Ling Chen

With massive advancements in sensor technologies and Internet-of-things, we now have access to terabytes of historical data; however, there is a lack of clarity in how to best exploit the data to predict future events. One possible…

Computational Physics · Physics 2022-05-05 Tapas Tripura , Souvik Chakraborty

We study the learning of numerical algorithms for scientific computing, which combines mathematically driven, handcrafted design of general algorithm structure with a data-driven adaptation to specific classes of tasks. This represents a…

Numerical Analysis · Mathematics 2022-07-12 Yue Guo , Felix Dietrich , Tom Bertalan , Danimir T. Doncevic , Manuel Dahmen , Ioannis G. Kevrekidis , Qianxiao Li

Probabilistic forecasting of irregularly sampled time series is crucial in domains such as healthcare and finance, yet it remains a formidable challenge. Existing Neural Controlled Differential Equation (Neural CDE) approaches, while…

Machine Learning · Computer Science 2026-02-13 Ilya Kuleshov , Alexander Marusov , Alexey Zaytsev

In this paper, we present a novel framework for enhancing model interpretability by integrating heatmaps produced separately by ResNet and a restructured 2D Transformer with globally weighted input saliency. We address the critical problem…

Machine Learning · Computer Science 2025-07-02 Jiztom Kavalakkatt Francis , Matthew J Darr