English
Related papers

Related papers: TI-DeepONet: Learnable Time Integration for Stable…

200 papers

Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, current NO-based…

Machine Learning · Computer Science 2024-03-18 Ashutosh Singh , Ricardo Augusto Borsoi , Deniz Erdogmus , Tales Imbiriba

Deep neural networks, despite their success in numerous applications, often function without established theoretical foundations. In this paper, we bridge this gap by drawing parallels between deep learning and classical numerical analysis.…

Machine Learning · Computer Science 2023-10-04 Emanuele Zappala , Daniel Levine , Sizhuang He , Syed Rizvi , Sacha Levy , David van Dijk

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

We consider using deep neural networks to solve time-dependent partial differential equations (PDEs), where multi-scale processing is crucial for modeling complex, time-evolving dynamics. While the U-Net architecture with skip connections…

Machine Learning · Computer Science 2024-03-29 Xuan Zhang , Jacob Helwig , Yuchao Lin , Yaochen Xie , Cong Fu , Stephan Wojtowytsch , Shuiwang Ji

We introduce a new class of hybrid preconditioners for solving parametric linear systems of equations. The proposed preconditioners are constructed by hybridizing the deep operator network, namely DeepONet, with standard iterative methods.…

Numerical Analysis · Mathematics 2024-01-11 Alena Kopaničáková , George Em Karniadakis

The robotic systems continuously interact with complex dynamical systems in the physical world. Reliable predictions of spatiotemporal evolution of these dynamical systems, with limited knowledge of system dynamics, are crucial for…

Artificial Intelligence · Computer Science 2019-01-08 Yun Long , Xueyuan She , Saibal Mukhopadhyay

We introduce a novel deep operator network (DeepONet) framework that incorporates generalised variational inference (GVI) using R\'enyi's $\alpha$-divergence to learn complex operators while quantifying uncertainty. By incorporating…

Machine Learning · Statistics 2025-12-09 Soban Nasir Lone , Subhayan De , Rajdip Nayek

For a long time, the vision community tries to learn the spatio-temporal representation by combining convolutional neural network together with various temporal models, such as the families of Markov chain, optical flow, RNN and temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Hao Shao , Shengju Qian , Yu Liu

Temporal difference (TD) learning is a foundational algorithm in reinforcement learning (RL). For nearly forty years, TD learning has served as a workhorse for applied RL as well as a building block for more complex and specialized…

Machine Learning · Computer Science 2025-06-24 Hwanwoo Kim , Panos Toulis , Eric Laber

Recurrent and convolutional neural networks are the most common architectures used for time series forecasting in deep learning literature. These networks use parameter sharing by repeating a set of fixed architectures with fixed parameters…

Machine Learning · Computer Science 2020-11-30 Joel Janek Dabrowski , YiFan Zhang , Ashfaqur Rahman

This paper proposes a new data-driven method for the reliable prediction of power system post-fault trajectories. The proposed method is based on the fundamentally new concept of Deep Operator Networks (DeepONets). Compared to traditional…

Numerical Analysis · Mathematics 2022-02-16 Christian Moya , Shiqi Zhang , Meng Yue , Guang Lin

The fast adaptation capability of deep neural networks in non-stationary environments is critical for online time series forecasting. Successful solutions require handling changes to new and recurring patterns. However, training deep neural…

Machine Learning · Computer Science 2022-10-18 Quang Pham , Chenghao Liu , Doyen Sahoo , Steven C. H. Hoi

Scientific computing has been an indispensable tool in applied sciences and engineering, where traditional numerical methods are often employed due to their superior accuracy guarantees. However, these methods often encounter challenges…

Numerical Analysis · Mathematics 2024-07-23 Ran Bi , Jingrun Chen , Weibing Deng

Many time-series classification problems involve developing metrics that are invariant to temporal misalignment. In human activity analysis, temporal misalignment arises due to various reasons including differing initial phase, sensor…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Suhas Lohit , Qiao Wang , Pavan Turaga

Deep Learning (DL), in particular deep neural networks (DNN), by default is purely data-driven and in general does not require physics. This is the strength of DL but also one of its key limitations when applied to science and engineering…

Machine Learning · Statistics 2022-09-26 Hai V. Nguyen , Tan Bui-Thanh

A wide range of scientific problems, such as those described by continuous-time dynamical systems and partial differential equations (PDEs), are naturally formulated on function spaces. While function spaces are typically…

This article explores operator learning models that can deduce solutions to partial differential equations (PDEs) on arbitrary domains without requiring retraining. We introduce two innovative models rooted in boundary integral equations…

Mathematical Physics · Physics 2024-06-05 Bin Meng , Yutong Lu , Ying Jiang

Improving diesel engine efficiency, reducing emissions, and enabling robust health monitoring have been critical research topics in engine modelling. While recent advancements in the use of neural networks for system monitoring have shown…

Machine Learning · Computer Science 2026-03-17 Kamaljyoti Nath , Varun Kumar , Daniel J. Smith , George Em Karniadakis

We present a framework that leverages the Discrete Empirical Interpolation Method (DEIM) for interpretable deep learning and dynamical system analysis. Although DEIM efficiently approximates nonlinear terms in projection-based reduced-order…

Machine Learning · Computer Science 2026-04-03 Hojin Kim , Romit Maulik

This work investigates the problem of learning temporal interaction networks. A temporal interaction network consists of a series of chronological interactions between users and items. Previous methods tackle this problem by using different…

Social and Information Networks · Computer Science 2021-07-09 Jiangxia Cao , Xixun Lin , Xin Cong , Shu Guo , Hengzhu Tang , Tingwen Liu , Bin Wang