English
Related papers

Related papers: Generalized Neural Closure Models with Interpretab…

200 papers

Closure modeling - the statistical modeling of missing dynamics in the natural sciences and engineering - is a growing and active area of research. Existing methods for closure modeling are often computationally prohibitive, lack…

Methodology · Statistics 2025-11-27 Eric Crislip , Mohammad Khalil , Teresa Portone , Oksana Chkrebtii , Kyle Neal

Convolutional neural networks (CNNs) provide flexible function approximations for a wide variety of applications when the input variables are in the form of images or spatial data. Although CNNs often outperform traditional statistical…

Methodology · Statistics 2024-05-24 Yeseul Jeon , Won Chang , Seonghyun Jeong , Sanghoon Han , Jaewoo Park

Deep models have achieved impressive progress in solving partial differential equations (PDEs). A burgeoning paradigm is learning neural operators to approximate the input-output mappings of PDEs. While previous deep models have explored…

Machine Learning · Computer Science 2023-05-30 Haixu Wu , Tengge Hu , Huakun Luo , Jianmin Wang , Mingsheng Long

The computational complexity of classical numerical methods for solving Partial Differential Equations (PDE) scales significantly as the resolution increases. As an important example, climate predictions require fine spatio-temporal…

Machine Learning · Computer Science 2022-10-12 Oussama Boussif , Dan Assouline , Loubna Benabbou , Yoshua Bengio

Solving parametric partial differential equations (PDEs) presents significant challenges for data-driven methods due to the sensitivity of spatio-temporal dynamics to variations in PDE parameters. Machine learning approaches often struggle…

Machine Learning · Computer Science 2024-11-11 Armand Kassaï Koupaï , Jorge Mifsut Benet , Yuan Yin , Jean-Noël Vittaut , Patrick Gallinari

Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of…

Machine Learning · Computer Science 2024-06-04 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

As further progress in the accurate and efficient computation of coupled partial differential equations (PDEs) becomes increasingly difficult, it has become highly desired to develop new methods for such computation. In deviation from…

Numerical Analysis · Mathematics 2021-03-17 H. S. Tang , L. Li , M. Grossberg , Y. J. Liu , Y. M. Jia , S. S. Li , W. B. Dong

In many scientific fields, the generation and evolution of data are governed by partial differential equations (PDEs) which are typically informed by established physical laws at the macroscopic level to describe general and predictable…

Methodology · Statistics 2025-07-01 Ziyuan Chen , Shunxing Yan , Fang Yao

Simulating stochastic differential equations (SDEs) in bounded domains, presents significant computational challenges due to particle exit phenomena, which requires accurate modeling of interior stochastic dynamics and boundary…

Machine Learning · Statistics 2025-07-23 Minglei Yang , Yanfang Liu , Diego del-Castillo-Negrete , Yanzhao Cao , Guannan Zhang

Partial Differential Equations (PDEs) describe phenomena ranging from turbulence and epidemics to quantum mechanics and financial markets. Despite recent advances in computational science, solving such PDEs for real-world applications…

Machine Learning · Computer Science 2025-05-19 Lothar Heimbach , Sebastian Kaltenbach , Petr Karnakov , Francis J. Alexander , Petros Koumoutsakos

Finding the correct encoding for a generic dynamical system's trajectory is a complicated task: the symbolic sequence needs to preserve the invariant properties from the system's trajectory. In theory, the solution to this problem is found…

Chaotic Dynamics · Physics 2018-04-18 Nicolás Rubido , Celso Grebogi , Murilo S. Baptista

Deep Feedback Models (DFMs) are a new class of stateful neural networks that combine bottom up input with high level representations over time. This feedback mechanism introduces dynamics into otherwise static architectures, enabling DFMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 David Calhas , Arlindo L. Oliveira

Modeling sequential patterns from data is at the core of various time series forecasting tasks. Deep learning models have greatly outperformed many traditional models, but these black-box models generally lack explainability in prediction…

Machine Learning · Computer Science 2023-05-23 Yingtao Luo , Chang Xu , Yang Liu , Weiqing Liu , Shun Zheng , Jiang Bian

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

Gaussian graphical models (GGMs) are widely used for statistical modeling, because of ease of inference and the ubiquitous use of the normal distribution in practical approximations. However, they are also known for their limited modeling…

Machine Learning · Statistics 2016-11-22 Qinliang Su , Xuejun Liao , Chunyuan Li , Zhe Gan , Lawrence Carin

Machine learning (ML) techniques have recently gained significant attention for solving compliance minimization (CM) problems. However, these methods typically provide poor feature boundaries, are very expensive, and lack a systematic…

Machine Learning · Computer Science 2025-11-06 Xiangyu Sun , Amin Yousefpour , Shirin Hosseinmardi , Ramin Bostanabad

Finding the dynamical law of observable quantities lies at the core of physics. Within the particular field of statistical mechanics, the generalized Langevin equation (GLE) comprises a general model for the evolution of observables…

Statistical Mechanics · Physics 2022-11-22 Antonio Russo , Miguel A. Duran-Olivencia , Ioannis G. Kevrekidis , Serafim Kalliadasis

Predictive Business Process Monitoring (PBPM) aims to forecast future events in ongoing cases based on historical event logs. While Graph Neural Networks (GNNs) are well suited to capture structural dependencies in process data, existing…

Machine Learning · Computer Science 2025-11-25 Fang Wang , Ernesto Damiani

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

Partial differential equations (PDEs) are fundamental for modeling complex physical systems, yet classical numerical solvers face prohibitive computational costs in high-dimensional and multi-scale regimes. While Transformer-based neural…

Machine Learning · Computer Science 2026-03-04 Pengyu Lai , Yixiao Chen , Dewu Yang , Rui Wang , Feng Wang , Hui Xu