English
Related papers

Related papers: Physics-Constrained Deep Learning for High-dimensi…

200 papers

Stochastic Partial Differential Equations (SPDEs) driven by random noise play a central role in modeling physical processes with rough spatio-temporal dynamics, such as turbulence flows, superconductors, and quantum dynamics. Although…

Machine Learning · Computer Science 2026-05-18 Yuantu Zhu , Zheyan Li , Dai Shi , Luke Thompson , Oliver Nash , Jose Miguel Lara Rangel , Siran Li , Bingguang Chen , Rongchan Zhu , Qi Meng , Hao Ni

In modern federated learning, one of the main challenges is to account for inherent heterogeneity and the diverse nature of data distributions for different clients. This problem is often addressed by introducing personalization of the…

Machine Learning · Statistics 2023-12-19 Nikita Kotelevskii , Samuel Horváth , Karthik Nandakumar , Martin Takáč , Maxim Panov

When faced with distribution shift at test time, deep neural networks often make inaccurate predictions with unreliable uncertainty estimates. While improving the robustness of neural networks is one promising approach to mitigate this…

Machine Learning · Computer Science 2021-09-28 Aurick Zhou , Sergey Levine

Surrogate models are often used as computationally efficient approximations to complex simulation models, enabling tasks such as solving inverse problems, sensitivity analysis, and probabilistic forward predictions, which would otherwise be…

Machine Learning · Statistics 2026-05-13 Philipp Reiser , Paul-Christian Bürkner , Anneli Guthke

A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: how can models utilize physics or mathematical principles…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang , Ali Mohammad-Djafari

Modeling complex physical dynamics is a fundamental task in science and engineering. Traditional physics-based models are sample efficient, and interpretable but often rely on rigid assumptions. Furthermore, direct numerical approximation…

Machine Learning · Computer Science 2023-03-02 Rui Wang , Rose Yu

Providing fast and accurate solutions to partial differential equations is a problem of continuous interest to the fields of applied mathematics and physics. With the recent advances in machine learning, the adoption learning techniques in…

Computational Physics · Physics 2019-04-16 S. Mohammad H. Hashemi , Demetri Psaltis

Modern computational methods, involving highly sophisticated mathematical formulations, enable several tasks like modeling complex physical phenomenon, predicting key properties and design optimization. The higher fidelity in these computer…

Computational Engineering, Finance, and Science · Computer Science 2023-04-13 Lele Luan , Nesar Ramachandra , Sandipp Krishnan Ravi , Anindya Bhaduri , Piyush Pandita , Prasanna Balaprakash , Mihai Anitescu , Changjie Sun , Liping Wang

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable…

Reservoir simulation workflows face a fundamental data asymmetry: input parameter fields (geostatistical permeability realizations, porosity distributions) are free to generate in arbitrary quantities, yet existing neural operator…

Machine Learning · Computer Science 2026-04-10 Brandon Yee , Pairie Koh

Inferring parameters of high-dimensional partial differential equations (PDEs) poses significant computational and inferential challenges, primarily due to the curse of dimensionality and the inherent limitations of traditional numerical…

Computational Engineering, Finance, and Science · Computer Science 2025-09-18 Weihao Yan , Christoph Brune , Mengwu Guo

In many machine learning applications, labeled data is scarce and obtaining more labels is expensive. We introduce a new approach to supervising neural networks by specifying constraints that should hold over the output space, rather than…

Artificial Intelligence · Computer Science 2016-09-20 Russell Stewart , Stefano Ermon

Physics-informed neural networks (PINNs) have gained significant attention as a surrogate modeling strategy for partial differential equations (PDEs), particularly in regimes where labeled data are scarce and physical constraints can be…

Machine Learning · Computer Science 2026-02-12 Nicolás Becerra-Zuniga , Lucas Lacasa , Eusebio Valero , Gonzalo Rubio

Parametric surrogate models for partial differential equations (PDEs) are a necessary component for many applications in the computational sciences, and convolutional neural networks (CNNs) have proved as an excellent tool to generate these…

Computational Engineering, Finance, and Science · Computer Science 2022-06-13 Jan Niklas Fuhg , Arnav Karmarkar , Teeratorn Kadeethum , Hongkyu Yoon , Nikolaos Bouklas

Highly accurate datasets from numerical or physical experiments are often expensive and time-consuming to acquire, posing a significant challenge for applications that require precise evaluations, potentially across multiple scenarios and…

Machine Learning · Computer Science 2026-02-06 Paolo Conti , Mengwu Guo , Attilio Frangi , Andrea Manzoni

Numerical methods such as finite element have been flourishing in the past decades for modeling solid mechanics problems via solving governing partial differential equations (PDEs). A salient aspect that distinguishes these numerical…

Numerical Analysis · Mathematics 2020-06-16 Chengping Rao , Hao Sun , Yang Liu

This study develops and validates neural network frameworks with physics-based constraints for surrogate modeling of rarefied gas dynamics across different levels of complexity. As a baseline, we first examine the BGK kinetic relaxation…

Fluid Dynamics · Physics 2025-09-09 Ehsan Roohi , Ahmad Shoja-Sani , Bijan Goshayeshi , Ahmad Peyvan

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

Standard deep learning methods, such as Ensemble Models, Bayesian Neural Networks and Quantile Regression Models provide estimates to prediction uncertainties for data-driven deep learning models. However, they can be limited in their…