中文
相关论文

相关论文: Understanding and mitigating gradient pathologies …

200 篇论文

Neural networks trained with standard objectives exhibit behaviors characteristic of probabilistic inference: soft clustering, prototype specialization, and Bayesian uncertainty tracking. These phenomena appear across architectures -- in…

机器学习 · 计算机科学 2026-01-01 Alan Oursland

We investigate the efficient learning of magnetic phases using artificial neural networks trained on synthetic data, combining computational simplicity with physics-informed strategies. Focusing on the diluted Ising model, which lacks an…

强关联电子 · 物理学 2026-04-29 Agustin Medina , Marcelo Arlego , Carlos A. Lamas

Neural networks are trained primarily based on their inputs and outputs, without regard for their internal mechanisms. These neglected mechanisms determine properties that are critical for safety, like (i) transparency; (ii) the absence of…

机器学习 · 计算机科学 2024-12-02 Alex Cloud , Jacob Goldman-Wetzler , Evžen Wybitul , Joseph Miller , Alexander Matt Turner

Physics-informed neural networks have emerged as a prominent new method for solving differential equations. While conceptually straightforward, they often suffer training difficulties that lead to relatively large discretization errors or…

数学物理 · 物理学 2024-03-13 Shivam Arora , Alex Bihlo , Francis Valiquette

Physics-informed neural networks (PINNs) are an increasingly powerful way to solve partial differential equations, generate digital twins, and create neural surrogates of physical models. In this manuscript we detail the inner workings of…

Physics-guided Neural Networks (PGNNs) represent an emerging class of neural networks that are trained using physics-guided (PG) loss functions (capturing violations in network outputs with known physics), along with the supervision…

Despite tremendous success of modern neural networks, they are known to be overconfident even when the model encounters inputs with unfamiliar conditions. Detecting such inputs is vital to preventing models from making naive predictions…

计算机视觉与模式识别 · 计算机科学 2020-09-07 Jinsol Lee , Ghassan AlRegib

Training a neural network requires navigating a high-dimensional, non-convex loss surface to find parameters that minimize this loss. In many ways, it is surprising that optimizers such as stochastic gradient descent and ADAM can reliably…

机器学习 · 计算机科学 2026-02-06 Conor Rowan , Finn Murphy-Blanchard

Turbulence modeling is a critical component in numerical simulations of industrial flows based on Reynolds-averaged Navier-Stokes (RANS) equations. However, after decades of efforts in the turbulence modeling community, universally…

流体动力学 · 物理学 2017-03-22 Jian-Xun Wang , Jin-Long Wu , Heng Xiao

Data-driven discovery of governing equations in computational science has emerged as a new paradigm for obtaining accurate physical models and as a possible alternative to theoretical derivations. The recently developed physics-informed…

机器学习 · 计算机科学 2023-10-18 Zongren Zou , Xuhui Meng , George Em Karniadakis

Machine learning is gaining growing momentum in various recent models for the dynamic analysis of information flows in data communications networks. These preliminary models often rely on off-the-shelf learning models to predict from…

机器学习 · 计算机科学 2023-04-04 Xiangle Cheng , James He , Shihan Xiao , Yingxue Zhang , Zhitang Chen , Pascal Poupart , Fenglin Li

In deep learning, it is common to use more network parameters than training points. In such scenarioof over-parameterization, there are usually multiple networks that achieve zero training error so that thetraining algorithm induces an…

机器学习 · 计算机科学 2023-08-22 Hung-Hsu Chou , Carsten Gieshoff , Johannes Maly , Holger Rauhut

Physics-Informed Neural Network (PINN) is a novel multi-task learning framework useful for solving physical problems modeled using differential equations (DEs) by integrating the knowledge of physics and known constraints into the…

机器学习 · 计算机科学 2024-09-18 Shivprasad Kathane , Shyamprasad Karagadde

This work concerns the application of physics-informed neural networks to the modeling and control of complex robotic systems. Achieving this goal required extending Physics Informed Neural Networks to handle non-conservative effects. We…

机器人学 · 计算机科学 2023-07-07 Jingyue Liu , Pablo Borja , Cosimo Della Santina

Recently, physics informed neural networks (PINNs) have been explored extensively for solving various forward and inverse problems and facilitating querying applications in fluid mechanics applications. However, work on PINNs for unsteady…

流体动力学 · 物理学 2024-02-28 Rahul Sundar , Dipanjan Majumdar , Didier Lucor , Sunetra Sarkar

Physics-informed neural networks (PINNs) provide a deep learning framework for numerically solving partial differential equations (PDEs), and have been widely used in a variety of PDE problems. However, there still remain some challenges in…

机器学习 · 计算机科学 2022-05-19 Wensheng Li , Chao Zhang , Chuncheng Wang , Hanting Guan , Dacheng Tao

Recent works in deep learning have shown that integrating differentiable physics simulators into the training process can greatly improve the quality of results. Although this combination represents a more complex optimization task than…

机器学习 · 计算机科学 2022-03-22 Patrick Schnell , Philipp Holl , Nils Thuerey

Combining machine learning with physics is a trending approach for discovering unknown dynamics, and one of the most intensively studied frameworks is the physics-informed neural network (PINN). However, PINN often fails to optimize the…

机器学习 · 计算机科学 2023-11-29 Yuichi Kajiura , Jorge Espin , Dong Zhang

Accurate prediction of vehicle collision dynamics is crucial for advanced safety systems and post-impact control applications, yet existing methods face inherent trade-offs among computational efficiency, prediction accuracy, and data…

系统与控制 · 电气工程与系统科学 2025-10-16 Yangye Jiang , Jiachen Wang , Daofei Li

In recent years, Physics-Informed Neural Networks (PINNs) have become a representative method for solving partial differential equations (PDEs) with neural networks. PINNs provide a novel approach to solving PDEs through optimization…

计算物理 · 物理学 2024-11-28 Weiwei Zhang , Wei Suo , Jiahao Song , Wenbo Cao