中文
相关论文

相关论文: Test-time Generalization for Physics through Neura…

200 篇论文

In multi-body dynamics, the motion of a complicated physical object is described as a coupled ordinary differential equation system with multiple unknown solutions. Engineers need to constantly adjust the object to meet requirements at the…

计算工程、金融与科学 · 计算机科学 2022-05-26 Wenhao Ding , Qing He , Hanghang Tong , Ping Wang

We study theoretical guarantees for solving linear systems in-context using a linear transformer architecture. For in-domain generalization, we provide neural scaling laws that bound the generalization error in terms of the number of tasks…

机器学习 · 计算机科学 2025-05-27 Frank Cole , Yulong Lu , Wuzhe Xu , Tianhao Zhang

Neural Operators (NOs) provide a powerful framework for computations involving physical laws that can be modelled by (integro-) partial differential equations (PDEs), directly learning maps between infinite-dimensional function spaces that…

Neural operators are a popular technique in scientific machine learning to learn a mathematical model of the behavior of unknown physical systems from data. Neural operators are especially useful to learn solution operators associated with…

数值分析 · 数学 2022-08-05 Nicolas Boullé , Seick Kim , Tianyi Shi , Alex Townsend

Physics-informed neural networks (PINNs) have made significant strides in modeling dynamical systems governed by partial differential equations (PDEs). However, their generalization capabilities across varying scenarios remain limited. To…

机器学习 · 计算机科学 2024-12-02 Honghui Wang , Yifan Pu , Shiji Song , Gao Huang

Developing neural operators that accurately predict the behavior of systems governed by partial differential equations (PDEs) across unseen parameter regimes is crucial for robust generalization in scientific and engineering applications.…

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

机器学习 · 计算机科学 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

机器学习 · 计算机科学 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

The modeling of complicated time-evolving physical dynamics from partial observations is a long-standing challenge. Particularly, observations can be sparsely distributed in a seemingly random or unstructured manner, making it difficult to…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Fan Xu , Hao Wu , Nan Wang , Lilan Peng , Kun Wang , Wei Gong , Xibin Zhao

Accurately quantifying long-term risk probabilities in diverse stochastic systems is essential for safety-critical control. However, existing sampling-based and partial differential equation (PDE)-based methods often struggle to handle…

系统与控制 · 电气工程与系统科学 2025-08-29 Zhuoyuan Wang , Raffaele Romagnoli , Kamyar Azizzadenesheli , Yorie Nakahira

The multi-scale and non-linear nature of phase-field models of solidification requires fine spatial and temporal discretization, leading to long computation times. This could be overcome with artificial-intelligence approaches. Surrogate…

偏微分方程分析 · 数学 2026-04-21 Chih-Kang Huang , Ludovick Gagnon , Miha Založnik , Benoît Appolaire

Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have…

机器学习 · 计算机科学 2020-11-03 Arnab Ghosh , Harkirat Singh Behl , Emilien Dupont , Philip H. S. Torr , Vinay Namboodiri

Neural Ordinary Differential Equations (NODEs) have proven successful in learning dynamical systems in terms of accurately recovering the observed trajectories. While different types of sparsity have been proposed to improve robustness, the…

机器学习 · 计算机科学 2022-10-27 Hananeh Aliee , Till Richter , Mikhail Solonin , Ignacio Ibarra , Fabian Theis , Niki Kilbertus

In this paper, we propose Test-Time Training, a general approach for improving the performance of predictive models when training and test data come from different distributions. We turn a single unlabeled test sample into a self-supervised…

机器学习 · 计算机科学 2020-07-03 Yu Sun , Xiaolong Wang , Zhuang Liu , John Miller , Alexei A. Efros , Moritz Hardt

Engineering design problems often involve solving parametric Partial Differential Equations (PDEs) under variable PDE parameters and domain geometry. Recently, neural operators have shown promise in learning PDE operators and quickly…

机器学习 · 计算机科学 2024-11-14 Weiheng Zhong , Hadi Meidani

Neural operators as novel neural architectures for fast approximating solution operators of partial differential equations (PDEs), have shown considerable promise for future scientific computing. However, the mainstream of training neural…

机器学习 · 计算机科学 2024-06-04 Tengfei Xu , Dachuan Liu , Peng Hao , Bo Wang

Segmentation of microscopy images constitutes an ill-posed inverse problem due to measurement noise, weak object boundaries, and limited labeled data. Although deep neural networks provide flexible nonparametric estimators, unconstrained…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Seema K. Poudel , Sunny K. Khadka

Diffusion-based Neural Combinatorial Optimization (NCO) has demonstrated effectiveness in solving NP-complete (NPC) problems by learning discrete diffusion models for solution generation, eliminating hand-crafted domain knowledge. Despite…

机器学习 · 计算机科学 2026-03-12 Haoyu Lei , Kaiwen Zhou , Yinchuan Li , Zhitang Chen , Farzan Farnia

Neural operators have been applied in various scientific fields, such as solving parametric partial differential equations, dynamical systems with control, and inverse problems. However, challenges arise when dealing with input functions…

数值分析 · 数学 2023-10-31 Zecheng Zhang , Christian Moya , Lu Lu , Guang Lin , Hayden Schaeffer

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

机器学习 · 计算机科学 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu