中文
相关论文

相关论文: UPS: Efficiently Building Foundation Models for PD…

200 篇论文

The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural--numerical hybrid solvers, which piggy-backs the modern trend towards…

机器学习 · 计算机科学 2023-03-21 Johannes Brandstetter , Daniel Worrall , Max Welling

Solving partial differential equations is difficult. Recently proposed neural resolution-invariant models, despite their effectiveness and efficiency, usually require equispaced spatial points of data. However, sampling in spatial domain is…

机器学习 · 计算机科学 2023-03-21 Haitao Lin , Lirong Wu , Yongjie Xu , Yufei Huang , Siyuan Li , Guojiang Zhao , Stan Z. Li

The complexities of information processing across Dynamic Data Driven Applications Systems drive the development and adoption of Artificial Intelligence-based optimization solutions. Traditional solvers often suffer from slow response times…

系统与控制 · 电气工程与系统科学 2024-07-09 Meiyi Li , Javad Mohammadi

In this work, we describe a novel approach to building a neural PDE solver leveraging recent advances in transformer based neural network architectures. Our model can provide solutions for different values of PDE parameters without any need…

机器学习 · 计算机科学 2024-07-10 Varun Madhavan , Amal S Sebastian , Bharath Ramsundar , Venkatasubramanian Viswanathan

Single-operator learning involves training a deep neural network to learn a specific operator, whereas recent work in multi-operator learning uses an operator embedding structure to train a single neural network on data from multiple…

机器学习 · 计算机科学 2025-06-16 Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

Dynamic Data Driven Applications Systems (DDDAS) motivate the development of optimization approaches capable of adapting to streaming, heterogeneous, and asynchronous data from sensor networks. Many established optimization solvers, such as…

系统与控制 · 电气工程与系统科学 2025-08-28 Meiyi Li , Javad Mohammadi

Recent multimodal systems often rely on separate expert modality encoders which cause linearly scaling complexity and computational overhead with added modalities. While unified Omni-models address this via Mixture-of-Expert (MoE)…

多媒体 · 计算机科学 2026-03-09 Kin Wai Lau , Yasar Abbas Ur Rehman , Lai-Man Po , Pedro Porto Buarque de Gusmão

Mixed-dimensional partial differential equations (PDEs) are characterized by coupled operators defined on domains of varying dimensions and pose significant computational challenges due to their inherent ill-conditioning. Moreover, the…

数值分析 · 数学 2025-05-14 Nunzio Dimola , Nicola Rares Franco , Paolo Zunino

Solving analytically intractable partial differential equations (PDEs) that involve at least one variable defined on an unbounded domain arises in numerous physical applications. Accurately solving unbounded domain PDEs requires efficient…

机器学习 · 计算机科学 2026-05-12 Mingtao Xia , Lucas Böttcher , Tom Chou

Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important…

机器学习 · 计算机科学 2023-02-06 Lu Zhang , Huaiqian You , Tian Gao , Mo Yu , Chung-Hao Lee , Yue Yu

Convolutional Neural Networks (CNNs) are crucial in various applications, but their deployment on resource-constrained edge devices poses challenges. This study presents the Sum-of-Products (SOP) units for convolution, which utilize…

机器学习 · 计算机科学 2025-05-14 Muhammad Sohail Ibrahim , Muhammad Usman , Jeong-A Lee

Recently, the use of neural networks to accelerate the solving of partial differential equations (PDEs) has gained significant traction in both academia and industry. However, employing neural networks as standalone surrogate models raises…

In this paper, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first…

We propose a framework for solving nonlinear partial differential equations (PDEs) by combining perturbation theory with one-shot transfer learning in Physics-Informed Neural Networks (PINNs). Nonlinear PDEs with polynomial terms are…

数值分析 · 数学 2025-11-17 Samuel Auroy , Pavlos Protopapas

Solving time-dependent Partial Differential Equations (PDEs) using a densely discretized spatial domain is a fundamental problem in various scientific and engineering disciplines, including modeling climate phenomena and fluid dynamics.…

机器学习 · 计算机科学 2025-10-24 Jan Hagnberger , Daniel Musekamp , Mathias Niepert

Numerical solvers of Partial Differential Equations (PDEs) are of fundamental significance to science and engineering. To date, the historical reliance on legacy techniques has circumscribed possible integration of big data knowledge and…

数值分析 · 数学 2024-08-12 Xi Han , Fei Hou , Hong Qin

We propose a neural network-based meta-learning method to efficiently solve partial differential equation (PDE) problems. The proposed method is designed to meta-learn how to solve a wide variety of PDE problems, and uses the knowledge for…

机器学习 · 统计学 2023-10-23 Tomoharu Iwata , Yusuke Tanaka , Naonori Ueda

Recent advancements in Multimodal Large Language Models (MLLMs) underscore the significance of scalable models and data to boost performance, yet this often incurs substantial computational costs. Although the Mixture of Experts (MoE)…

人工智能 · 计算机科学 2024-05-21 Yunxin Li , Shenyuan Jiang , Baotian Hu , Longyue Wang , Wanqi Zhong , Wenhan Luo , Lin Ma , Min Zhang

Solving partial differential equations (PDEs) is the cornerstone of scientific research and development. Data-driven machine learning (ML) approaches are emerging to accelerate time-consuming and computation-intensive numerical simulations…

光学 · 物理学 2024-09-30 Yingheng Tang , Ruiyang Chen , Minhan Lou , Jichao Fan , Cunxi Yu , Andy Nonaka , Zhi Yao , Weilu Gao

PDEs arise ubiquitously in science and engineering, where solutions depend on parameters (physical properties, boundary conditions, geometry). Traditional numerical methods require re-solving the PDE for each parameter, making parameter…

机器学习 · 统计学 2026-02-02 Zhuo Zhang , Xiong Xiong , Sen Zhang , Yuan Zhao , Xi Yang