中文
相关论文

相关论文: Leveraging Operator Learning to Accelerate Converg…

200 篇论文

One of the widespread solutions for non-rigid tracking has a nested-loop structure: with Gauss-Newton to minimize a tracking objective in the outer loop, and Preconditioned Conjugate Gradient (PCG) to solve a sparse linear system in the…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Yang Li , Aljaž Božič , Tianwei Zhang , Yanli Ji , Tatsuya Harada , Matthias Nießner

Deep Operator Networks (DeepONets) and their physics-informed variants have shown significant promise in learning mappings between function spaces of partial differential equations, enhancing the generalization of traditional neural…

机器学习 · 计算机科学 2025-01-08 Milad Ramezankhani , Anirudh Deodhar , Rishi Yash Parekh , Dagnachew Birru

A scaled conjugate gradient method that accelerates existing adaptive methods utilizing stochastic gradients is proposed for solving nonconvex optimization problems with deep neural networks. It is shown theoretically that, whether with…

机器学习 · 计算机科学 2024-12-17 Naoki Sato , Koshiro Izumi , Hideaki Iiduka

Recent advances in scientific machine learning have shed light on the modeling of pattern-forming systems. However, simulations of real patterns still incur significant computational costs, which could be alleviated by leveraging large…

计算工程、金融与科学 · 计算机科学 2023-02-28 Wei Li , Martin Z. Bazant , Juner Zhu

Fast and accurate predictions for complex physical dynamics are a significant challenge across various applications. Real-time prediction on resource-constrained hardware is even more crucial in real-world problems. The deep operator…

机器学习 · 计算机科学 2023-12-27 Jae Yong Lee , Sung Woong Cho , Hyung Ju Hwang

The inverse problem of supervised reconstruction of depth-variable (time-dependent) parameters in a neural ordinary differential equation (NODE) is considered, that means finding the weights of a residual network with time continuous…

机器学习 · 计算机科学 2022-02-14 George Baravdish , Gabriel Eilertsen , Rym Jaroudi , B. Tomas Johansson , Lukáš Malý , Jonas Unger

As deep learning models and datasets rapidly scale up, network training is extremely time-consuming and resource-costly. Instead of training on the entire dataset, learning with a small synthetic dataset becomes an efficient solution.…

机器学习 · 计算机科学 2022-08-02 Zixuan Jiang , Jiaqi Gu , Mingjie Liu , David Z. Pan

Multiscale modeling is an effective approach for investigating multiphysics systems with largely disparate size features, where models with different resolutions or heterogeneous descriptions are coupled together for predicting the system's…

计算工程、金融与科学 · 计算机科学 2022-12-07 Minglang Yin , Enrui Zhang , Yue Yu , George Em Karniadakis

This work explores the application of deep operator learning principles to a problem in statistical physics. Specifically, we consider the linear kinetic equation, consisting of a differential advection operator and an integral collision…

Models with dominant advection always posed a difficult challenge for projection-based reduced order modelling. Many methodologies that have recently been proposed are based on the pre-processing of the full-order solutions to accelerate…

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

最优化与控制 · 数学 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

Phase-field modeling is an effective but computationally expensive method for capturing the mesoscale morphological and microstructure evolution in materials. Hence, fast and generalizable surrogate models are needed to alleviate the cost…

Design and optimal control problems are among the fundamental, ubiquitous tasks we face in science and engineering. In both cases, we aim to represent and optimize an unknown (black-box) function that associates a performance/outcome to a…

机器学习 · 计算机科学 2021-10-27 Sifan Wang , Mohamed Aziz Bhouri , Paris Perdikaris

We propose a simple interpolation-based method for the efficient approximation of gradients in neural ODE models. We compare it with the reverse dynamic method (known in the literature as "adjoint method") to train neural ODEs on…

神经与进化计算 · 计算机科学 2020-11-03 Talgat Daulbaev , Alexandr Katrutsa , Larisa Markeeva , Julia Gusak , Andrzej Cichocki , Ivan Oseledets

Operator learning has emerged as a promising tool for accelerating the solution of partial differential equations (PDEs). The Deep Operator Networks (DeepONets) represent a pioneering framework in this area: the "vanilla" DeepONet is valued…

机器学习 · 计算机科学 2025-09-03 Zhi-Feng Wei , Wenqian Chen , Panos Stinis

This paper designs an Operator Learning framework to approximate the dynamic response of synchronous generators. One can use such a framework to (i) design a neural-based generator model that can interact with a numerical simulator of the…

机器学习 · 计算机科学 2023-01-31 Christian Moya , Guang Lin , Tianqiao Zhao , Meng Yue

Numerical simulation for climate modeling resolving all important scales is a computationally taxing process. Therefore, to circumvent this issue a low resolution simulation is performed, which is subsequently corrected for bias using…

大气与海洋物理 · 物理学 2023-02-08 Aniruddha Bora , Khemraj Shukla , Shixuan Zhang , Bryce Harrop , Ruby Leung , George Em Karniadakis

A new data-driven method for operator learning of stochastic differential equations(SDE) is proposed in this paper. The central goal is to solve forward and inverse stochastic problems more effectively using limited data. Deep operator…

机器学习 · 统计学 2022-04-08 Jiahao Zhang , Shiqi Zhang , Guang Lin

A large class of hyperbolic and advection-dominated PDEs can have solutions with discontinuities. This paper investigates, both theoretically and empirically, the operator learning of PDEs with discontinuous solutions. We rigorously prove,…

机器学习 · 计算机科学 2022-10-04 Samuel Lanthaler , Roberto Molinaro , Patrik Hadorn , Siddhartha Mishra

This paper studies a distributed multi-agent convex optimization problem. The system comprises multiple agents in this problem, each with a set of local data points and an associated local cost function. The agents are connected to a…

最优化与控制 · 数学 2021-08-20 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra