English
Related papers

Related papers: Linearized Learning Methods with Multiscale Deep N…

200 papers

Accurate and efficient numerical simulation of unconventional reservoirs is challenging. Long periods of transient flow and steep potential gradients occur due to the extreme conductivity contrast between matrix and fracture. Detailed…

Computational Engineering, Finance, and Science · Computer Science 2020-10-23 Jiamin Jiang

We consider two-level finite element discretization methods for the stream function formulation of the Navier-Stokes equations. The two-level method consists of solving a small nonlinear system on the coarse mesh, then solving a linear…

Numerical Analysis · Mathematics 2025-10-20 Faisal Fairag

Deep neural networks (DNNs) have made great progress in various fields. In particular, the quantized neural network is a promising technique making DNNs compatible on resource-limited devices for memory and computation saving. In this…

Optimization and Control · Mathematics 2022-04-26 Fengmiao Bian , Ren Liu , Xiaoqun Zhang

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible…

Machine Learning · Computer Science 2022-11-15 Colin Ponce , Ruipeng Li , Christina Mao , Panayot Vassilevski

This proposed work introduces a data-assimilation-assisted approach to train neural networks, aimed at effectively reducing epistemic uncertainty in state estimates of separated flows. This method, referred to as model-consistent training,…

Fluid Dynamics · Physics 2024-08-02 Minghan Chu

Modal methods are a long-standing approach to physical modelling synthesis. Extensions to nonlinear problems are possible, leading to coupled nonlinear systems of ordinary differential equations. Recent work in scalar auxiliary variable…

Sound · Computer Science 2026-03-17 Victor Zheleznov , Stefan Bilbao , Alec Wright , Simon King

This work presents a two-stage adaptive framework for progressively developing deep neural network (DNN) architectures that generalize well for a given training data set. In the first stage, a layerwise training approach is adopted where a…

Machine Learning · Computer Science 2024-09-24 C G Krishnanunni , Tan Bui-Thanh

In this paper, we investigate neural networks applied to multiscale simulations and discuss a design of a novel deep neural network model reduction approach for multiscale problems. Due to the multiscale nature of the medium, the fine-grid…

Numerical Analysis · Mathematics 2024-12-20 Min Wang , Siu Wun Cheung , Wing Tat Leung , Eric T. Chung , Yalchin Efendiev , Mary Wheeler

Conventional fluid simulations can be time consuming and energy intensive. We researched the viability of a neural network for simulating incompressible fluids in a randomized obstacle-heavy environment, as an alternative to the numerical…

Fluid Dynamics · Physics 2025-10-28 Rui Hespanha , Elliot McGuire , João Hespanha

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated…

Machine Learning · Statistics 2025-07-10 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang , Wei Zhu

Recent work in deep learning focuses on solving physical systems in the Ordinary Differential Equation or Partial Differential Equation. This current work proposed a variant of Convolutional Neural Networks (CNNs) that can learn the hidden…

Machine Learning · Computer Science 2021-11-02 Mansura Habiba , Barak A. Pearlmutter

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Machine Learning models incorporating multiple layered learning networks have been seen to provide effective models for various classification problems. The resulting optimization problem to solve for the optimal vector minimizing the…

Optimization and Control · Mathematics 2018-07-03 Vyacheslav Kungurtsev , Tomas Pevny

Adversarial training can be used to learn models that are robust against perturbations. For linear models, it can be formulated as a convex optimization problem. Compared to methods proposed in the context of deep learning, leveraging the…

Machine Learning · Statistics 2025-03-20 Antônio H. RIbeiro , Thomas B. Schön , Dave Zahariah , Francis Bach

Artificial intelligence (AI) shows great potential to reduce the huge cost of solving partial differential equations (PDEs). However, it is not fully realized in practice as neural networks are defined and trained on fixed domains and…

Machine Learning · Computer Science 2025-04-16 Hongyu Li , Ximeng Ye , Peng Jiang , Guoliang Qin , Tiejun Wang

Turbulent problems in industrial applications are predominantly solved using Reynolds Averaged Navier Stokes (RANS) turbulence models. The accuracy of the RANS models is limited due to closure assumptions that induce uncertainty into the…

Fluid Dynamics · Physics 2018-02-20 Atieh Alizadeh Moghaddam , Amir Sadaghiyani

In recent years, Physics-Informed Neural Networks (PINNs) have emerged as a powerful and robust framework for solving nonlinear differential equations across a wide range of scientific and engineering disciplines, including biology,…

Fluid Dynamics · Physics 2025-11-19 Ritik Pal , Soubhik Mukherjee , Urmi Dutta , Arghya Choudhury

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

Numerical Analysis · Mathematics 2025-01-28 Qi Wang , Yuan Mi , Haoyun Wang , Yi Zhang , Ruizhi Chengze , Hongsheng Liu , Ji-Rong Wen , Hao Sun

Learning complex trajectories from demonstrations in robotic tasks has been effectively addressed through the utilization of Dynamical Systems (DS). State-of-the-art DS learning methods ensure stability of the generated trajectories;…

Robotics · Computer Science 2024-12-10 Andreas Sochopoulos , Michael Gienger , Sethu Vijayakumar

The deep neural network multigrid solver (DNN-MG) combines a coarse-grid finite element simulation with a deep neural network that corrects the solution on finer grid levels, thereby improving the computational efficiency. In this work, we…

Numerical Analysis · Mathematics 2026-01-26 Robert Jendersie , Nils Margenberg , Christian Lessig , Thomas Richter