English
Related papers

Related papers: Transfer Learning on Multi-Fidelity Data

200 papers

We analyze the regression accuracy of convolutional neural networks assembled from encoders, decoders and skip connections and trained with multifidelity data. Besides requiring significantly less trainable parameters than equivalent fully…

Machine Learning · Computer Science 2022-10-26 Lauren Partin , Gianluca Geraci , Ahmad Rushdi , Michael S. Eldred , Daniele E. Schiavazzi

Data-driven surrogate models are widely used for applications such as design optimization and uncertainty quantification, where repeated evaluations of an expensive simulator are required. For most partial differential equation (PDE)…

Computational Physics · Physics 2019-10-18 Wei Xing , Robert M. Kirby , Shandian Zhe

Many large scale problems in computational fluid dynamics such as uncertainty quantification, Bayesian inversion, data assimilation and PDE constrained optimization are considered very challenging computationally as they require a large…

Computational Physics · Physics 2020-04-22 Kjetil O. Lye , Siddhartha Mishra , Deep Ray

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

Neural Stochastic Differential Equations (NSDEs) model the drift and diffusion functions of a stochastic process as neural networks. While NSDEs are known to make accurate predictions, their uncertainty quantification properties have been…

Machine Learning · Computer Science 2022-09-13 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

We present an approach for constructing a surrogate from ensembles of information sources of varying cost and accuracy. The multifidelity surrogate encodes connections between information sources as a directed acyclic graph, and is trained…

Machine Learning · Computer Science 2021-08-25 Alex Gorodetsky , John D. Jakeman , Gianluca Geraci

A neural network architecture is presented that exploits the multilevel properties of high-dimensional parameter-dependent partial differential equations, enabling an efficient approximation of parameter-to-solution maps, rivaling…

Machine Learning · Computer Science 2024-08-21 Janina Enrica Schütte , Martin Eigel

In recent years, representation learning approaches have disrupted many multimedia computing tasks. Among those approaches, deep convolutional neural networks (CNNs) have notably reached human level expertise on some constrained image…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Lucas Pascal , Xavier Bost , Benoît Huet

State-of-the-art computer codes for simulating real physical systems are often characterized by a vast number of input parameters. Performing uncertainty quantification (UQ) tasks with Monte Carlo (MC) methods is almost always infeasible…

Computational Physics · Physics 2018-10-17 Rohit Tripathy , Ilias Bilionis

Scientific machine learning is increasingly being spoken of as universal emulators for classical numerical solvers for multi-scale partial differential equations, but most apparent successes can be explained by facts that also define their…

Mathematical Physics · Physics 2026-04-23 Karthik Duraisamy

Convolutional Neural Networks (CNNs) have shown to be powerful medical image segmentation models. In this study, we address some of the main unresolved issues regarding these models. Specifically, training of these models on small medical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Davood Karimi , Ali Gholipour

Neural networks (NNs) have been widely used to solve partial differential equations (PDEs) in the applications of physics, biology, and engineering. One effective approach for solving PDEs with a fixed differential operator is learning…

Numerical Analysis · Mathematics 2025-11-21 Wenrui Hao , Rui Peng Li , Yuanzhe Xi , Tianshi Xu , Yahong Yang

Across many domains of science, stochastic models are an essential tool to understand the mechanisms underlying empirically observed data. Models can be of different levels of detail and accuracy, with models of high-fidelity (i.e., high…

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

Physics-informed neural networks (PINNs) have shown promising potential for solving partial differential equations (PDEs) using deep learning. However, PINNs face training difficulties for evolutionary PDEs, particularly for dynamical…

Neural and Evolutionary Computing · Computer Science 2023-12-25 Siqi Chen , Bin Shan , Ye Li

Convolutional neural networks (CNNs) work well on large datasets. But labelled data is hard to collect, and in some applications larger amounts of data are not available. The problem then is how to use CNNs with small data -- as CNNs…

Machine Learning · Statistics 2016-01-19 Yarin Gal , Zoubin Ghahramani

Machine Learning (ML) methods and tools have gained great success in many data, signal, image and video processing tasks, such as classification, clustering, object detection, semantic segmentation, language processing, Human-Machine…

Machine Learning · Computer Science 2023-09-06 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

Partial differential equations (PDEs) play a fundamental role in modeling and simulating problems across a wide range of disciplines. Recent advances in deep learning have shown the great potential of physics-informed neural networks…

Machine Learning · Computer Science 2022-01-31 Pu Ren , Chengping Rao , Yang Liu , Jianxun Wang , Hao Sun

The ability to automatically learn task specific feature representations has led to a huge success of deep learning methods. When large training data is scarce, such as in medical imaging problems, transfer learning has been very effective.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-21 Hariharan Ravishankar , Prasad Sudhakar , Rahul Venkataramani , Sheshadri Thiruvenkadam , Pavan Annangi , Narayanan Babu , Vivek Vaidya

In computational fluid dynamics, there is an inevitable trade off between accuracy and computational cost. In this work, a novel multi-fidelity deep generative model is introduced for the surrogate modeling of high-fidelity turbulent flow…

Computational Physics · Physics 2021-01-12 Nicholas Geneva , Nicholas Zabaras