English
Related papers

Related papers: A Study on the Performance of Distributed Training…

200 papers

The high cost of high-resolution computational fluid/flame dynamics (CFD) has hindered its application in combustion related design, research and optimization. In this study, we propose a new framework for turbulent combustion simulation…

Fluid Dynamics · Physics 2020-03-03 Jian An , Hanyi Wang , Bing Liu , Kai Hong Luo , Fei Qin , Guo Qiang He

CFD is widely used in physical system design and optimization, where it is used to predict engineering quantities of interest, such as the lift on a plane wing or the drag on a motor vehicle. However, many systems of interest are…

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been…

Fluid Dynamics · Physics 2022-10-18 Alberto Olmo , Ahmed Zamzam , Andrew Glaws , Ryan King

Deep learning has led to tremendous advancements in the field of Artificial Intelligence. One caveat however is the substantial amount of compute needed to train these deep learning models. Training a benchmark dataset like ImageNet on a…

Machine Learning · Computer Science 2018-10-30 Karanbir Chahal , Manraj Singh Grover , Kuntal Dey

Large-scale AI model training divides work across thousands of GPUs, then synchronizes gradients across them at each step. This incurs a significant network burden that only centralized, monolithic clusters can support, driving up…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 David McAllister , Matthew Tancik , Jiaming Song , Angjoo Kanazawa

The field of numerical simulation is of significant importance for the design and management of real-world systems, with partial differential equations (PDEs) being a commonly used mathematical modeling tool. However, solving PDEs remains…

Machine Learning · Computer Science 2023-06-21 Wenzhuo Liu , Mouadh Yagoubi , Marc Schoenauer

An evolutionary multi-objective aerodynamic design optimization method using the computational fluid dynamics (CFD) simulations incorporating deep neural network (DNN) to reduce the required computational time is proposed. In this approach,…

Fluid Dynamics · Physics 2023-05-01 Yukito Tsunoda , Akira Oyama

In this work, an efficient physics-constrained deep learning model is developed for solving multiphase flow in 3D heterogeneous porous media. The model fully leverages the spatial topology predictive capability of convolutional neural…

Geophysics · Physics 2021-05-21 Bicheng Yan , Dylan Robert Harp , Bailian Chen , Rajesh Pawar

Accurate prediction of flow fields around underwater vehicles undergoing vertical-plane oblique motions is critical for hydrodynamic analysis, but it often requires computationally expensive CFD simulations. This study proposes a…

Fluid Dynamics · Physics 2026-01-07 Tianli Hu , Chengsheng Wu , Jun Ding , Xing Wang , Yu Yang , Jianchun Wang

Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-19 Haiyang Lin , Mingyu Yan , Xiaocheng Yang , Mo Zou , Wenming Li , Xiaochun Ye , Dongrui Fan

Modeling of fluid flows requires corresponding adequate and effective approaches that would account for multiscale nature of the considered physics. Despite the tremendous growth of computational power in the past decades, modeling of fluid…

Fluid Dynamics · Physics 2025-06-24 Arsen S. Iskhakov , Nam T. Dinh

Many physical processes such as weather phenomena or fluid mechanics are governed by partial differential equations (PDEs). Modelling such dynamical systems using Neural Networks is an active research field. However, current methods are…

Machine Learning · Computer Science 2022-10-12 Andrzej Dulny , Andreas Hotho , Anna Krause

Traditional fluid flow predictions require large computational resources. Despite recent progress in parallel and GPU computing, the ability to run fluid flow predictions in real-time is often infeasible. Recently developed machine learning…

Fluid Dynamics · Physics 2021-06-08 Y. van Halder , B. Sanderse , B. Koren

Solving partial differential equations with deep learning makes it possible to reduce simulation times by multiple orders of magnitude and unlock scientific methods that typically rely on large numbers of sequential simulations, such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-24 Philipp A. Witte , Russell J. Hewett , Kumar Saurabh , AmirHossein Sojoodi , Ranveer Chandra

The Physics-Constrained DeepONet (PC-DeepONet), an architecture that incorporates fundamental physics knowledge into the data-driven DeepONet model, is presented in this study. This methodology is exemplified through surrogate modeling of…

We introduce a novel masked pre-training technique for graph neural networks (GNNs) applied to computational fluid dynamics (CFD) problems. By randomly masking up to 40\% of input mesh nodes during pre-training, we force the model to learn…

Machine Learning · Computer Science 2025-08-27 Paul Garnier , Vincent Lannelongue , Jonathan Viquerat , Elie Hachem

Recent advances in data-generating techniques led to an explosive growth of geo-spatiotemporal data. In domains such as hydrology, ecology, and transportation, interpreting the complex underlying patterns of spatiotemporal interactions with…

Machine Learning · Computer Science 2023-01-30 Aishwarya Sarkar , Chaoqun Lu , Ali Jannesari

Distributed training of deep nets is an important technique to address some of the present day computing challenges like memory consumption and computational demands. Classical distributed approaches, synchronous or asynchronous, are based…

Machine Learning · Computer Science 2019-01-14 Youjie Li , Mingchao Yu , Songze Li , Salman Avestimehr , Nam Sung Kim , Alexander Schwing

Flash floods in urban areas occur with increasing frequency. Detecting these floods would greatlyhelp alleviate human and economic losses. However, current flood prediction methods are eithertoo slow or too simplified to capture the flood…

Signal Processing · Electrical Eng. & Systems 2019-08-28 Kun Qian , Abduallah Mohamed , Christian Claudel

We consider a federated learning (FL) system consisting of multiple clients and a server, where the clients aim to collaboratively learn a common decision model from their distributed data. Unlike the conventional FL framework that assumes…

Machine Learning · Computer Science 2023-05-10 Kun Jin , Tongxin Yin , Zhongzhu Chen , Zeyu Sun , Xueru Zhang , Yang Liu , Mingyan Liu