中文
相关论文

相关论文: Using Gradient to Boost the Generalization Perform…

200 篇论文

We derive explicit equations governing the cumulative biases and weights in Deep Learning with ReLU activation function, based on gradient descent for the Euclidean cost in the input layer, and under the assumption that the weights are, in…

机器学习 · 计算机科学 2025-01-15 Thomas Chen

Computational Fluid Dynamics (CFD)-driven training combines machine learning (ML) with CFD solvers to develop physically consistent closure models with improved predictive accuracy. In the original framework, each ML-generated candidate…

机器学习 · 计算机科学 2025-12-23 Yuan Fang , Fabian Waschkowski , Maximilian Reissmann , Richard D. Sandberg , Takuo Oda , Koichi Tanimoto

Fractional Gradient Descent (FGD) offers a novel and promising way to accelerate optimization by incorporating fractional calculus into machine learning. Although FGD has shown encouraging initial results across various optimization tasks,…

机器学习 · 计算机科学 2025-10-22 Jan Sobotka , Petr Šimánek , Pavel Kordík

This paper describes a study based on computational fluid dynamics (CFD) and deep neural networks that focusing on predicting the flow field in differently distorted U-shaped pipes. The main motivation of this work was to get an insight…

机器学习 · 计算机科学 2020-10-02 Gergely Hajgató , Bálint Gyires-Tóth , György Paál

Use of Deep Learning (DL) in commercial applications such as image classification, sentiment analysis and speech recognition is increasing. When training DL models with large number of parameters and/or large datasets, cost and speed of…

分布式、并行与集群计算 · 计算机科学 2021-05-28 Medha Atre , Birendra Jha , Ashwini Rao

Computational Fluid Dynamics (CFD) is central to science and engineering, but faces severe scalability challenges, especially in high-dimensional, multiscale, and turbulent regimes. Traditional numerical methods often become prohibitively…

Reinforcement learning (RL) is highly suitable for devising control strategies in the context of dynamical systems. A prominent instance of such a dynamical system is the system of equations governing fluid dynamics. Recent research results…

机器学习 · 计算机科学 2022-11-21 Marius Kurz , Philipp Offenhäuser , Dominic Viola , Oleksandr Shcherbakov , Michael Resch , Andrea Beck

The field of scientific machine learning and its applications to numerical analyses such as CFD has recently experienced a surge in interest. While its viability has been demonstrated in different domains, it has not yet reached a level of…

流体动力学 · 物理学 2025-03-19 Giuseppe Bruni , Sepehr Maleki , Senthil K Krishnababu

We propose a new technique that boosts the convergence of training generative adversarial networks. Generally, the rate of training deep models reduces severely after multiple iterations. A key reason for this phenomenon is that a deep…

机器学习 · 统计学 2018-06-15 Atsushi Nitanda , Taiji Suzuki

We present a novel deep learning framework for flow field predictions in irregular domains when the solution is a function of the geometry of either the domain or objects inside the domain. Grid vertices in a computational fluid dynamics…

机器学习 · 计算机科学 2021-09-20 Ali Kashefi , Davis Rempe , Leonidas J. Guibas

Molecular Dynamics (MD) simulations are vital for exploring complex systems in computational physics and chemistry. While machine learning methods dramatically reduce computational costs relative to ab initio methods, their accuracy in…

材料科学 · 物理学 2025-07-18 Ivan Žugec , Tin Hadži Veljković , Maite Alducin , J. Iñaki Juaristi

Computational Fluid Dynamics (CFD) is the simulation of fluid flow undertaken with the use of computational hardware. The underlying equations are computationally challenging to solve and necessitate high performance computing (HPC) to…

分布式、并行与集群计算 · 计算机科学 2024-04-04 Zachary Cooper-Baldock , Brenda Vara Almirall , Kiao Inthavong

Computational fluid dynamics (CFD) drives progress in numerous scientific and engineering fields, yet high-fidelity simulations remain computationally prohibitive. While machine learning approaches offer computing acceleration, they…

流体动力学 · 物理学 2025-08-12 Rui Zhang , Qi Meng , Han Wan , Yang Liu , Zhi-Ming Ma , Hao Sun

Deep Learning (DL) has had an immense success in the recent past, leading to state-of-the-art results in various domains such as image recognition and natural language processing. One of the reasons for this success is the increasing size…

分布式、并行与集群计算 · 计算机科学 2019-09-26 Ruben Mayer , Hans-Arno Jacobsen

In this work, we investigate the use of data-driven equation discovery for dynamical systems to model and forecast continuous-time dynamics of unconstrained optimization problems. To avoid expensive evaluations of the objective function and…

最优化与控制 · 数学 2026-02-19 Grant Norman , Conor Rowan , Kurt Maute , Alireza Doostan

Numerical simulation of fluids plays an essential role in modeling many physical phenomena, such as weather, climate, aerodynamics and plasma physics. Fluids are well described by the Navier-Stokes equations, but solving these equations at…

流体动力学 · 物理学 2022-04-27 Dmitrii Kochkov , Jamie A. Smith , Ayya Alieva , Qing Wang , Michael P. Brenner , Stephan Hoyer

A major challenge in training large-scale machine learning models is configuring the training process to maximize model performance, i.e., finding the best training setup from a vast design space. In this work, we unlock a gradient-based…

机器学习 · 统计学 2025-03-19 Logan Engstrom , Andrew Ilyas , Benjamin Chen , Axel Feldmann , William Moses , Aleksander Madry

Deep learning (DL), a new-generation of artificial neural network research, has transformed industries, daily lives and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to…

机器学习 · 统计学 2018-09-05 Chaopeng Shen

Graph neural networks (GNNs) have emerged as powerful surrogates for mesh-based computational fluid dynamics (CFD), but training them on high-resolution unstructured meshes with hundreds of thousands of nodes remains prohibitively…

机器学习 · 计算机科学 2025-09-17 Paul Garnier , Vincent Lannelongue , Elie Hachem

We describe tests validating progress made toward acceleration and automation of hydrodynamic codes in the regime of developed turbulence by three Deep Learning (DL) Neural Network (NN) schemes trained on Direct Numerical Simulations of…

流体动力学 · 物理学 2018-12-06 Ryan King , Oliver Hennigh , Arvind Mohan , Michael Chertkov