中文
相关论文

相关论文: The GNAT method for nonlinear model reduction: eff…

200 篇论文

Advancement in finite element methods have become essential in various disciplines, and in particular for Computational Fluid Dynamics (CFD), driving research efforts for improved precision and efficiency. While Convolutional Neural…

机器学习 · 计算机科学 2025-08-27 Paul Garnier , Jonathan Viquerat , Elie Hachem

In this paper, we develop a variant of the well-known Gauss-Newton (GN) method to solve a class of nonconvex optimization problems involving low-rank matrix variables. As opposed to the standard GN method, our algorithm allows one to handle…

最优化与控制 · 数学 2020-10-27 Quoc Tran-Dinh

We present Exact Gauss-Newton (EGN), a stochastic second-order optimization algorithm that combines the generalized Gauss-Newton (GN) Hessian approximation with low-rank linear algebra to compute the descent direction. Leveraging the…

机器学习 · 计算机科学 2025-10-16 Mikalai Korbit , Adeyemi D. Adeoye , Alberto Bemporad , Mario Zanon

In this paper, we introduce a quasi-Newton method optimized for efficiently solving quasi-linear elliptic equations and systems, with a specific focus on GPU-based computation. By approximating the Jacobian matrix with a combination of…

数值分析 · 数学 2025-03-25 Wenrui Hao , Sun Lee , Xiangxiong Zhang

The Gauss-Newton algorithm is a popular and efficient centralized method for solving non-linear least squares problems. In this paper, we propose a multi-agent distributed version of this algorithm, named Gossip-based Gauss-Newton (GGN)…

数值分析 · 数学 2016-08-24 Xiao Li , Anna Scaglione

Deep neural networks (DNNs) have been proven to have many redundancies. Hence, many efforts have been made to compress DNNs. However, the existing model compression methods treat all the input samples equally while ignoring the fact that…

机器学习 · 计算机科学 2018-07-05 Zhisheng Wang , Fangxuan Sun , Jun Lin , Zhongfeng Wang , Bo Yuan

Quasi-Newton (QN) methods provide an efficient alternative to second-order methods for minimizing smooth unconstrained problems. While QN methods generally compose a Hessian estimate based on one secant interpolation per iteration,…

最优化与控制 · 数学 2025-04-11 Mokhwa Lee , Yifan Sun

Quasi-Newton methods are widely used in practise for convex loss minimization problems. These methods exhibit good empirical performance on a wide variety of tasks and enjoy super-linear convergence to the optimal solution. For large-scale…

机器学习 · 计算机科学 2015-06-10 Aurelien Lucchi , Brian McWilliams , Thomas Hofmann

This work presents a novel version of recently developed Gauss-Newton method for solving systems of nonlinear equations, based on upper bound of solution residual and quadratic regularization ideas. We obtained for such method global…

最优化与控制 · 数学 2021-05-04 Nikita Yudin , Alexander Gasnikov

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

最优化与控制 · 数学 2024-10-25 Md Abu Talhamainuddin Ansary

We employ the principle of minimum pressure gradient to transform problems in unsteady computational fluid dynamics (CFD) into a convex optimization framework subject to linear constraints. This formulation permits solving, for the first…

流体动力学 · 物理学 2025-01-15 Hussam Sababha , Haithem Taha , Mohammed Daqaq

Advancements in computational fluid mechanics have largely relied on Newtonian frameworks, particularly through the direct simulation of Navier-Stokes equations. In this work, we propose an alternative computational framework that employs…

流体动力学 · 物理学 2024-12-10 H. Sababha , A. Elmaradny , H. Taha , M. Daqaq

A slow decaying Kolmogorov n-width of the solution manifold of a parametric partial differential equation precludes the realization of efficient linear projection-based reduced-order models. This is due to the high dimensionality of the…

数值分析 · 数学 2023-08-08 Francesco Romor , Giovanni Stabile , Gianluigi Rozza

Modeling and simulation of complex fluid flows with dynamics that span multiple spatio-temporal scales is a fundamental challenge in many scientific and engineering domains. Full-scale resolving simulations for systems such as highly…

机器学习 · 计算机科学 2025-02-13 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

This paper makes the first attempt to apply newly developed upwind GFDM for the meshless solution of two-phase porous flow equations. In the presented method, node cloud is used to flexibly discretize the computational domain, instead of…

数值分析 · 数学 2022-04-19 Xiang Rao , Yina Liu , Hui Zhao

We propose the generalized Newton's method (GeN) -- a Hessian-informed approach that applies to any optimizer such as SGD and Adam, and covers the Newton-Raphson method as a sub-case. Our method automatically and dynamically selects the…

机器学习 · 计算机科学 2025-05-20 Zhiqi Bu , Shiyun Xu

Although major advances have been achieved over the past decades for the reduction and identification of linear systems, deriving nonlinear low-order models still is a chal- lenging task. In this work, we develop a new data-driven framework…

流体动力学 · 物理学 2016-12-26 Jean-Christophe Loiseau , Steven L. Brunton

We leverage physics-embedded differentiable graph network simulators (GNS) to accelerate particulate and fluid simulations to solve forward and inverse problems. GNS represents the domain as a graph with particles as nodes and learned…

地球物理 · 物理学 2023-09-26 Krishna Kumar , Yongjin Choi

Gaussian processes (GPs) based methods for solving partial differential equations (PDEs) demonstrate great promise by bridging the gap between the theoretical rigor of traditional numerical algorithms and the flexible design of machine…

数值分析 · 数学 2024-02-02 Xianjin Yang , Houman Owhadi

Neural networks often struggle with high-dimensional but small sample-size tabular datasets. One reason is that current weight initialisation methods assume independence between weights, which can be problematic when there are insufficient…

机器学习 · 计算机科学 2024-08-20 Andrei Margeloiu , Nikola Simidjievski , Pietro Lio , Mateja Jamnik