中文
相关论文

相关论文: Numerical Analysis on Neural Network Projected Sch…

200 篇论文

This study focuses on a Wasserstein-type gradient flow, which represents an optimization process of a continuous model of a Deep Neural Network (DNN). First, we establish the existence of a minimizer for an average loss of the model under…

机器学习 · 计算机科学 2024-04-16 Noboru Isobe

We present a novel multiscale framework for analyzing sequences of probability measures in Wasserstein spaces over Euclidean domains. Exploiting the intrinsic geometry of optimal transport, we construct a multiscale transform applicable to…

数值分析 · 数学 2026-04-13 Wael Mattar , Nir Sharon

Pressure and flow estimation in Water Distribution Networks (WDN) allows water management companies to optimize their control operations. For many years, mathematical simulation tools have been the most common approach to reconstructing an…

机器学习 · 计算机科学 2024-07-11 Huy Truong , Andrés Tello , Alexander Lazovik , Victoria Degeler

Recently, deep neural networks (DNNs) have shown advantages in accelerating optimization algorithms. One approach is to unfold finite number of iterations of conventional optimization algorithms and to learn parameters in the algorithms.…

机器学习 · 计算机科学 2021-04-23 Byung Hyun Lee , Se Young Chun

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

This paper provides results on Wasserstein gradient flows between measures on the real line. Utilizing the isometric embedding of the Wasserstein space $\mathcal P_2(\mathbb R)$ into the Hilbert space $L_2((0,1))$, Wasserstein gradient…

最优化与控制 · 数学 2024-08-13 Johannes Hertrich , Robert Beinert , Manuel Gräf , Gabriele Steidl

In several machine learning tasks for graph structured data, the graphs under consideration may be composed of a varying number of nodes. Therefore, it is necessary to design pooling methods that aggregate the graph representations of…

机器学习 · 计算机科学 2022-05-20 Effrosyni Simou

Gradient boosting is a sequential ensemble method that fits a new weaker learner to pseudo residuals at each iteration. We propose Wasserstein gradient boosting, a novel extension of gradient boosting that fits a new weak learner to…

统计方法学 · 统计学 2024-08-30 Takuo Matsubara

In this paper, we study higher-order-accurate-in-time minimizing movements schemes for Wasserstein gradient flows. We introduce a novel accelerated second-order scheme, leveraging the differential structure of the Wasserstein space in both…

偏微分方程分析 · 数学 2025-12-23 Raymond Chu , Matt Jacobs

The field of artificial neural network (ANN) training has garnered significant attention in recent years, with researchers exploring various mathematical techniques for optimizing the training process. In particular, this paper focuses on…

泛函分析 · 数学 2023-06-23 Arzu Ahmadova

Variational inference (VI) can be cast as an optimization problem in which the variational parameters are tuned to closely align a variational distribution with the true posterior. The optimization task can be approached through vanilla…

机器学习 · 计算机科学 2025-04-24 Dai Hai Nguyen , Tetsuya Sakurai , Hiroshi Mamitsuka

We address the problem of computing a textural loss based on the statistics extracted from the feature activations of a convolutional neural network optimized for object recognition (e.g. VGG-19). The underlying mathematical problem is the…

计算机视觉与模式识别 · 计算机科学 2021-03-12 Eric Heitz , Kenneth Vanhoey , Thomas Chambon , Laurent Belcour

This paper addresses a new active learning strategy for regression problems. The presented Wasserstein active regression model is based on the principles of distribution-matching to measure the representativeness of the labeled dataset. The…

机器学习 · 计算机科学 2024-03-25 Benjamin Bobbia , Matthias Picard

Wasserstein gradient flow (WGF) is a common method to perform optimization over the space of probability measures. While WGF is guaranteed to converge to a first-order stationary point, for nonconvex functionals the converged solution does…

最优化与控制 · 数学 2025-09-23 Naoya Yamamoto , Juno Kim , Taiji Suzuki

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

机器学习 · 计算机科学 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

Two neural-network-based numerical schemes are proposed to solve the classical obstacle problems. The schemes are based on the universal approximation property of neural networks, and the cost functions are taken as the energy minimization…

数值分析 · 数学 2022-08-10 Xinyue Evelyn Zhao , Wenrui Hao , Bei Hu

A key challenge in modern deep learning theory is to explain the remarkable success of gradient-based optimization methods when training large-scale, complex deep neural networks. Though linear convergence of such methods has been proved…

机器学习 · 计算机科学 2025-09-30 Yash Jakhmola

The population dynamics of molecules, cells, and organisms are governed by a number of unknown forces. In the last decade, population dynamics have predominantly been modeled with Wasserstein gradient flows. However, since gradient flows…

机器学习 · 计算机科学 2026-05-19 Vincent Guan , Lazar Atanackovic , Kirill Neklyudov

The implicit biases of gradient-based optimization algorithms are conjectured to be a major factor in the success of modern deep learning. In this work, we investigate the implicit bias of gradient flow and gradient descent in two-layer…

机器学习 · 计算机科学 2022-10-14 Spencer Frei , Gal Vardi , Peter L. Bartlett , Nathan Srebro , Wei Hu

Geometrically parametrized Partial Differential Equations are nowadays widely used in many different fields as, for example, shape optimization processes or patient specific surgery studies. The focus of this work is on some advances for…

流体动力学 · 物理学 2021-07-21 Matteo Zancanaro , Markus Mrosek , Giovanni Stabile , Carsten Othmer , Gianluigi Rozza