中文
相关论文

相关论文: Efficient Primal-dual Forward-backward Splitting M…

200 篇论文

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

机器学习 · 计算机科学 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

最优化与控制 · 数学 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

This paper presents a simple primal dual method named DPD which is a flexible framework for a class of saddle point problem with or without strongly convex component. The presented method has linearized version named LDPD and exact version…

最优化与控制 · 数学 2019-07-16 Zhipeng Xie , Jianwen Shi

We develop a fast and scalable numerical approach to solve Wasserstein gradient flows (WGFs), particularly suitable for high-dimensional cases. Our approach is to use general reduced-order models, like deep neural networks, to parameterize…

数值分析 · 数学 2024-05-24 Yijie Jin , Shu Liu , Hao Wu , Xiaojing Ye , Haomin Zhou

We propose a method for optimal Bayesian filtering with deterministic particles. In order to avoid particle degeneration, the filter step is not performed at once. Instead, the particles progressively flow from prior to posterior. This is…

机器学习 · 统计学 2023-03-07 Uwe D. Hanebeck

Wasserstein Gradient Flow (WGF) describes the gradient dynamics of probability density within the Wasserstein space. WGF provides a promising approach for conducting optimization over the probability distributions. Numerically approximating…

机器学习 · 计算机科学 2024-06-04 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

The ever-growing size of training datasets enhances the generalization capability of modern machine learning models but also incurs exorbitant computational costs. Existing data pruning approaches aim to accelerate training by removing…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Dongyue Wu , Zilin Guo , Jialong Zuo , Nong Sang , Changxin Gao

The forward-backward splitting method (FBS) for minimizing a nonsmooth composite function can be interpreted as a (variable-metric) gradient method over a continuously differentiable function which we call forward-backward envelope (FBE).…

最优化与控制 · 数学 2019-11-11 Lorenzo Stella , Andreas Themelis , Panagiotis Patrinos

This manuscript introduces a regression-type formulation for approximating the Perron-Frobenius Operator by relying on distributional snapshots of data. These snapshots may represent densities of particles. The Wasserstein metric is…

最优化与控制 · 数学 2020-11-03 Amirhossein Karimi , Tryphon T. Georgiou

Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of…

机器学习 · 统计学 2019-05-16 Luca Ambrogioni , Umut Guclu , Marcel van Gerven

This paper introduces a second-order convex splitting scheme for gradient flows arising in phase-field models, based on the backward differentiation formula (BDF2) for the implicit part and the Adams-Bashforth method for the nonlinear and…

最优化与控制 · 数学 2026-04-30 Xinhua Shen , Zaijiu Shang , Hongpeng Sun

We propose a Forward-Backward Truncated-Newton method (FBTN) for minimizing the sum of two convex functions, one of which smooth. Unlike other proximal Newton methods, our approach does not involve the employment of variable metrics, but is…

最优化与控制 · 数学 2019-11-11 Andreas Themelis , Masoud Ahookhosh , Panagiotis Patrinos

The $L^2$ gradient flow of the Ginzburg-Landau free energy functional leads to the Allen Cahn equation that is widely used for modeling phase separation. Machine learning methods for solving the Allen-Cahn equation in its strong form suffer…

机器学习 · 计算机科学 2025-03-27 Revanth Mattey , Susanta Ghosh

This work proposes a novel low-complexity digital backpropagation (DBP) method, with the goal of optimizing the trade-off between backpropagation accuracy and complexity. The method combines a split step Fourier method (SSFM)-like structure…

信息论 · 计算机科学 2025-04-04 Stella Civelli , Debi Pada Jana , Enrico Forestieri , Marco Secondini

We formulate well-posed continuous-time generative flows for learning distributions that are supported on low-dimensional manifolds through Wasserstein proximal regularizations of $f$-divergences. Wasserstein-1 proximal operators regularize…

机器学习 · 统计学 2024-07-17 Hyemin Gu , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang

In this paper we investigate the numerical approximation of an analogue of the Wasserstein distance for optimal transport on graphs that is defined via a discrete modification of the Benamou--Brenier formula. This approach involves the…

数值分析 · 数学 2017-07-24 Matthias Erbar , Martin Rumpf , Bernhard Schmitzer , Stefan Simon

We introduce a novel optimal transport framework for probabilistic circuits (PCs). While it has been shown recently that divergences between distributions represented as certain classes of PCs can be computed tractably, to the best of our…

人工智能 · 计算机科学 2025-10-16 Adrian Ciotinga , YooJung Choi

This work proposes an Accelerated Primal-Dual Fixed-Point (APDFP) method that employs Nesterov type acceleration to solve composite problems of the form min f(x) + g(Bx), where g is nonsmooth and B is a linear operator. The APDFP features…

最优化与控制 · 数学 2025-11-04 Ya-Nan Zhu

Optimal transport has gained much attention in image processing field, such as computer vision, image interpolation and medical image registration. Recently, Bredies et al. (ESAIM:M2AN 54:2351-2382, 2020) and Schmitzer et al. (IEEE T MED…

数值分析 · 数学 2023-08-21 Yiming Gao

In this paper we bring together some of the key ideas and methods of two disparate fields of mathematical research, frame theory and optimal transport, using the methods of the second to answer questions posed in the first. In particular,…

泛函分析 · 数学 2022-12-01 Clare Wickman , Kasso Okoudjou