中文
相关论文

相关论文: Scalable Preconditioning of Block-Structured Linea…

200 篇论文

A method for quasistatic cohesive fracture is introduced that uses an alternating direction method of multipliers (ADMM) to implement an energy approach to cohesive fracture. The ADMM algorithm minimizes a non-smooth, non-convex potential…

数值分析 · 数学 2022-02-15 James Petrie , M. Reza Hirmand , Katerina D. Papoulia

This article discusses the uncertainty quantification (UQ) for time-independent linear and nonlinear partial differential equation (PDE)-based systems with random model parameters carried out using sampling-free intrusive stochastic…

计算工程、金融与科学 · 计算机科学 2023-10-24 Sudhi Sharma , Pierre Jolivet , Victorita Dolean , Abhijit Sarkar

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

机器学习 · 统计学 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

Multistep matrix splitting iterations serve as preconditioning for Krylov subspace methods for solving singular linear systems. The preconditioner is applied to the generalized minimal residual (GMRES) method and the flexible GMRES (FGMRES)…

数值分析 · 数学 2021-11-09 Keiichi Morikuni

The alternating direction method of multipliers (ADM or ADMM) breaks a complex optimization problem into much simpler subproblems. The ADM algorithms are typically short and easy to implement yet exhibit (nearly) state-of-the-art…

最优化与控制 · 数学 2021-02-02 Ming Yan , Wotao Yin

The alternating direction method of multipliers (ADMM) is an effective method for solving wide fields of convex problems. At each iteration, the classical ADMM solves two subproblems exactly. However, in many applications, it is expensive…

最优化与控制 · 数学 2019-03-07 Yan Gu , Nobuo Yamashita

For multi-block alternating direction method of multipliers(ADMM), where the objective function can be decomposed into multiple block components, we show that with block symmetric Gauss-Seidel iteration, the algorithm will converge quickly.…

最优化与控制 · 数学 2017-05-24 Jinchao Xu , Kailai Xu , Yinyu Ye

In the last decade, tensors have shown their potential as valuable tools for various tasks in numerical linear algebra. While most of the research has been focusing on how to compress a given tensor in order to maintain information as well…

数值分析 · 数学 2024-09-17 Alberto Bucci , Davide Palitta , Leonardo Robol

Alternating Direction Method of Multipliers (ADMM) has recently been proposed as a potential alternative optimizer to the Stochastic Gradient Descent(SGD) for deep learning problems. This is because ADMM can solve gradient vanishing and…

最优化与控制 · 数学 2021-06-24 Junxiang Wang , Zheng Chai , Yue Cheng , Liang Zhao

The Alternating Direction Method of Multipliers (ADMM) has gained significant attention across a broad spectrum of machine learning applications. Incorporating the over-relaxation technique shows potential for enhancing the convergence rate…

最优化与控制 · 数学 2024-01-02 Jintao Song , Wenqi Lu , Yunwen Lei , Yuchao Tang , Zhenkuan Pan , Jinming Duan

We consider constraint-coupled optimization problems in which agents of a network aim to cooperatively minimize the sum of local objective functions subject to individual constraints and a common linear coupling constraint. We propose a…

最优化与控制 · 数学 2019-07-26 Alessandro Falsone , Ivano Notarnicola , Giuseppe Notarstefano , Maria Prandini

Quantization of the parameters of machine learning models, such as deep neural networks, requires solving constrained optimization problems, where the constraint set is formed by the Cartesian product of many simple discrete sets. For such…

最优化与控制 · 数学 2021-03-02 Tianjian Huang , Prajwal Singhania , Maziar Sanjabi , Pabitra Mitra , Meisam Razaviyayn

Big data, including applications with high security requirements, are often collected and stored on multiple heterogeneous devices, such as mobile devices, drones and vehicles. Due to the limitations of communication costs and security…

分布式、并行与集群计算 · 计算机科学 2020-10-05 Hao Chen , Yu Ye , Ming Xiao , Mikael Skoglund , H. Vincent Poor

We develop a parallel-in-time multigrid preconditioner for augmented systems. These saddle-point systems are foundational to numerical optimization. Our preconditioner, when paired with a suitable optimization method, accelerates the…

最优化与控制 · 数学 2025-12-08 Radoslav Vuchkov , Eric C. Cyr , Aurya Javeed , Denis Ridzal

The operation of large-scale infrastructure networks requires scalable optimization schemes. To guarantee safe system operation, a high degree of feasibility in a small number of iterations is important. Decomposition schemes can help to…

系统与控制 · 电气工程与系统科学 2024-12-02 Alexander Engelmann , Sungho Shin , François Pacaud , Victor M. Zavala

In this paper, we present a semi-proximal alternating direction method of multipliers (ADMM) for solving $3$-block separable convex minimization problems with the second block in the objective being a strongly convex function and one…

最优化与控制 · 数学 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

This paper addresses the efficient solution of linear systems arising from curl-conforming finite element discretizations of $H(\mathrm{curl})$ elliptic problems with heterogeneous coefficients. We first employ the discrete form of a…

数值分析 · 数学 2025-06-10 Chupeng Ma , Yongwei Zhang

In this paper, we consider nonconvex optimization problems with nonsmooth nonconvex objective function and nonlinear equality constraints. We assume that both the objective function and the functional constraints can be separated into 2…

最优化与控制 · 数学 2025-03-04 Lahcen El Bourkhissi , Ion Necoara

Inexact alternating direction multiplier methods (ADMMs) are developed for solving general separable convex optimization problems with a linear constraint and with an objective that is the sum of smooth and nonsmooth terms. The approach…

最优化与控制 · 数学 2016-04-12 William W. Hager , Hongchao Zhang

This paper investigates the collision-free control problem for multi-agent systems. For such multi-agent systems, it is the typical situation where conventional methods using either the usual centralized model predictive control (MPC), or…

多智能体系统 · 计算机科学 2024-02-07 Zilong Cheng , Jun Ma , Wenxin Wang , Zicheng Zhu , Clarence W. de Silva , Tong Heng Lee