English
Related papers

Related papers: An Element-wise RSAV Algorithm for Unconstrained O…

200 papers

We develop an efficient stochastic variance reduced gradient descent algorithm to solve the affine rank minimization problem consists of finding a matrix of minimum rank from linear measurements. The proposed algorithm as a stochastic…

Optimization and Control · Mathematics 2022-11-08 Ningning Han , Juan Nie , Jian Lu , Michael K. Ng

By time discretization of a second-order primal-dual dynamical system with damping $\alpha/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a…

Optimization and Control · Mathematics 2022-06-06 Xin He , Rong Hu , Ya-Ping Fang

Stochastic non-convex non-concave optimization, formally characterized as Stochastic Variational Inequalities (SVIs), presents unique challenges due to rotational dynamics and the absence of a global merit function. While adaptive step-size…

Optimization and Control · Mathematics 2026-03-12 Yungi Jeong , Takumi Otsuka

In this work, we study the problem of finding approximate, with minimum support set, solutions to matrix max-plus equations, which we call sparse approximate solutions. We show how one can obtain such solutions efficiently and in polynomial…

Optimization and Control · Mathematics 2020-12-22 Nikos Tsilivis , Anastasios Tsiamis , Petros Maragos

This paper develops three linear and energy-stable schemes for a modified phase field crystal model with a strong nonlinear vacancy potential (VMPFC model). This sixth-order phase-field model enables realistic crystal growth simulation.…

Numerical Analysis · Mathematics 2025-10-14 Wanrong Hao , Yunqing Huang

Large-scale non-convex sparsity-constrained problems have recently gained extensive attention. Most existing deterministic optimization methods (e.g., GraSP) are not suitable for large-scale and high-dimensional problems, and thus…

Machine Learning · Computer Science 2019-12-03 Fanhua Shang , Bingkun Wei , Hongying Liu , Yuanyuan Liu , Jiacheng Zhuo

The scalar auxiliary variable (SAV)-type methods are very popular techniques for solving various nonlinear dissipative systems. Compared to the semi-implicit method, the baseline SAV method can keep a modified energy dissipation law but…

Numerical Analysis · Mathematics 2023-10-16 Zhengguang Liu , Yanrong Zhang , Xiaoli Li

Evolution Strategies (ES) are stochastic derivative-free optimization algorithms whose most prominent representative, the CMA-ES algorithm, is widely used to solve difficult numerical optimization problems. We provide the first rigorous…

Optimization and Control · Mathematics 2022-10-25 Cheikh Touré , Anne Auger , Nikolaus Hansen

We consider convex optimization problems which are widely used as convex relaxations for low-rank matrix recovery problems. In particular, in several important problems, such as phase retrieval and robust PCA, the underlying assumption in…

Optimization and Control · Mathematics 2022-06-22 Dan Garber

This paper presents a stochastic approximation proximal subgradient (SAPS) method for stochastic convex-concave minimax optimization. By accessing unbiased and variance bounded approximate subgradients, we show that this algorithm exhibits…

Optimization and Control · Mathematics 2024-04-01 Yu-Hong Dai , Jiani Wang , Liwei Zhang

Based on the Uzawa algorithm, we consider an adaptive finite element method for the Stokes system. We prove linear convergence with optimal algebraic rates for the residual estimator (which is equivalent to the total error), if the arising…

Numerical Analysis · Mathematics 2019-11-15 Giovanni Di Fratta , Thomas Führer , Gregor Gantner , Dirk Praetorius

We consider a class of optimization problems with Cartesian variational inequality (CVI) constraints, where the objective function is convex and the CVI is associated with a monotone mapping and a convex Cartesian product set. This…

Optimization and Control · Mathematics 2021-02-16 Harshal D. Kaushik , Farzad Yousefian

We propose a new numerical technique to deal with nonlinear terms in gradient flows. By introducing a scalar auxiliary variable (SAV), we construct efficient and robust energy stable schemes for a large class of gradient flows. The SAV…

Numerical Analysis · Mathematics 2017-10-05 Jie Shen , Jie Xu , Jiang Yang

Two primary scalar auxiliary variable (SAV) approaches are widely applied for simulating gradient flow systems, i.e., the nonlinear energy-based approach and the Lagrange multiplier approach. The former guarantees unconditional energy…

Numerical Analysis · Mathematics 2024-11-27 Qiong-Ao Huang , Wei Jiang , Jerry Zhijian Yang , Cheng Yuan

We consider convex and nonconvex constrained optimization with a partially separable objective function: agents minimize the sum of local objective functions, each of which is known only by the associated agent and depends on the variables…

Optimization and Control · Mathematics 2020-10-20 Loris Cannelli , Francisco Facchinei , Gesualdo Scutari , Vyacheslav Kungurtsev

We design an adaptive virtual element method (AVEM) of lowest order over triangular meshes with hanging nodes in 2d, which are treated as polygons. AVEM hinges on the stabilization-free a posteriori error estimators recently derived in [8].…

Numerical Analysis · Mathematics 2023-02-28 L. Beirão da Veiga , C. Canuto , R. H. Nochetto , G. Vacca , M. Verani

In this work, we develop an adaptive nonconforming finite element algorithm for the numerical approximation of phase-field parameterized topology optimization governed by the Stokes system. We employ the conforming linear finite element…

Numerical Analysis · Mathematics 2026-04-20 Bangti Jin , Jing Li , Yifeng Xu , Shengfeng Zhu

Regularized empirical risk minimization (rERM) has become important in data-intensive fields such as genomics and advertising, with stochastic gradient methods typically used to solve the largest problems. However, ill-conditioned…

Machine Learning · Statistics 2025-01-28 Jingruo Sun , Zachary Frangella , Madeleine Udell

In this paper, we propose a randomized accelerated method for the minimization of a strongly convex function under linear constraints. The method is of Kaczmarz-type, i.e. it only uses a single linear equation in each iteration. To obtain…

Optimization and Control · Mathematics 2025-04-03 Lionel Tondji , Dirk A. Lorenz , Ion Necoara

The Smectic-A (SmA) phase is modeled by a modified Landau-de Gennes (mLdG) model proposed by Xia et al. [Phys. Rev. Lett., 126 (2021), 177801], in which a tensor order parameter Q for the orientational order is coupled with a real scalar…

Numerical Analysis · Mathematics 2026-04-22 Wenshuai Hu , Guanghua Ji , Xiao Li