English
Related papers

Related papers: Second-order self-consistent field algorithms: fro…

200 papers

In this paper we consider finding a second-order stationary point (SOSP) of nonconvex equality constrained optimization when a nearly feasible point is known. In particular, we first propose a new Newton-CG method for finding an approximate…

Optimization and Control · Mathematics 2023-01-10 Chuan He , Zhaosong Lu , Ting Kei Pong

In this paper, we present a novel second order in time mixed finite element scheme for the Cahn-Hilliard-Navier-Stokes equations with matched densities. The scheme combines a standard second order Crank-Nicholson method for the…

Numerical Analysis · Mathematics 2016-06-09 Amanda E. Diegel , Cheng Wang , Xiaoming Wang , Steven M. Wise

We study the numerical solution of a Cahn-Hilliard/Allen-Cahn system with strong coupling through state and gradient dependent non-diagonal mobility matrices. A fully discrete approximation scheme in space and time is proposed which…

Numerical Analysis · Mathematics 2024-08-02 Aaron Brunk , Herbert Egger , Oliver Habrich

The total complexity (measured as the total number of gradient computations) of a stochastic first-order optimization algorithm that finds a first-order stationary point of a finite-sum smooth nonconvex objective function $F(w)=\frac{1}{n}…

Optimization and Control · Mathematics 2019-04-24 Lam M. Nguyen , Marten van Dijk , Dzung T. Phan , Phuong Ha Nguyen , Tsui-Wei Weng , Jayant R. Kalagnanam

Iron-sulfur clusters comprise an important functional motif of the catalytic centers of biological systems, capable of enabling important chemical transformations at ambient conditions. This remarkable capability derives from a notoriously…

We develop and analyze several different second-order algorithms for computing a near-optimal solution path of a convex parametric optimization problem with smooth Hessian. Our algorithms are inspired by a differential equation perspective…

Optimization and Control · Mathematics 2023-06-16 Heyuan Liu , Paul Grigas

Constrained second-order convex optimization algorithms are the method of choice when a high accuracy solution to a problem is needed, due to their local quadratic convergence. These algorithms require the solution of a constrained…

Optimization and Control · Mathematics 2025-06-13 Alejandro Carderera , Sebastian Pokutta

Optimization on Riemannian manifolds widely arises in eigenvalue computation, density functional theory, Bose-Einstein condensates, low rank nearest correlation, image registration, and signal processing, etc. We propose an adaptive…

Optimization and Control · Mathematics 2017-08-08 Jiang Hu , Andre Milzarek , Zaiwen Wen , Yaxiang Yuan

This paper focuses on the minimization of a sum of a twice continuously differentiable function $f$ and a nonsmooth convex function. An inexact regularized proximal Newton method is proposed by an approximation to the Hessian of $f$…

Optimization and Control · Mathematics 2023-11-09 Ruyu Liu , Shaohua Pan , Yuqia Wu , Xiaoqi Yang

Training learned image compression (LIC) models entails navigating a challenging optimization landscape defined by the fundamental trade-off between rate and distortion. Standard first-order optimizers, such as SGD and Adam, struggle with…

Image and Video Processing · Electrical Eng. & Systems 2026-01-30 Yichi Zhang , Fengqing Zhu

This article focuses on the development of high-order energy stable schemes for the multi-length-scale incommensurate phase-field crystal model which is able to study the phase behavior of aperiodic structures. These high-order schemes…

Numerical Analysis · Mathematics 2020-08-31 Kai Jiang , Wei Si

This article focuses on the development of high-order energy stable schemes for the multi-length-scale incommensurate phase-field crystal model which is able to study the phase behavior of aperiodic structures. These high-order schemes…

Numerical Analysis · Mathematics 2020-05-26 Kai Jiang , Wei Si

A rapid algorithm is derived for the Helmholtz--Hodge decomposition on the surface of the sphere in spherical coordinates. The algorithm uncouples modes of spherical harmonics with different absolute order, writes the conversion as…

Numerical Analysis · Mathematics 2018-09-13 Julien Molina , Richard Mikael Slevinsky

We propose an efficient algorithm for solving orthogonal canonical correlation analysis (OCCA) in the form of trace-fractional structure and orthogonal linear projections. Even though orthogonality has been widely used and proved to be a…

Machine Learning · Computer Science 2019-09-26 Leihong Zhang , Li Wang , Zhaojun Bai , Ren-cang Li

We provide an exact analysis of a class of randomized algorithms for solving overdetermined least-squares problems. We consider first-order methods, where the gradients are pre-conditioned by an approximation of the Hessian, based on a…

Optimization and Control · Mathematics 2020-02-27 Jonathan Lacotte , Mert Pilanci

We present a modification of the $\Delta$SCF method of calculating energies of excited states, in order to make it applicable to resonance calculations of molecules adsorbed on metal surfaces, where the molecular orbitals are highly…

Materials Science · Physics 2009-03-06 Jeppe Gavnholt , Thomas Olsen , Mads Engelund , Jakob Schiøtz

This work introduces a moving anchor acceleration technique to extragradient algorithms for smooth structured minimax problems. The moving anchor is introduced as a generalization of the original algorithmic anchoring framework, i.e. the…

Optimization and Control · Mathematics 2025-06-03 James K. Alcala , Yat Tin Chow , Mahesh Sunkula

We propose a new globally convergent stochastic second order method. Our starting point is the development of a new Sketched Newton-Raphson (SNR) method for solving large scale nonlinear equations of the form $F(x)=0$ with $F:\mathbb{R}^p…

Numerical Analysis · Mathematics 2022-05-10 Rui Yuan , Alessandro Lazaric , Robert M. Gower

We analyze Newton's method with lazy Hessian updates for solving general possibly non-convex optimization problems. We propose to reuse a previously seen Hessian for several iterations while computing new gradients at each step of the…

Optimization and Control · Mathematics 2023-06-16 Nikita Doikov , El Mahdi Chayti , Martin Jaggi

Molecule-optimized basis sets, based on approximate natural orbitals, are developed for accelerating the convergence of quantum calculations with strongly correlated (multi-referenced) electrons. We use a low-cost approximate solution of…

Chemical Physics · Physics 2014-02-12 Gergely Gidofalvi , David A. Mazziotti