English
Related papers

Related papers: A trust-region augmented Hessian implementation fo…

200 papers

We present an algorithm to solve the CASSCF linear response equations that is both simple and efficient. The algorithm makes use of the well established symmetric and antisymmetric combinations of trial vectors, but further orthogonalizes…

Chemical Physics · Physics 2023-07-27 Riccardo Alessandro , Ivan Giannì , Federica Pes , Tommaso Nottoli , Filippo Lipparini

Recently, the impressive empirical success of policy gradient (PG) methods has catalyzed the development of their theoretical foundations. Despite the huge efforts directed at the design of efficient stochastic PG-type algorithms, the…

Machine Learning · Computer Science 2023-11-09 Ilyas Fatkhullin , Anas Barakat , Anastasia Kireeva , Niao He

We focus on the numerical approximation of the Cahn-Hilliard type equations, and present a family of second-order unconditionally energy-stable schemes. By reformulating the equation into an equivalent system employing a scalar auxiliary…

Fluid Dynamics · Physics 2018-03-19 Suchuan Dong , Zhiguo Yang , Lianlei Lin

Binary trust-region steepest descent (BTR) and combinatorial integral approximation (CIA) are two recently investigated approaches for the solution of optimization problems with distributed binary-/discrete-valued variables (control…

Optimization and Control · Mathematics 2024-02-14 Paul Manns , Mirko Hahn , Christian Kirches , Sven Leyffer , Sebastian Sager

Statistical preconditioning enables fast methods for distributed large-scale empirical risk minimization problems. In this approach, multiple worker nodes compute gradients in parallel, which are then used by the central node to update the…

In recent years, we have witnessed the emergence of scientific machine learning as a data-driven tool for the analysis, by means of deep-learning techniques, of data produced by computational science and engineering applications. At the…

Machine Learning · Computer Science 2024-03-20 Stefano Zampini , Umberto Zerbinati , George Turkiyyah , David Keyes

In this paper we devise and analyze an unconditionally stable, second-order-in-time numerical scheme for the Cahn-Hilliard equation in two and three space dimensions. We prove that our two-step scheme is unconditionally energy stable and…

Numerical Analysis · Mathematics 2014-11-20 Amanda E. Diegel , Cheng Wang , Steven M. Wise

This article is concerned with the numerical solution of subspace optimization problems, consisting of minimizing a smooth functional over the set of orthogonal projectors of fixed rank. Such problems are encountered in particular in…

Numerical Analysis · Mathematics 2022-10-17 Eric Cancès , Gaspard Kemlin , Antoine Levitt

In this paper the problem of consistency of smoothed particle hydrodynamics (SPH) is solved. A novel error analysis is developed in $n$-dimensional space using the Poisson summation formula, which enables the treatment of the kernel and…

Computational Physics · Physics 2019-04-09 Leonardo Di G. Sigalotti , Otto Rendón , Jaime Klapp , Carlos A. Vargas , Kilver Campos

First-order optimizers are reliable but slow in sharp, anisotropic regions. We study a curvature-adaptive method that periodically sketches a low-rank Hessian subspace via Hessian--vector products and preconditions gradients only in that…

Machine Learning · Computer Science 2025-11-18 Wenzhang Du

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

This paper proposes an implicit family of sub-step integration algorithms grounded in the explicit singly diagonally implicit Runge-Kutta (ESDIRK) method. The proposed methods achieve third-order consistency per sub-step and thus the…

Numerical Analysis · Mathematics 2025-06-05 Jinze Li , Hua Li , Kaiping Yu , Rui Zhao

We propose a novel second order in time numerical scheme for Cahn-Hilliard-Navier- Stokes phase field model with matched density. The scheme is based on second order convex-splitting for the Cahn-Hilliard equation and pressure-projection…

Numerical Analysis · Mathematics 2016-11-25 Daozhi Han , Xiaoming Wang

In this paper, we introduce a fourth-order accurate finite element method for incompressible variable density flow. The method is implicit in time and constructed with the Taylor series technique, and uses standard high-order Lagrange basis…

Numerical Analysis · Mathematics 2022-09-21 Lukas Lundgren , Murtazo Nazarov

An algorithm for solving smooth nonconvex optimization problems is proposed that, in the worst-case, takes $\mathcal{O}(\epsilon^{-3/2})$ iterations to drive the norm of the gradient of the objective function below a prescribed positive…

Optimization and Control · Mathematics 2018-03-16 Frank E. Curtis , Daniel P. Robinson , Mohammadreza Samadi

A very simple first-order algorithm is proposed for solving nonlinear optimization problems with deterministic nonlinear equality constraints. This algorithm adaptively selects steps in the plane tangent to the constraints or steps that…

Optimization and Control · Mathematics 2026-03-11 Serge Gratton , Philippe L. Toint

We derive and implement a second-order adjoint method to compute exact gradients and Hessians for a prototypical quantum optimal control problem, that of solving for the minimal energy applied electric field that drives a molecule from a…

Quantum Physics · Physics 2025-05-02 Harish S. Bhat

The total complexity (measured as the total number of gradient computations) of a stochastic first-order optimization algorithm that finds a first-order stationary point of a finite-sum smooth nonconvex objective function $F(w)=\frac{1}{n}…

Optimization and Control · Mathematics 2019-04-24 Lam M. Nguyen , Marten van Dijk , Dzung T. Phan , Phuong Ha Nguyen , Tsui-Wei Weng , Jayant R. Kalagnanam

We propose a nonsmooth trust-region method for solving optimization problems with locally Lipschitz continuous functions, with application to problems constrained by variational inequalities of the second kind. Under suitable assumptions on…

Optimization and Control · Mathematics 2018-01-17 Constantin Christof , Juan Carlos De Los Reyes , Christian Meyer

Smoothed particle hydrodynamics (SPH) offers distinct advantages for modeling many engineering problems, yet achieving high-order consistency in its conservative formulation remains to be addressed. While zero- and higher-order…

Fluid Dynamics · Physics 2024-06-06 Bo Zhang , Nikolaus Adams , Xiangyu Hu