Related papers: A speed restart scheme for a dynamics with Hessian…
Based on an observation that additive Schwarz methods for general convex optimization can be interpreted as gradient methods, we propose an acceleration scheme for additive Schwarz methods. Adopting acceleration techniques developed for…
In a smoothly bounded convex domain $\Omega\subset R^n$ with $n\ge 1$, a no-flux initial-boundary value problem for \[ \left\{ \begin{array}{l} u_t=\Delta \big(u\phi(v)\big), v_t=\Delta v-uv, \end{array} \right. \] is considered under the…
In this paper, through a very intuitive vanilla proximal method perspective, we derive accelerated high-order optimization algorithms for minimizing a convex function that has H\"{o}lder continuous derivatives. In this general convex…
We propose a generic framework based on a new stochastic variance-reduced gradient descent algorithm for accelerating nonconvex low-rank matrix recovery. Starting from an appropriate initial estimator, our proposed algorithm performs…
We propose a structure-adaptive variant of the state-of-the-art stochastic variance-reduced gradient algorithm Katyusha for regularized empirical risk minimization. The proposed method is able to exploit the intrinsic low-dimensional…
Geometric numerical integration has recently been exploited to design symplectic accelerated optimization algorithms by simulating the Lagrangian and Hamiltonian systems from the variational framework introduced in Wibisono et al. In this…
We study the Hamiltonian flow for optimization (HF-opt), which simulates the Hamiltonian dynamics for some integration time and resets the velocity to $0$ to decrease the objective function; this is the optimization analogue of the…
We propose a new approach to perform the boosted difference of convex functions algorithm (BDCA) on non-smooth and non-convex problems involving the difference of convex (DC) functions. The recently proposed BDCA uses an extrapolation step…
Infrequent Metadynamics is a popular method to obtain the rates of long timescale processes from accelerated simulations. The inference procedure is based on rescaling the first-passage times of Metadynamics trajectories using a…
We propose HAMSI (Hessian Approximated Multiple Subsets Iteration), which is a provably convergent, second order incremental algorithm for solving large-scale partially separable optimization problems. The algorithm is based on a local…
In this paper we study the support recovery problem for single index models $Y=f(\boldsymbol{X}^{\intercal} \boldsymbol{\beta},\varepsilon)$, where $f$ is an unknown link function, $\boldsymbol{X}\sim N_p(0,\mathbb{I}_{p})$ and…
We present a constrained formulation of Dedner et al's hyperbolic/parabolic divergence cleaning scheme for enforcing the \nabla\dot B = 0 constraint in Smoothed Particle Magnetohydrodynamics (SPMHD) simulations. The constraint we impose is…
Motivated by a constrained minimization problem, it is studied the gradient flows with respect to Hessian Riemannian metrics induced by convex functions of Legendre type. The first result characterizes Hessian Riemannian structures on…
Dynamical mean-field theory (DMFT) is a cornerstone technique for studying strongly correlated electronic systems. However, each DMFT step is computationally demanding, and many iterations can be required to achieve convergence. Here, we…
We consider the $\nabla \phi$ interface model with a uniformly convex interaction potential possessing H\"older continuous second derivatives. Combining ideas of Naddaf and Spencer with methods from quantitative homogenization, we show that…
Let us consider a family $F(\alpha,\beta,\gamma,\delta)$ of convex quadrangles in the plane with given angles $\{\alpha,\beta,\gamma,\delta\}$ and with the perimeter $2\pi$. Such quadrangle $Q\in F(\alpha,\beta,\gamma,\delta)$ can be…
This work aims to minimize a continuously differentiable convex function with Lipschitz continuous gradient under linear equality constraints. The proposed inertial algorithm results from the discretization of the second-order primal-dual…
In a recent work (Covas et al. 1997), the behaviour and the robustness of truncated $\alpha\Omega$ dynamos with a dynamic $\alpha$ were studied with respect to a number of changes in the driving term of the dynamic $\alpha$ equation, which…
This paper investigates the problem of recovering source terms in abstract initial value problems (IVP) commonly used to model various scientific phenomena in physics, chemistry, economics, and other fields. We consider source terms of the…
Iterative algorithms based on thresholding, feedback and null space tuning (NST+HT+FB) for sparse signal recovery are exceedingly effective and fast, particularly for large scale problems. The core algorithm is shown to converge in finitely…