相关论文: Improved scalar auxiliary variable schemes for ori…

Recent advances in the literature have demonstrated that standard supervised learning algorithms are ill-suited for problems with endogenous explanatory variables. To correct for the endogeneity bias, many variants of nonparameteric…

In this paper, we focus on Stochastic Amplitude Flow (SAF) for phase retrieval, a stochastic gradient descent for the amplitude-based squared loss. While the convergence to a critical point of (nonstochastic) Amplitude Flow is…

We present and analyze several strategies for improving the performance of stochastic variance-reduced gradient (SVRG) methods. We first show that the convergence rate of these methods can be preserved under a decreasing sequence of errors…

We develop and analyze a variant of the SARAH algorithm, which does not require computation of the exact gradient. Thus this new method can be applied to general expectation minimization problems rather than only finite sum problems. While…

We propose a novel Skew Gradient Embedding (SGE) framework for systematically reformulating thermodynamically consistent partial differential equation (PDE) models-capturing both reversible and irreversible processes-as generalized gradient…

We introduce a novel and efficient algorithm called the stochastic approximate gradient descent (SAGD), as an alternative to the stochastic gradient descent for cases where unbiased stochastic gradients cannot be trivially obtained.…

We fill the two main remaining gaps in the full classification of non-degenerate planar traveling waves of scalar balance laws from the point of view of spectral and nonlinear stability/instability under smooth perturbations. On one hand we…

Self-adjusting steepness (SAS)-based schemes preserve various structures in the compressible flows. These schemes provide a range of desired behaviors depending on the steepness-adjustable limiters with the steepness measured by a steepness…

We propose in this paper efficient first/second-order time-stepping schemes for the evolutional Navier-Stokes-Nernst-Planck-Poisson equations. The proposed schemes are constructed using an auxiliary variable reformulation and sophisticated…

A novel notion for constructing a well-balanced scheme - a gradient-robust scheme - is introduced and a showcase application for a steady compressible, isothermal Stokes equations is presented. Gradient-robustness means that arbitrary…

Estimating depth from stereo vision cameras, i.e., "depth from stereo", is critical to emerging intelligent applications deployed in energy- and performance-constrained devices, such as augmented reality headsets and mobile autonomous…

Existing algorithms to solve alternating-current optimal power flow (AC-OPF) often exploit linear approximations to simplify system models and accelerate computations. In this paper, we improve a recent hierarchical OPF algorithm, which…

In this work, we study long-time numerical integration of Hamiltonian systems subject to linear perturbations. By introducing an energy-induced metric, we establish a straightforward, coordinate-free criterion for dissipativity that ensures…

We propose a statistical adaptive procedure called SALSA for automatically scheduling the learning rate (step size) in stochastic gradient methods. SALSA first uses a smoothed stochastic line-search procedure to gradually increase the…

In today's cyber-enabled smart grids, high penetration of uncertain renewables, purposeful manipulation of meter readings, and the need for wide-area situational awareness, call for fast, accurate, and robust power system state estimation.…

Currently existing energy-stable parametric finite element methods for surface diffusion flow and other flows are usually limited to first-order accuracy in time. Designing a high-order algorithm for geometric flows that can also be…

We develop a stable and efficient numerical scheme for modeling the optical field evolution in a nonlinear dispersive cavity with counter propagating waves and complex, semiconductor physics gain dynamics that are expensive to evaluate. Our…

In this work, we investigate (energy) stability of global radial basis function (RBF) methods for linear advection problems. Classically, boundary conditions (BC) are enforced strongly in RBF methods. By now it is well-known that this can…

This paper develops three linear and energy-stable schemes for a modified phase field crystal model with a strong nonlinear vacancy potential (VMPFC model). This sixth-order phase-field model enables realistic crystal growth simulation.…

In this paper, we propose a novel sufficient decrease technique for variance reduced stochastic gradient descent methods such as SAG, SVRG and SAGA. In order to make sufficient decrease for stochastic optimization, we design a new…