English
Related papers

Related papers: Stable difference methods for block-oriented adapt…

200 papers

The stochastic gradient (SG) method can minimize an objective function composed of a large number of differentiable functions, or solve a stochastic optimization problem, to a moderate accuracy. The block coordinate descent/update (BCD)…

Optimization and Control · Mathematics 2015-11-23 Yangyang Xu , Wotao Yin

We design and analyze a new adaptive stabilized finite element method. We construct a discrete approximation of the solution in a continuous trial space by minimizing the residual measured in a dual norm of a discontinuous test space that…

Numerical Analysis · Mathematics 2020-04-22 Victor M. Calo , Alexandre Ern , Ignacio Muga , Sergio Rojas

Quantifying uncertainty in predictive simulations for real-world problems is of paramount importance - and far from trivial, mainly due to the large number of stochastic parameters and significant computational requirements. Adaptive sparse…

Computational Physics · Physics 2019-11-25 Ionut-Gabriel Farcas , Tobias Görler , Hans-Joachim Bungartz , Frank Jenko , Tobias Neckel

This paper introduces an adaptive time splitting technique for the solution of stiff evolutionary PDEs that guarantees an effective error control of the simulation, independent of the fastest physical time scale for highly unsteady…

Numerical Analysis · Mathematics 2012-04-10 Stéphane Descombes , Max Duarte , Thierry Dumont , Violaine Louvet , Marc Massot

In this paper we establish a stability barrier of a class of high-order Hermite-type discretization of 1D advection equations underlying the hybrid-variable (HV) and active flux (AF) methods. These methods seek numerical approximations to…

Numerical Analysis · Mathematics 2025-05-12 Xianyi Zeng

We present a new algorithm for numerical magnetohydrodynamics on staggered meshes preserving $\nabla \cdot B = 0$. Our algorithm is based on the constrained transport method and supports both cell-based adaptive mesh refinement and temporal…

Space Physics · Physics 2025-12-15 Ilja Honkonen , Riku Jarvinen , David Phillips

Many problems in control theory can be formulated as semidefinite programs (SDPs). For large-scale SDPs, it is important to exploit the inherent sparsity to improve the scalability. This paper develops efficient first-order methods to solve…

Optimization and Control · Mathematics 2020-01-13 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou , Paul Goulart , Andrew Wynn

The multi-resolution method, e.g., the Adaptive Particle Refinement (APR) method, has been developed to increase the local particle resolution and therefore the solution quality within a pre-defined refinement zone instead of using a…

Fluid Dynamics · Physics 2022-08-10 Tianrun Gao , Huihe Qiu , Lin Fu

To overcome the quadratic cost of self-attention, recent works have proposed various sparse attention modules, most of which fall under one of two groups: 1) sparse attention under a hand-crafted patterns and 2) full attention followed by a…

Machine Learning · Computer Science 2022-10-28 Sungjun Cho , Seonwoo Min , Jinwoo Kim , Moontae Lee , Honglak Lee , Seunghoon Hong

We consider monotone inclusion problems where the operators may be expectation-valued, a class of problems that subsumes convex stochastic optimization problems as well as subclasses of stochastic variational inequality and equilibrium…

Optimization and Control · Mathematics 2021-10-19 Shisheng Cui , Uday V. Shanbhag

The high-order accurate continuous Galerkin finite element method offers attractive computational efficiency for computational fluid dynamics. A challenge is however spurious oscillations which result for convection dominated flows over…

Numerical Analysis · Mathematics 2023-11-10 Arnaud G. Malan , Jan Nordstrom

We establish sharp well-posedness and approximation estimates for variational saddle point systems at the continuous level. The main results of this note have been known to be true only in the finite dimensional case. Known spectral results…

Numerical Analysis · Mathematics 2014-11-04 Constantin Bacuta

Summation-by-parts (SBP) finite-difference discretizations share many attractive properties with Galerkin finite-element methods (FEMs), including time stability and superconvergent functionals; however, unlike FEMs, SBP operators are not…

Numerical Analysis · Mathematics 2015-09-07 Jason E. Hicken , David C. Del Rey Fernández , David W. Zingg

An implicit method for the ohmic dissipation is proposed. The proposed method is based on the Crank-Nicolson method and exhibits second-order accuracy in time and space. The proposed method has been implemented in the SFUMATO adaptive mesh…

Instrumentation and Methods for Astrophysics · Physics 2015-05-19 Tomoaki Matsumoto

Stochastic gradient descent is a canonical tool for addressing stochastic optimization problems, and forms the bedrock of modern machine learning and statistics. In this work, we seek to balance the fact that attenuating step-size is…

Signal Processing · Electrical Eng. & Systems 2020-07-10 Zhan Gao , Alec Koppel , Alejandro Ribeiro

We present compact semi-implicit finite difference schemes on structured grids for numerical solutions of the advection by an external velocity and by a speed in normal direction that are applicable in level set methods. The most involved…

Numerical Analysis · Mathematics 2023-12-01 Peter Frolkovič , Nikola Gajdošová

This work is focused on the extension and assessment of the monotonicity-preserving scheme in [3] and the local bounds preserving scheme in [5] to hierarchical octree adaptive mesh refinement (AMR). Whereas the former can readily be used on…

Numerical Analysis · Mathematics 2020-06-24 Jesus Bonilla , Santiago Badia

A framework is introduced for solving a sequence of slowly changing optimization problems, including those arising in regression and classification applications, using optimization algorithms such as stochastic gradient descent (SGD). The…

Machine Learning · Computer Science 2015-09-25 Craig Wilson , Venugopal V. Veeravalli

A very popular approach for solving stochastic optimization problems is the stochastic gradient descent method (SGD). Although the SGD iteration is computationally cheap and the practical performance of this method may be satisfactory under…

Optimization and Control · Mathematics 2017-06-21 Andrei Patrascu , Ion Necoara

The analysis of structure-preserving numerical methods for the Poisson--Nernst--Planck (PNP) system has attracted growing interests in recent years. In this work, we provide an optimal rate convergence analysis and error estimate for finite…

Numerical Analysis · Mathematics 2022-02-23 Jie Ding , Cheng Wang , Shenggao Zhou