English
Related papers

Related papers: Stability implies robust convergence of a class of…

200 papers

This paper analyses a $(1,\lambda)$-Evolution Strategy, a randomised comparison-based adaptive search algorithm, on a simple constraint optimisation problem. The algorithm uses resampling to handle the constraint and optimizes a linear…

Neural and Evolutionary Computing · Computer Science 2014-12-09 Alexandre Chotard , Anne Auger , Nikolaus Hansen

{\it Critical slowing down} associated with the iterative solvers close to the critical point often hinders large-scale numerical simulation of fracture using discrete lattice networks. This paper presents a block circlant preconditioner…

Materials Science · Physics 2009-11-11 Phani Kumar V. V. Nukala , Srdjan Simunovic

This paper presents a complementary approach to establish stability of finite receding horizon control with a terminal cost. First a new augmented stage cost is defined by rotating the terminal cost. Then a one-step optimisation problem is…

Optimization and Control · Mathematics 2023-01-31 Wen-Hua Chen , Yunda Yan

We develop new perturbation techniques for conducting convergence analysis of various first-order algorithms for a class of nonsmooth optimization problems. We consider the iteration scheme of an algorithm to construct a perturbed…

Optimization and Control · Mathematics 2018-10-25 Xiangfeng Wang , Jane Ye , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

Based on SGD, previous works have proposed many algorithms that have improved convergence speed and generalization in stochastic optimization, such as SGDm, AdaGrad, Adam, etc. However, their convergence analysis under non-convex conditions…

Machine Learning · Computer Science 2024-02-05 Yichuan Deng , Zhao Song , Chiwun Yang

This work focuses on the numerical approximations of neutral stochastic delay differential equations with their drift and diffusion coefficients growing super-linearly with respect to both delay variables and state variables. Under…

Numerical Analysis · Mathematics 2024-02-15 Jingjing Cai , Ziheng Chen , Yuanling Niu

The Allen-Cahn equation is a fundamental model for phase transitions, offering critical insights into the dynamics of interface evolution in various physical systems. This paper investigates the stability and robustness of frequently…

Numerical Analysis · Mathematics 2025-04-11 Wenrui Hao , Sun Lee , Xiaofeng Xu , Zhiliang Xu

In this paper, we propose a parallel-in-time algorithm for approximately solving parabolic equations. In particular, we apply the $k$-step backward differentiation formula, and then develop an iterative solver by using the waveform…

Numerical Analysis · Mathematics 2021-06-04 Shuonan Wu , Zhi Zhou

We establish new global bifurcation theorems for dynamical systems in terms of local semiflows on complete metric spaces. These theorems are applied to the nonlinear evolution equation $u_t+A u=f_\lambda(u)$ in a Banach space $X$, where $A$…

Dynamical Systems · Mathematics 2018-02-07 Luyan Zhou , Desheng Li

In this paper, we discuss the asymptotic behavior of the Upper Confidence Bound (UCB) algorithm in the context of multiarmed bandit problems and discuss its implication in downstream inferential tasks. While inferential tasks become…

Machine Learning · Statistics 2024-08-09 Koulik Khamaru , Cun-Hui Zhang

We focus on the problem of adding fault-tolerance to an existing concurrent protocol in the presence of {\em unchangeable environment actions}. Such unchangeable actions occur in practice due to several reasons. One instance includes the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-05 Mohammad Roohitavaf , Sandeep Kulkarni

We consider the problem of asynchronous stochastic optimization, where an optimization algorithm makes updates based on stale stochastic gradients of the objective that are subject to an arbitrary (possibly adversarial) sequence of delays.…

Optimization and Control · Mathematics 2025-06-23 Amit Attia , Ofir Gaash , Tomer Koren

We revisit the numerical stability of four well-established explicit stochastic integration schemes through a new generic benchmark stochastic differential equation designed to assess asymptotic statistical accuracy and stability…

Numerical Analysis · Mathematics 2026-05-20 Thomas Hudson , Sarah Helfert , Xingjie Helen Li

In this article, we derive fast and robust parallel-in-time preconditioned iterative methods for the all-at-once linear systems arising upon discretization of time-dependent PDEs. The discretization we employ is based on a Runge--Kutta…

Numerical Analysis · Mathematics 2023-04-25 Santolo Leveque , Luca Bergamaschi , Ángeles Martínez , John W. Pearson

An numerical iterative framework for global modal stability analysis of compressible flows using a parallel environment is presented. The framework uses a matrix-free implementation to allow computations of large scale problems. Various…

Fluid Dynamics · Physics 2015-02-13 O. Henze , M. Lemke , J. Sesterhenn

Iterative sketching and sketch-and-precondition are randomized algorithms used for solving overdetermined linear least-squares problems. When implemented in exact arithmetic, these algorithms produce high-accuracy solutions to least-squares…

Numerical Analysis · Mathematics 2024-04-15 Ethan N. Epperly

Stability analysis of Wilkinson's iterative refinement with a relaxation IR(omega) for solving linear systems is given. It extends existing results for omega=1, i.e., for Wilkinson's iterative refinement. We assume that all computations are…

Numerical Analysis · Mathematics 2015-12-15 Alicja Smoktunowicz , Jakub Kierzkowski , Iwona Wrobel

We say that an algorithm is stable if small changes in the input result in small changes in the output. This kind of algorithm stability is particularly relevant when analyzing and visualizing time-varying data. Stability in general plays…

Data Structures and Algorithms · Computer Science 2025-03-10 Wouter Meulemans , Bettina Speckmann , Kevin Verbeek , Jules Wulms

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

This paper studies the stability of covariance-intersection (CI)-based distributed Kalman filtering in time-varying systems. For the general time-varying case, a relationship between the error covariance and the observability Gramian is…

Systems and Control · Electrical Eng. & Systems 2025-04-09 Zhongyao Hu , Bo Chen , Chao Sun , Li Yu