English
Related papers

Related papers: An adaptive selective frequency damping method

200 papers

Small-Signal Stability Constrained Optimal Power Flow (SSSC-OPF) can provide additional stability measures and control strategies to guarantee the system to be small-signal stable. However, due to the nonsmooth property of the spectral…

Optimization and Control · Mathematics 2016-08-15 Peijie Li , Junjian Qi , Jianhui Wang , Hua Wei , Xiaoqing Bai , Feng Qiu

This paper proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a \textit{fixed} time from any given initial condition for unconstrained optimization, constrained…

Optimization and Control · Mathematics 2022-04-27 Kunal Garg , Dimitra Panagou

Stochastic gradient descent (SGD) is a powerful optimization technique that is particularly useful in online learning scenarios. Its convergence analysis is relatively well understood under the assumption that the data samples are…

Machine Learning · Computer Science 2024-10-03 Ethan Che , Jing Dong , Xin T. Tong

The 3DVAR filter is prototypical of methods used to combine observed data with a dynamical system, online, in order to improve estimation of the state of the system. Such methods are used for high dimensional data assimilation problems,…

Probability · Mathematics 2015-06-11 D. Bloemker , K. J. H. Law , A. M. Stuart , K. C. Zygalakis

We propose a stochastic optimization method for minimizing loss functions, expressed as an expected value, that adaptively controls the batch size used in the computation of gradient approximations and the step size used to move along such…

Machine Learning · Computer Science 2020-03-04 Achraf Bahamou , Donald Goldfarb

The Finite State Projection (FSP) method approximates the Chemical Master Equation (CME) by restricting the dynamics to a finite subset of the (typically infinite) state space, enabling direct numerical solution with computable error…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Aditya Dendukuri , Shivkumar Chandrasekaran , Linda Petzold

In this article we present a goal-oriented adaptive finite element method for a class of subsurface flow problems in porous media, which exhibit seepage faces. We focus on a representative case of the steady state flows governed by a…

Numerical Analysis · Mathematics 2021-01-12 Ben Ashby , Cassiano Bortolozo , Alex Lukyanov , Tristan Pryer

The computation time required by standard finite difference methods with fixed timesteps for solving fractional diffusion equations is usually very large because the number of operations required to find the solution scales as the square of…

Numerical Analysis · Mathematics 2024-06-28 Santos B. Yuste , Joaquin Quintana-Murillo

Deep neural networks (DNN) are typically optimized using stochastic gradient descent (SGD). However, the estimation of the gradient using stochastic samples tends to be noisy and unreliable, resulting in large gradient variance and bad…

Machine Learning · Computer Science 2021-05-18 Xingyi Yang

The purpose of this paper is to develop a practical strategy to accelerate Newton's method in the vicinity of singular points. We present an adaptive safeguarding scheme with a tunable parameter, which we call adaptive gamma-safeguarding,…

Numerical Analysis · Mathematics 2024-08-23 Matt Dallas , Sara Pollock , Leo G. Rebholz

Many relevant problems in the area of systems and control, such as controller synthesis, observer design and model reduction, can be viewed as optimization problems involving dynamical systems: for instance, maximizing performance in the…

Optimization and Control · Mathematics 2023-11-15 Pascal Den Boef , Jos Maubach , Wil Schilders , Nathan van de Wouw

Computational fluid dynamics (CFD) simulations are broadly applied in engineering and physics. A standard description of fluid dynamics requires solving the Navier-Stokes (N-S) equations in different flow regimes. However, applications of…

Computational Engineering, Finance, and Science · Computer Science 2021-12-14 Shen Wang , Mehdi Nikfar , Joshua C. Agar , Yaling Liu

Diffusion models have achieved remarkable success in generative tasks but suffer from high computational costs due to their iterative sampling process and quadratic attention costs. Existing training-free acceleration strategies that reduce…

Machine Learning · Computer Science 2025-07-24 Ting Jiang , Yixiao Wang , Hancheng Ye , Zishan Shao , Jingwei Sun , Jingyang Zhang , Zekai Chen , Jianyi Zhang , Yiran Chen , Hai Li

Gradient-based methods are well-suited for derivative-free optimization (DFO), where finite-difference (FD) estimates are commonly used as gradient surrogates. Traditional stochastic approximation methods, such as Kiefer-Wolfowitz (KW) and…

Optimization and Control · Mathematics 2025-03-03 Guo Liang , Guangwu Liu , Kun Zhang

Flow matching (FM) has shown promising results in data-driven planning. However, it inherently lacks formal guarantees for ensuring state and action constraints, whose satisfaction is a fundamental and crucial requirement for the safety and…

Machine Learning · Computer Science 2025-12-02 Tzu-Yuan Huang , Armin Lederer , Dai-Jie Wu , Xiaobing Dai , Sihua Zhang , Stefan Sosnowski , Shao-Hua Sun , Sandra Hirche

Due to the black-box nature of inverters and the wide variation range of operating points, it is challenging to on-line predict and adaptively enhance the stability of inverter-based systems. To solve this problem, this paper provides a…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Yang Li , Xiangyang Wu , Zhikang Shuai , Junbin Fang , Lili He , Yi Lei , Z. John Shen

Stochastic Gradient Descent (SGD) and its momentum variants form the backbone of deep learning optimization, yet the underlying dynamics of their gradient behavior remain insufficiently understood. In this work, we reinterpret gradient…

Machine Learning · Computer Science 2026-03-09 Zhipeng Yao , Rui Yu , Guisong Chang , Ying Li , Yu Zhang , Dazhou Li

We introduce adaptive sampling methods for stochastic programs with deterministic constraints. First, we propose and analyze a variant of the stochastic projected gradient method where the sample size used to approximate the reduced…

Optimization and Control · Mathematics 2023-02-07 Florian Beiser , Brendan Keith , Simon Urbainczyk , Barbara Wohlmuth

With the increasing use of renewable generation in power systems, responsive resources will be necessary to support primary frequency control in future low-inertia/under-damped power systems. Flexible loads can provide fast-frequency…

Systems and Control · Electrical Eng. & Systems 2023-07-28 Hani Mavalizadeh , Luis A. Duffaut Espinosa , Mads R. Almassalkhi

The present study aims to extend the applicability of the static-boundary absorption method in phase-resolving CFD simulations outside the conventional shallow-water waves limit. Even though this method was originally formulated for…

Fluid Dynamics · Physics 2020-11-26 Muhannad W. Gamaleldin , Alexander V. Babanin , Amin Chabchoub