English
Related papers

Related papers: An optimization-based reformulation of the classic…

200 papers

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average…

Optimization and Control · Mathematics 2019-04-16 Damien Scieur , Alexandre d'Aspremont , Francis Bach

Stochastic resetting, the procedure of stopping and re-initializing random processes, has recently emerged as a powerful tool for accelerating processes ranging from queuing systems to molecular simulations. However, its usefulness is…

Statistical Mechanics · Physics 2025-03-18 Tommer D. Keidar , Ofir Blumer , Barak Hirshberg , Shlomi Reuveni

In terms of the concepts of state and state transition, a new algorithm-State Transition Algorithm (STA) is proposed in order to probe into classical and intelligent optimization algorithms. On the basis of state and state transition, it…

Optimization and Control · Mathematics 2012-10-15 Xiaojun Zhou , Chunhua Yang , Weihua Gui

State redistribution is an algorithm that stabilizes cut cells for embedded boundary grid methods. This work extends the earlier algorithm in several important ways. First, state redistribution is extended to three spatial dimensions.…

Motivated by variational models in continuum mechanics, we introduce a novel algorithm to perform nonsmooth and nonconvex minimizations with linear constraints in Euclidean spaces. We show how this algorithm is actually a natural…

Analysis of PDEs · Mathematics 2015-03-20 Marco Artina , Massimo Fornasier , Francesco Solombrino

In this paper we address the numerical solution of nonlinear ill-posed systems by iterative regularization methods in the classes of Levenberg-Marquardt, trust-region and adaptive quadratic regularization procedures. Both with exact and…

Numerical Analysis · Mathematics 2015-04-17 Stefania Bellavia , Benedetta Morini

In terms of the concepts of state and state transition, a new heuristic random search algorithm named state transition algorithm is proposed. For continuous function optimization problems, four special transformation operators called…

Optimization and Control · Mathematics 2013-12-10 Xiaojun Zhou , Chunhua Yang , Weihua Gui

Nonlinear optimal control problems for trajectory planning with obstacle avoidance present several challenges. While general-purpose optimizers and dynamic programming methods struggle when adopted separately, their combination enabled by a…

Optimization and Control · Mathematics 2024-08-09 Rebecca Richter , Alberto De Marchi , Matthias Gerdts

State estimation aims at approximately reconstructing the solution $u$ to a parametrized partial differential equation from $m$ linear measurements, when the parameter vector $y$ is unknown. Fast numerical recovery methods have been…

Numerical Analysis · Mathematics 2020-11-25 Albert Cohen , Wolfgang Dahmen , Olga Mula , James Nichols

This work explores the global optimization problem of finding lowest-energy configurations (ground states) in disordered continuous spins models from statistical physics, with a particular focus on the random field XY model. Due to an…

Optimization and Control · Mathematics 2026-05-07 Ramgopal Agrawal , Lorenzo Ciarpaglini , Enzo Marinari , Marco Sciandrone , Diego Scuppa , Elisa Trasatti

In the classical stochastic resetting problem, a particle, moving according to some stochastic dynamics, undergoes random interruptions that bring it to a selected domain, and then, the process recommences. Hitherto, the resetting mechanism…

Statistical Mechanics · Physics 2020-12-08 Carlos A. Plata , Deepak Gupta , Sandro Azaele

We propose a novel algorithm for solving non-convex, nonlinear equality-constrained finite-sum optimization problems. The proposed algorithm incorporates an additional sampling strategy for sample size update into the well-known framework…

Optimization and Control · Mathematics 2025-08-05 Nataša Krejić , Nataša Krklec Jerinkić , Tijana Ostojić , Nemanja Vučićević

A classical reduced order model for dynamical problems involves spatial reduction of the problem size. However, temporal reduction accompanied by the spatial reduction can further reduce the problem size without losing accuracy much, which…

Numerical Analysis · Mathematics 2019-10-04 Youngsoo Choi , Peter Brown , Bill Arrighi , Robert Anderson

In this work, we present methods for state estimation in continuous-discrete nonlinear systems involving stochastic differential equations. We present the extended Kalman filter, the unscented Kalman filter, the ensemble Kalman filter, and…

The Expectation-Maximization (EM) algorithm is a popular choice for learning latent variable models. Variants of the EM have been initially introduced, using incremental updates to scale to large datasets, and using Monte Carlo (MC)…

Machine Learning · Statistics 2022-03-22 Belhal Karimi , Ping Li

We present a classical algorithm to find approximate solutions to instances of quadratic unconstrained binary optimisation. The algorithm can be seen as an analogue of quantum annealing under the restriction of a product state space, where…

Quantum Physics · Physics 2023-02-14 Joseph Bowles , Alexandre Dauphin , Patrick Huembeli , José Martinez , Antonio Acín

Economic dispatch problem for a networked power system has been considered. The objective is to minimize the total generation cost while meeting the overall supply-demand balance and generation capacity. In particular, a more practical…

Systems and Control · Computer Science 2019-05-01 Seungjoon Lee , Hyungbo Shim

This paper presents a constrained adaptive dynamic programming (CADP) algorithm to solve general nonlinear nonaffine optimal control problems with known dynamics. Unlike previous ADP algorithms, it can directly deal with problems with state…

Systems and Control · Electrical Eng. & Systems 2022-04-11 Jingliang Duan , Zhengyu Liu , Shengbo Eben Li , Qi Sun , Zhenzhong Jia , Bo Cheng

This paper presents a novel approach to solving large-scale minimax problems with nonsmooth regularizers. We propose a stochastic implicit proximal point algorithm with variance reduction techniques where stochastic oracles are selected in…

Optimization and Control · Mathematics 2026-05-25 Kehan Zhu , Jiani Wang , Yu-Hong Dai

Reconstruction techniques are commonly used in cosmology to reduce complicated nonlinear behaviours to a more tractable linearized system. We study a new reconstruction technique that uses the Moving-Mesh algorithm to estimate the…

Cosmology and Nongalactic Astrophysics · Physics 2017-06-21 Qiaoyin Pan , Ue-Li Pen , Derek Inman , Hao-Ran Yu