English
Related papers

Related papers: A Merit Function Approach for Evolution Strategies

200 papers

We develop a framework for convexifying a fairly general class of optimization problems. Under additional assumptions, we analyze the suboptimality of the solution to the convexified problem relative to the original nonconvex problem and…

Systems and Control · Computer Science 2014-06-04 Krishnamurthy Dvijotham , Maryam Fazel , Emanuel Todorov

There are two distinct approaches to solving reinforcement learning problems, namely, searching in value function space and searching in policy space. Temporal difference methods and evolutionary algorithms are well-known examples of these…

Machine Learning · Computer Science 2011-06-02 J. J. Grefenstette , D. E. Moriarty , A. C. Schultz

This paper contributes to the treatment of extensive constraints in evolutionary many-constraint optimization through consideration of the relationships between pair-wise constraints. In a conflicting relationship, the functional value of…

Artificial Intelligence · Computer Science 2020-10-12 Mengjun Ming , Rui Wang , Tao Zhang

Newton's method has been an important approach for solving variational inequalities, quasi-Newton method is a good alternative choice to save computational cost. In this paper, we propose a new method for solving monotone variational…

Optimization and Control · Mathematics 2025-05-20 Yuge Ye , Qingna Li , Deren Han

Existing evolutionary algorithms for Constrained Multi-objective Optimization Problems (CMOPs) typically treat all constraints uniformly, overlooking their distinct geometric relationships with the true Constrained Pareto Front (CPF). In…

Neural and Evolutionary Computing · Computer Science 2026-04-07 Ruiqing Sun , Dawei Feng , Sheng Qi , Xing Zhou , Lianghao Li , Bo Ding , Yijie Wang , Rui Wang , Huaimin Wang

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt

There is an abundance of empirical evidence in the numerical relativity literature that the form in which the Einstein evolution equations are written plays a significant role in the lifetime of numerical simulations. This paper attempts to…

General Relativity and Quantum Cosmology · Physics 2009-11-10 David R. Fiske

Constrained multi-objective optimization problems (CMOPs) pervade real-world applications in science, engineering, and design. Constraint violation has been a building block in designing evolutionary multi-objective optimization algorithms…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Shuang Li , Ke Li , Wei Li , Ming Yang

In this paper, an evolutionary strategy (ES) method is introduced as an optimization approach to solve problems in the manufacturing area. The ES method is applied to a case study for milling operations. The results show that it can…

Optimization and Control · Mathematics 2015-01-08 Zhixin Yang

Reinforcement Learning (RL) serves as a versatile framework for sequential decision-making, finding applications across diverse domains such as robotics, autonomous driving, recommendation systems, supply chain optimization, biology,…

Machine Learning · Computer Science 2024-08-26 Vaneet Aggarwal , Washim Uddin Mondal , Qinbo Bai

Evolutionary algorithms are sensitive to the mutation rate (MR); no single value of this parameter works well across domains. Self-adaptive MR approaches have been proposed but they tend to be brittle: Sometimes they decay the MR to zero,…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Akarsh Kumar , Bo Liu , Risto Miikkulainen , Peter Stone

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

Directional motion towards a specified destination is a common occurrence in physical processes and human societal activities. Utilizing this prior information can significantly improve the control and predictive performance of system…

Systems and Control · Electrical Eng. & Systems 2024-03-27 Xiaowei Yang , Haiqi Liu , Fanqin Meng , Xiaojing Shen

This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints…

Optimization and Control · Mathematics 2022-04-20 Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz , Gerd Wachsmuth

Policy gradient methods, which have been extensively studied in the last decade, offer an effective and efficient framework for reinforcement learning problems. However, their performances can often be unsatisfactory, suffering from…

Machine Learning · Computer Science 2026-01-27 Shihab Ahmed , El Houcine Bergou , Aritra Dutta , Yue Wang

We study the theory of systems with constraints from the point of view of the formal theory of partial differential equations. For finite-dimensional systems we show that the Dirac algorithm completes the equations of motion to an…

High Energy Physics - Theory · Physics 2009-10-28 Werner M. Seiler , Robin W. Tucker

We propose, analyze, and test a proximal-gradient method for solving regularized optimization problems with general constraints. The method employs a decomposition strategy to compute trial steps and uses a merit function to determine step…

Optimization and Control · Mathematics 2026-01-16 Frank E. Curtis , Xiaoyi Qu , Daniel P. Robinson

In this work, we deal with the problem of computing a comprehensive front of efficient solutions in multi-objective portfolio optimization problems in presence of sparsity constraints. We start the discussion pointing out some weaknesses of…

Optimization and Control · Mathematics 2025-09-23 Arturo Annunziata , Matteo Lapucci , Pieluigi Mansueto , Davide Pucci

In this article we provide a comprehensive review of the different evolutionary algorithm techniques used to address multimodal optimization problems, classifying them according to the nature of their approach. On the one hand there are…

Neural and Evolutionary Computing · Computer Science 2015-08-24 Noe Casas

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng