English
Related papers

Related papers: Newton methods for k-order Markov Constrained Moti…

200 papers

The objective of this paper is to introduce and demonstrate a robust method for multi-constrained topology optimization. The method is derived by combining the topological sensitivity with the classic augmented Lagrangian formulation. The…

Computational Engineering, Finance, and Science · Computer Science 2022-03-31 Shiguang Deng , Krishnan Suresh

The reasons which restrict opportunities of classical mechanics at the description of nonequilibrium systems are discussed. The way of overcoming of the key restrictions is offered. This way is based on an opportunity of representation of…

General Physics · Physics 2012-05-14 V. M. Somsikov

We analyze the performance of a variant of Newton method with quadratic regularization for solving composite convex minimization problems. At each step of our method, we choose regularization parameter proportional to a certain power of the…

Optimization and Control · Mathematics 2022-08-12 Nikita Doikov , Konstantin Mishchenko , Yurii Nesterov

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

Machine Learning · Computer Science 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

Newton-type methods enjoy fast local convergence and strong empirical performance, but achieving global guarantees comparable to first-order methods remains challenging. Even for simple strongly convex problems, no straightforward variant…

Numerical Analysis · Mathematics 2025-10-20 Alexander Lim , Fred Roosta

The focus in this work is on interior-point methods for inequality-constrained quadratic programs, and particularly on the system of nonlinear equations to be solved for each value of the barrier parameter. Newton iterations give high…

Optimization and Control · Mathematics 2024-01-24 David Ek , Anders Forsgren

A Newton-type active set algorithm for large-scale minimization subject to polyhedral constraints is proposed. The algorithm consists of a gradient projection step, a second-order Newton-type step in the null space of the constraint matrix,…

Optimization and Control · Mathematics 2021-01-12 William W. Hager , Davoud Ataee Tarzanagh

A survey of topics of recent interest in Hamiltonian and Lagrangian dynamical systems, including accessible discussions of regularization of the central force problem; inequivalent Lagrangians and Hamiltonians; constants of central force…

Classical Physics · Physics 2009-11-11 James T. Wheeler

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

The Knapsack Problem is a classic problem in combinatorial optimisation. Solving these problems may be computationally expensive. Recent years have seen a growing interest in the use of deep learning methods to approximate the solutions to…

Machine Learning · Computer Science 2023-12-07 Mitchell Keegan , Mahdi Abolghasemi

The problem of constrained Markov decision process is considered. An agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its costs (the number of constraints is relatively small). A new dual…

Optimization and Control · Mathematics 2022-10-21 Egor Gladin , Maksim Lavrik-Karmazin , Karina Zainullina , Varvara Rudenko , Alexander Gasnikov , Martin Takáč

Many problems in geometric optics or convex geometry can be recast as optimal transport problems: this includes the far-field reflector problem, Alexandrov's curvature prescription problem, etc. A popular way to solve these problems…

Numerical Analysis · Mathematics 2017-03-08 Jun Kitagawa , Quentin Mérigot , Boris Thibert

Uncertain dynamic obstacles, such as pedestrians or vehicles, pose a major challenge for optimal robot navigation with safety guarantees. Previous work on motion planning has followed two main strategies to provide a safe bound on an…

Placing robots outside controlled conditions requires versatile movement representations that allow robots to learn new tasks and adapt them to environmental changes. The introduction of obstacles or the placement of additional robots in…

Robotics · Computer Science 2022-01-06 Felix Frank , Alexandros Paraschos , Patrick van der Smagt , Botond Cseke

In this paper, we introduce faster accelerated primal-dual algorithms for minimizing a convex function subject to strongly convex function constraints. Prior to our work, the best complexity bound was $\mathcal{O}(1/{\varepsilon})$,…

Optimization and Control · Mathematics 2024-11-28 Zhenwei Lin , Qi Deng

Developing a contemporary optimal transport (OT) solver requires navigating trade-offs among several critical requirements: GPU parallelization, scalability to high-dimensional problems, theoretical convergence guarantees, empirical…

Machine Learning · Computer Science 2025-04-04 Mete Kemertas , Amir-massoud Farahmand , Allan D. Jepson

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

We focus on the optimization problem with smooth, possibly nonconvex objectives and a convex constraint set for which the Euclidean projection operation is practically available. Focusing on this setting, we carry out a general convergence…

Optimization and Control · Mathematics 2026-04-23 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Marco Sciandrone , Diego Scuppa

We study stochastic second-order methods for solving general non-convex optimization problems. We propose using a special version of momentum to stabilize the stochastic gradient and Hessian estimates in Newton's method. We show that…

Optimization and Control · Mathematics 2025-06-27 El Mahdi Chayti , Nikita Doikov , Martin Jaggi

Newton method is one of the most powerful methods for finding solutions of nonlinear equations and for proving their existence. In its "pure" form it has fast convergence near the solution, but small convergence domain. On the other hand…

Optimization and Control · Mathematics 2019-08-27 Boris Polyak , Andrey Tremba