English
Related papers

Related papers: Collocation methods for second and higher order sy…

200 papers

Motion planning and control problems are embedded and essential in almost all robotics applications. These problems are often formulated as stochastic optimal control problems and solved using dynamic programming algorithms. Unfortunately,…

Robotics · Computer Science 2018-01-12 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

Stochastic optimization methods have actively been playing a critical role in modern machine learning algorithms to deliver decent performance. While numerous works have proposed and developed diverse approaches, first-order and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Zhanhong Jiang , Md Zahid Hasan , Aditya Balu , Joshua R. Waite , Genyi Huang , Soumik Sarkar

We provide a novel computer-assisted technique for systematically analyzing first-order methods for optimization. In contrast with previous works, the approach is particularly suited for handling sublinear convergence rates and stochastic…

Optimization and Control · Mathematics 2021-12-22 Adrien Taylor , Francis Bach

Several interesting problems in multi-robot systems can be cast in the framework of distributed optimization. Examples include multi-robot task allocation, vehicle routing, target protection, and surveillance. While the theoretical analysis…

Robotics · Computer Science 2025-04-03 Andrea Testa , Guido Carnevale , Giuseppe Notarstefano

These notes focus on the minimization of convex functionals using first-order optimization methods, which are fundamental in many areas of applied mathematics and engineering. The primary goal of this document is to introduce and analyze…

Optimization and Control · Mathematics 2024-10-28 Charles Dossal , Samuel Hurault , Nicolas Papadakis

An adaptive direct collocation method is developed for solving optimal control problems constrained by parabolic partial differential equations. The partial differential equation is first reformulated in a variational setting, where the…

Optimization and Control · Mathematics 2026-03-18 Alexander M. Davies , Sara Pollock , Miriam E. Dennis , Anil V. Rao

In dual decomposition, the dual to an optimization problem with a specific structure is solved in distributed fashion using (sub)gradient and recently also fast gradient methods. The traditional dual decomposition suffers from two main…

Optimization and Control · Mathematics 2014-04-08 Pontus Giselsson

We introduce a novel technique for constructing higher-order variational integrators for Hamiltonian systems of ODEs. In particular, we are concerned with generating globally smooth approximations to solutions of a Hamiltonian system. Our…

Numerical Analysis · Mathematics 2015-03-17 Melvin Leok , Tatiana Shingel

In this work, we propose a high-order multiscale method for an elliptic model problem with rough and possibly highly oscillatory coefficients. Convergence rates of higher order are obtained using the regularity of the right-hand side only.…

Numerical Analysis · Mathematics 2023-04-18 Zhaonan Dong , Moritz Hauck , Roland Maier

First-order methods for solving convex optimization problems have been at the forefront of mathematical optimization in the last 20 years. The rapid development of this important class of algorithms is motivated by the success stories…

Optimization and Control · Mathematics 2021-01-07 Pavel Dvurechensky , Mathias Staudigl , Shimrit Shtern

The size and complexity of software and hardware systems have significantly increased in the past years. As a result, it is harder to guarantee their correct behavior. One of the most successful methods for automated verification of…

Artificial Intelligence · Computer Science 2011-07-04 O. Grumberg , S. Livne , S. Markovitch

Higher-order tensor methods were recently proposed for minimizing smooth convex and nonconvex functions. Higher-order algorithms accelerate the convergence of the classical first-order methods thanks to the higher-order derivatives used in…

Optimization and Control · Mathematics 2024-01-11 Ion Necoara

The optimal control of a mechanical system is of crucial importance in many realms. Typical examples are the determination of a time-minimal path in vehicle dynamics, a minimal energy trajectory in space mission design, or optimal motion…

Optimization and Control · Mathematics 2008-10-09 S. Ober-Bloebaum , O. Junge , J. E. Marsden

Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical…

Optimization and Control · Mathematics 2022-05-23 Xin He , Rong Hu , Ya-Ping Fang

A central challenge to using first-order methods for optimizing nonconvex problems is the presence of saddle points. First-order methods often get stuck at saddle points, greatly deteriorating their performance. Typically, to escape from…

Machine Learning · Computer Science 2017-09-06 Sashank J Reddi , Manzil Zaheer , Suvrit Sra , Barnabas Poczos , Francis Bach , Ruslan Salakhutdinov , Alexander J Smola

For constrained system which has several independent first integrals, we give a new stabilization method which named adjustment-stabilization method. It can stabilize all known constants of motion for a given dynamical system very well…

Computational Physics · Physics 2010-06-14 Wen-biao Han , Xin-hao Liao

Assembly of large scale structural systems in space is understood as critical to serving applications that cannot be deployed from a single launch. Recent literature proposes the use of discrete modular structures for in-space assembly and…

Multiagent Systems · Computer Science 2020-08-28 Allan Costa , Benjamin Jenett , Irina Kostitsyna , Amira Abdel-Rahman , Neil Gershenfeld , Kenneth Cheung

There is a rising interest in Spatio-temporal systems described by Partial Differential Equations (PDEs) among the control community. Not only are these systems challenging to control, but the sizing and placement of their actuation is an…

Optimization and Control · Mathematics 2020-02-05 Ethan N. Evans , Andrew P. Kendall , George I. Boutselis , Evangelos A. Theodorou

The output-error method is a mainstay of aircraft system identification from flight-test data. It is the method of choice for a wide range of applications, from the estimation of stability and control derivatives for aerodynamic database…

Computation · Statistics 2019-09-09 Dimas Abreu Archanjo Dutra

Distributed optimization is the standard way of speeding up machine learning training, and most of the research in the area focuses on distributed first-order, gradient-based methods. Yet, there are settings where some…

Machine Learning · Computer Science 2025-11-03 Matin Ansaripour , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh