English
Related papers

Related papers: Collocation methods for second and higher order sy…

200 papers

Optimizing problems in a distributed manner is critical for systems involving multiple agents with private data. Despite substantial interest, a unified method for analyzing the convergence rates of distributed optimization algorithms is…

Optimization and Control · Mathematics 2024-10-01 Mayank Baranwal , Kushal Chakrabarti

In this paper, we analyze the convergence of several discretize-then-optimize algorithms, based on either a second-order or a fourth-order finite difference discretization, for solving elliptic PDE-constrained optimization or optimal…

Numerical Analysis · Mathematics 2018-08-14 Jun Liu , Zhu Wang

Optimization in machine learning, both theoretical and applied, is presently dominated by first-order gradient methods such as stochastic gradient descent. Second-order optimization methods, that involve second derivatives and/or second…

Machine Learning · Computer Science 2021-03-08 Rohan Anil , Vineet Gupta , Tomer Koren , Kevin Regan , Yoram Singer

In a series of papers \cite{LSJR16, PP17, LPP}, it was established that some of the most commonly used first order methods almost surely (under random initializations) and with step-size being small enough, avoid strict saddle points, as…

Optimization and Control · Mathematics 2025-09-30 Ioannis Panageas , Georgios Piliouras , Xiao Wang

The elucidation of many physical problems in science and engineering is subject to the accurate numerical modelling of complex wave propagation phenomena. Over the last decades, high-order numerical approximation for partial differential…

Numerical Analysis · Mathematics 2025-10-20 Mathias Anselmann , Markus Bause

A conventional way to handle model predictive control (MPC) problems distributedly is to solve them via dual decomposition and gradient ascent. However, at each time-step, it might not be feasible to wait for the dual algorithm to converge.…

Optimization and Control · Mathematics 2015-03-13 Farhad Farokhi , Iman Shames , Karl H. Johansson

Model order reduction (MOR) has long been a mainstream strategy to accelerate large-scale transient circuit simulation. Dynamic Mode Decomposition (DMD) represents a novel data-driven characterization method, extracting dominant dynamical…

Signal Processing · Electrical Eng. & Systems 2025-08-06 Na Liu , Chengliang Dai , Qiuyue Wu , Qiuqi Li , Guoxiong Cai

Switching time optimization arises in finite-horizon optimal control for switched systems where, given a sequence of continuous dynamics, one minimizes a cost function with respect to the switching times. We propose an efficient method for…

Optimization and Control · Mathematics 2017-05-09 Bartolomeo Stellato , Sina Ober-Blöbaum , Paul J. Goulart

Time delays are a common perturbation in systems with many states, such as networked, distributed, or decentralized systems. Current methods analyzing the stability of large systems with time delay typically produce very conservative…

Systems and Control · Computer Science 2017-10-31 George Armanious , Rick Lind

Robotic pick and place stands at the heart of autonomous manipulation. When conducted in cluttered or complex environments robots must jointly reason about the selected grasp and desired placement locations to ensure success. While several…

Robotics · Computer Science 2024-02-15 Mohanraj Devendran Shanthi , Tucker Hermans

In this paper, a novel class of exponential Fourier collocation methods (EFCMs) is presented for solving systems of first-order ordinary differential equations. These so-called exponential Fourier collocation methods are based on the…

Numerical Analysis · Mathematics 2018-02-22 Bin Wang , Xinyuan Wu , Fanwei Meng , Yonglei Fang

Probabilistic solvers for ordinary differential equations (ODEs) provide efficient quantification of numerical uncertainty associated with simulation of dynamical systems. Their convergence rates have been established by a growing body of…

Machine Learning · Statistics 2020-12-21 Nicholas Krämer , Philipp Hennig

Dynamic programming algorithms have been successfully applied to propositional stochastic planning problems by using compact representations, in particular algebraic decision diagrams, to capture domain dynamics and value functions. Work on…

Artificial Intelligence · Computer Science 2014-01-17 Saket Joshi , Roni Khardon

Accurate maps are a prerequisite for virtually all mobile robot tasks. Most state-of-the-art maps assume a static world; therefore, dynamic objects are filtered out of the measurements. However, this division ignores movable but non-moving…

Robotics · Computer Science 2025-01-09 Matti Pekkanen , Francesco Verdoja , Ville Kyrki

The paper presents a general strategy to solve ordinary differential equations (ODE), where some coefficient depend on the spatial variable and on additional random variables. The approach is based on the application of a recently developed…

Numerical Analysis · Mathematics 2019-07-17 Maximilian Bochmann , Lutz Kämmerer , Daniel Potts

Direct multiple shooting (DMS) and direct collocation (DC) are two common transcription methods for solving optimal control problems (OCP) in biomechanics and robotics. They have rarely been compared in terms of solution and speed. Through…

Optimization and Control · Mathematics 2023-06-30 P. Puchaud , F. Bailly , M. Begon

Over the last few years there have been dramatic advances in our understanding of mathematical and computational models of complex systems in the presence of uncertainty. This has led to a growth in the area of uncertainty quantification as…

Numerical Analysis · Mathematics 2013-06-05 Maziar Raissi , Padmanabhan Seshaiyer

We analyze composition methods with complex coefficients exhibiting the so-called ``symmetry-conjugate'' pattern in their distribution. In particular, we study their behavior with respect to preservation of qualitative properties when…

Numerical Analysis · Mathematics 2021-01-12 Sergio Blanes , Fernando Casas , Philippe Chartier , Alejandro Escorihuela-Tomàs

This work proposes an adaptive structure-preserving model order reduction method for finite-dimensional parametrized Hamiltonian systems modeling non-dissipative phenomena. To overcome the slowly decaying Kolmogorov width typical of…

Numerical Analysis · Mathematics 2022-02-02 Jan S. Hesthaven , Cecilia Pagliantini , Nicolò Ripamonti

Learning dynamical systems through purely data-driven methods is challenging as they do not learn the underlying conservation laws that enable them to correctly generalize. Existing port-Hamiltonian neural network methods have recently been…

Machine Learning · Computer Science 2026-02-18 Maximino Linares , Guillaume Doras , Thomas Hélie