English
Related papers

Related papers: Abstraction-based branch and bound approach to Q-l…

200 papers

Hybrid optimal control problems are studied for a general class of hybrid systems where autonomous and controlled state jumps are allowed at the switching instants and in addition to terminal and running costs switching between discrete…

Optimization and Control · Mathematics 2017-02-22 Ali Pakniyat , Peter E. Caines

We propose a new approach to solving dynamic decision problems with unbounded rewards based on the transformations used in Q-learning. In our case, the objective of the transform is to convert an unbounded dynamic program into a bounded…

Optimization and Control · Mathematics 2022-08-02 Qingyin Ma , John Stachurski , Alexis Akira Toda

This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical…

Robotics · Computer Science 2023-12-06 Mohammad Safeea , Pedro Neto

This work solves suboptimal mixed-integer quadratic programs recursively for feedback control of dynamical systems. The proposed framework leverages parametric mixed-integer quadratic programming (MIQP) and hybrid systems theory to model a…

Optimization and Control · Mathematics 2025-07-04 Luke Fina , Christopher Petersen

In this work, we develop a control-theoretic framework for constrained optimization problems with composite objective functions including non-differentiable terms. Building on the proximal augmented Lagrangian formulation, we construct a…

Optimization and Control · Mathematics 2026-05-05 V. Cerone , S. M. Fosson , S. Pirrera , A. Re , D. Regruto

This paper presents a control architecture in which a direct adaptive control technique is used within the model predictive control framework, using the concurrent learning based approach, to compensate for model uncertainties. At each time…

Optimization and Control · Mathematics 2015-02-02 Olugbenga Moses Anubi

Aerial manipulators (AM) exhibit particularly challenging, non-linear dynamics; the UAV and the manipulator it is carrying form a tightly coupled dynamic system, mutually impacting each other. The mathematical model describing these…

Robotics · Computer Science 2022-10-11 Paul Kremer , Jose Luis Sanchez-Lopez , Holger Voos

The main challenge in controlling hybrid systems arises from having to consider an exponential number of sequences of future modes to make good long-term decisions. Model predictive control (MPC) computes a control action through a…

Optimization and Control · Mathematics 2021-06-09 Sandeep Menta , Joseph Warrington , John Lygeros , Manfred Morari

We consider an LQR optimal control problem with partially unknown dynamics. We propose a new model-based online algorithm to obtain an approximation of the dynamics $and$ the control at the same time during a single simulation.

Numerical Analysis · Mathematics 2021-05-31 Agnese Pacifico , Andrea Pesare , Maurizio Falcone

We consider covariance control problems for nonlinear stochastic systems. Our objective is to find an optimal control strategy to steer the state from an initial distribution to a terminal one with specified mean and covariance. This…

Systems and Control · Electrical Eng. & Systems 2019-11-22 Zeji Yi , Zhefeng Cao , Evangelos Theodorou , Yongxin Chen

We propose an approach to solving constrained combinatorial optimization problems based on embedding the concept of Lagrangian duality into the framework of adiabatic quantum computation. Within the setting of circuit-model fault-tolerant…

Optimization and Control · Mathematics 2024-04-30 Einar Gabbassov , Gili Rosenberg , Artur Scherer

Model-free learning-based control methods have seen great success recently. However, such methods typically suffer from poor sample complexity and limited convergence guarantees. This is in sharp contrast to classical model-based control,…

Optimization and Control · Mathematics 2020-06-16 Guannan Qu , Chenkai Yu , Steven Low , Adam Wierman

Creating a simulation of a system enables the tuning of control systems without the need for a physical system. In this paper, we employ Lagrangian Mechanics to derive a set of equations to simulate an inverted pendulum on a cart. The…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Ethan Kou , Majid Moghadam

Learning accurate dynamics models is necessary for optimal, compliant control of robotic systems. Current approaches to white-box modeling using analytic parameterizations, or black-box modeling using neural networks, can suffer from high…

Robotics · Computer Science 2019-03-05 Jayesh K. Gupta , Kunal Menda , Zachary Manchester , Mykel J. Kochenderfer

This work considers the problem of approximating initial condition and time-dependent optimal control and trajectory surfaces using multivariable Fourier series. A modified Augmented Lagrangian algorithm for translating the optimal control…

Optimization and Control · Mathematics 2023-12-14 Gabriel Nicolosi , Terry Friesz , Christopher Griffin

This article introduces the novel framework of max-algebraic hybrid automata as a hybrid modelling language in the max-plus algebra. We show that the modelling framework unifies and extends the switching max-plus linear systems framework…

Formal Languages and Automata Theory · Computer Science 2021-11-22 A. Gupta , B. De Schutter , J. van der Woude , T. van den Boom

This paper presents a novel approach to including non-instantaneous discrete control transitions in the linear hybrid automaton approach to simulation and verification of hybrid control systems. In this paper we study the control of a…

Systems and Control · Computer Science 2015-01-26 Avinash Malik , Partha Roop

We consider optimal control problems for partial differential equations where the controls take binary values but vary over the time horizon, they can thus be seen as dynamic switches. The switching patterns may be subject to combinatorial…

Optimization and Control · Mathematics 2024-04-04 Christoph Buchheim , Alexandra Grütering , Christian Meyer

In branching simulation, a novel approach to simulation presented in this paper, a multiplicity of plausible scenarios are concurrently developed and implemented. In conventional simulations of complex systems, there arise from time to time…

Computational Engineering, Finance, and Science · Computer Science 2007-05-23 Mark Burgin , Walter Karplus , Damon Liu

This article investigates the modeling and control of Lagrangian systems involving non-conservative forces using a hybrid method that does not require acceleration calculations. It focuses in particular on the derivation and identification…

Systems and Control · Electrical Eng. & Systems 2025-12-03 Ibrahim Laiche , Mokrane Boudaoud , Patrick Gallinari , Pascal Morin