English
Related papers

Related papers: ARRTOC: Adversarially Robust Real-Time Optimizatio…

200 papers

This research introduces an innovative method for adaptive traffic signal control (ATSC) through the utilization of multi-objective deep reinforcement learning (DRL) techniques. The proposed approach aims to enhance control strategies at…

Machine Learning · Computer Science 2024-08-05 Shahin Mirbakhsh , Mahdi Azizi

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

Machine Learning · Computer Science 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), as the widely employed policy based reinforcement learning (RL) methods, are prone to converge to a sub-optimal solution as they limit the policy representation…

Machine Learning · Computer Science 2020-06-16 Jun Song , Chaoyue Zhao

Dexterous manipulation tasks often require switching between different contact modes, such as rolling, sliding, sticking, or non-contact contact modes. When formulating dexterous manipulation tasks as a trajectory optimization problem, a…

In pursuit of the time-optimal path tracking (TOPT) trajectory of a robot manipulator along a preset path, a beforehand identified robot dynamic model is usually used to obtain the required optimal trajectory for perfect tracking. However,…

Robotics · Computer Science 2019-08-06 Jiadong Xiao , Lin Li , Tie Zhang , Yanbiao Zou

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

Machine Learning · Computer Science 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

Robotic foundation models require reasoning over complex visual scenes to execute adaptive actions in dynamic environments. While recent studies on latent-reasoning Vision-Language-Action (VLA) models have demonstrated the capability to…

Reinforcement Learning (RL) robot controllers usually aggregate many task objectives into one scalar reward. While large-scale proximal policy optimisation (PPO) has enabled impressive results such as robust robot locomotion in the real…

Robotics · Computer Science 2025-09-19 Humphrey Munn , Brendan Tidd , Peter Böhm , Marcus Gallagher , David Howard

Real-time optimization with persistent parameter adaptation (ROPA) is an RTO approach, where the steady-state model parameters are updated dynamically using transient measurements. Consequently, we avoid waiting for a steady-state before…

Systems and Control · Electrical Eng. & Systems 2022-06-02 J. Matias , J. P. C. Oliveira , G. A. C. Le Roux , J. Jaschke

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

Optimization and Control · Mathematics 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

We propose a framework for online meta-optimization of parameters that govern optimization, called Amortized Proximal Optimization (APO). We first interpret various existing neural network optimizers as approximate stochastic proximal point…

Machine Learning · Computer Science 2022-03-02 Juhan Bae , Paul Vicol , Jeff Z. HaoChen , Roger Grosse

Motion planning is a key aspect of robotics. A common approach to address motion planning problems is trajectory optimization. Trajectory optimization can represent the high-level behaviors of robots through mathematical formulations.…

Robotics · Computer Science 2024-08-21 Fatemeh Rastgar

Supporting decision-making has long been a central vision in the field of spatio-temporal intelligence. While prior work has improved the timeliness and accuracy of spatio-temporal forecasting, converting these forecasts into actionable…

Machine Learning · Computer Science 2025-06-24 Shulun Chen , Wei Shao , Flora D. Salim , Hao Xue

Optimization problems routinely depend on uncertain parameters that must be predicted before a decision is made. Classical robust and regret formulations are designed to handle erroneous predictions and can provide statistical error bounds…

Optimization and Control · Mathematics 2026-03-30 Jannis Kurtz , Bart P. G. van Parys

Neglecting consumers' comfort always leads to failure or slow-response to demand response request. In this paper, we propose several comprehensive comfort level models for various appliances in campus-based commercial buildings (CBs). The…

Optimization and Control · Mathematics 2019-03-28 Zheming Liang , Desong Bian , Dawei Su , Ruisheng Diao , Di Shi , Zhiwei Wang , Wencong Su

This paper considers the problem of real-time control and learning in dynamic systems subjected to parametric uncertainties. We propose a combination of a Reinforcement Learning (RL) based policy in the outer loop suitably chosen to ensure…

Machine Learning · Computer Science 2023-06-13 Anuradha M. Annaswamy , Anubhav Guha , Yingnan Cui , Sunbochen Tang , Peter A. Fisher , Joseph E. Gaudio

To improve efficiency and reduce failures in autonomous vehicles, research has focused on developing robust and safe learning methods that take into account disturbances in the environment. Existing literature in robust reinforcement…

Machine Learning · Computer Science 2019-03-12 Xiaobai Ma , Katherine Driggs-Campbell , Mykel J. Kochenderfer

Evaluating and updating the obstacle avoidance velocity for an autonomous robot in real-time ensures robustness against noise and disturbances. A passive damping controller can obtain the desired motion with a torque-controlled robot, which…

Robotics · Computer Science 2024-07-16 Lukas Huber , Thibaud Trinca , Jean-Jacques Slotine , Aude Billard