English
Related papers

Related papers: STOPS: Short-Term-based Volatility-controlled Poli…

200 papers

Autonomous UAV navigation using reinforcement learning (RL) is vulnerable to adversarial attacks that manipulate sensor inputs, potentially leading to unsafe behavior and mission failure. Although robust RL methods provide partial…

Machine Learning · Computer Science 2025-12-16 Deepak Kumar Panda , Weisi Guo

The most data-efficient algorithms for reinforcement learning (RL) in robotics are based on uncertain dynamical models: after each episode, they first learn a dynamical model of the robot, then they use an optimization algorithm to find a…

Safe reinforcement learning (RL) offers advanced solutions to constrained optimal control problems. Existing studies in safe RL implicitly assume continuity in policy functions, where policies map states to actions in a smooth,…

Machine Learning · Computer Science 2024-03-29 Wenjun Zou , Yao Lyu , Jie Li , Yujie Yang , Shengbo Eben Li , Jingliang Duan , Xianyuan Zhan , Jingjing Liu , Yaqin Zhang , Keqiang Li

Perception algorithms are ubiquitous in modern autonomy stacks, providing necessary environmental information to operate in the real world. Many of these algorithms depend on the visibility of keypoints, which must remain within the robot's…

Optimization and Control · Mathematics 2025-02-21 Christopher R. Hayner , John M. Carson , Behçet Açıkmeşe , Karen Leung

In this paper, we consider a modified version of the control problem in a model free Markov decision process (MDP) setting with large state and action spaces. The control problem most commonly addressed in the contemporary literature is to…

Artificial Intelligence · Computer Science 2018-02-01 Ajin George Joseph , Shalabh Bhatnagar

As drones and autonomous cars become more widespread it is becoming increasingly important that robots can operate safely under realistic conditions. The noisy information fed into real systems means that robots must use estimates of the…

Robotics · Computer Science 2017-06-01 Brian Axelrod , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Direct policy search has been widely applied in modern reinforcement learning and continuous control. However, the theoretical properties of direct policy search on nonsmooth robust control synthesis have not been fully understood. The…

Optimization and Control · Mathematics 2022-10-24 Xingang Guo , Bin Hu

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance, frequently without considering safety. In contrast, safe reinforcement learning seeks to reduce or avoid unsafe behavior.…

Machine Learning · Computer Science 2025-06-17 Zahra Shahrooei , Ali Baheri

We study continuous action reinforcement learning problems in which it is crucial that the agent interacts with the environment only through safe policies, i.e.,~policies that do not take the agent to undesirable situations. We formulate…

Machine Learning · Computer Science 2019-02-13 Yinlam Chow , Ofir Nachum , Aleksandra Faust , Edgar Duenez-Guzman , Mohammad Ghavamzadeh

The most data-efficient algorithms for reinforcement learning in robotics are model-based policy search algorithms, which alternate between learning a dynamical model of the robot and optimizing a policy to maximize the expected return…

Machine Learning · Computer Science 2020-03-05 Rituraj Kaushik , Konstantinos Chatzilygeroudis , Jean-Baptiste Mouret

The Vortex Search (VS) algorithm is one of the recently proposed metaheuristic algorithms which was inspired from the vortical flow of the stirred fluids. Although the VS algorithm is shown to be a good candidate for the solution of certain…

Artificial Intelligence · Computer Science 2016-06-10 Berat Doğan

Many practical applications of robotics require systems that can operate safely despite uncertainty. In the context of motion planning, two types of uncertainty are particularly important when planning safe robot trajectories. The first is…

Robotics · Computer Science 2023-02-02 Charles Dawson , Ashkan Jasour , Andreas Hofmann , Brian Williams

Parameter control and dynamic algorithm configuration study how to dynamically choose suitable configurations of a parametrized algorithm during the optimization process. Despite being an intensively researched topic in evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-07-14 Gianluca Covini , Denis Antipov , Carola Doerr

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO) are among the most successful policy gradient approaches in deep reinforcement learning (RL). While these methods achieve state-of-the-art performance across a…

Machine Learning · Computer Science 2020-06-22 Ahmed Touati , Amy Zhang , Joelle Pineau , Pascal Vincent

We study the policy testing problem in discounted Markov decision processes (MDPs) in the fixed-confidence setting under a generative model with static sampling. The goal is to decide whether the value of a given policy exceeds a specified…

Machine Learning · Statistics 2026-04-21 Kaito Ariu , Po-An Wang , Alexandre Proutiere , Kenshi Abe

Due to nonholonomic dynamics, the motion planning of nonholonomic robots is always a difficult problem. This letter presents a Discrete States-based Trajectory Planning(DSTP) algorithm for autonomous nonholonomic robots. The proposed…

Robotics · Computer Science 2023-02-20 Ziyi Zou , Ziang Zhang , Zhen Lu , Xiang Li , You Wang , Jie Hao , Guang Li

Many real-world systems often involve physical components or operating environments with highly nonlinear and uncertain dynamics. A number of different control algorithms can be used to design optimal controllers for such systems, assuming…

Systems and Control · Electrical Eng. & Systems 2023-04-06 Navid Hashemi , Justin Ruths , Jyotirmoy V. Deshmukh

Achieving reactive robot behavior in complex dynamic environments is still challenging as it relies on being able to solve trajectory optimization problems quickly enough, such that we can replan the future motion at frequencies which are…

Robotics · Computer Science 2023-03-15 Julius Jankowski , Lara Brudermüller , Nick Hawes , Sylvain Calinon

We study online adaptive policy selection in systems with time-varying costs and dynamics. We develop the Gradient-based Adaptive Policy Selection (GAPS) algorithm together with a general analytical framework for online policy selection via…

Optimization and Control · Mathematics 2023-06-14 Yiheng Lin , James A. Preiss , Emile Anand , Yingying Li , Yisong Yue , Adam Wierman

The problem of searching for an unknown object occurs in important applications ranging from security, medicine and defense. Sensors with the capability to process information rapidly require adaptive algorithms to control their search in…

Information Theory · Computer Science 2015-08-18 Huanyu Ding , David A. Castañón