English
Related papers

Related papers: Bayesian Ambiguity Contraction-based Adaptive Robu…

200 papers

Adaptive Informative Path Planning with Multimodal Sensing (AIPPMS) considers the problem of an agent equipped with multiple sensors, each with different sensing accuracy and energy costs. The agent's goal is to explore the environment and…

Artificial Intelligence · Computer Science 2022-09-19 Joshua Ott , Edward Balaban , Mykel J. Kochenderfer

Multiple robots could perceive a scene (e.g., detect objects) collaboratively better than individuals, although easily suffer from adversarial attacks when using deep learning. This could be addressed by the adversarial defense, but its…

Robotics · Computer Science 2023-08-21 Yiming Li , Qi Fang , Jiamu Bai , Siheng Chen , Felix Juefei-Xu , Chen Feng

Distributed integrated sensing and communication (D-ISAC) enables multiple spatially distributed nodes to cooperatively perform sensing and communication. However, achieving coherent cooperation across distributed nodes is challenging due…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Seonghoon Yoo , Seulhyun Kwon , Kawon Han , Elaheh Ataeebojd , Mehdi Rasti , Joonhyuk Kang

Reinforcement Learning (RL) agents in the real world must satisfy safety constraints in addition to maximizing a reward objective. Model-based RL algorithms hold promise for reducing unsafe real-world actions: they may synthesize policies…

Machine Learning · Computer Science 2021-12-16 Yecheng Jason Ma , Andrew Shen , Osbert Bastani , Dinesh Jayaraman

Integrated task and motion planning has emerged as a challenging problem in sequential decision making, where a robot needs to compute high-level strategy and low-level motion plans for solving complex tasks. While high-level strategies…

Artificial Intelligence · Computer Science 2018-02-19 Siddharth Srivastava , Nishant Desai , Richard Freedman , Shlomo Zilberstein

We study unconstrained smooth convex optimization under stochastic first- and zeroth-order oracles subject only to finite-moment bounds, naturally admitting persistent bias and heavy-tailed noise. In this hostile environment, integrating…

Optimization and Control · Mathematics 2026-04-20 Shunzhi Zhang , Shichen Liao , Congying Han , Tiande Guo

Partial observability and uncertainty are common problems in sequential decision-making that particularly impede the use of formal models such as Markov decision processes (MDPs). However, in practice, agents may be able to employ costly…

Machine Learning · Computer Science 2023-12-19 Merlijn Krale , Thiago D. Simão , Jana Tumova , Nils Jansen

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

In this paper, we consider a Markov decision process (MDP), where the ego agent has a nominal objective to pursue while needs to hide its state from detection by an adversary. After formulating the problem, we first propose a value…

Systems and Control · Electrical Eng. & Systems 2019-08-22 Nan Li , Ilya Kolmanovsky , Anouck Girard

Planning problems are hard, motion planning, for example, isPSPACE-hard. Such problems are even more difficult in the presence of uncertainty. Although, Markov Decision Processes (MDPs) provide a formal framework for such problems, finding…

Artificial Intelligence · Computer Science 2013-01-14 Carlos E. Guestrin , Dirk Ormoneit

Integrated sensing and communication (ISAC) has emerged as a transformative technology for 6G networks, enabling the seamless integration of communication and sensing functionalities. Reconfigurable intelligent surfaces (RIS), with their…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Shoushuo Zhang , Rang Liu , Ming Li , Wei Wang , Qian Liu

This paper introduces an uncertainty compensation-based robust adaptive model predictive control (MPC) framework for linear systems with nonlinear time-varying uncertainties. The framework integrates an L1 adaptive controller to compensate…

Systems and Control · Electrical Eng. & Systems 2026-03-20 Ran Tao , Pan Zhao , Ilya Kolmanovsky , Naira Hovakimyan

Safely deploying robots in uncertain and dynamic environments requires a systematic accounting of various risks, both within and across layers in an autonomy stack from perception to motion planning and control. Many widely used motion…

Systems and Control · Electrical Eng. & Systems 2020-02-10 Venkatraman Renganathan , Iman Shames , Tyler H. Summers

We propose Adaptive Randomized Smoothing (ARS) to certify the predictions of our test-time adaptive models against adversarial examples. ARS extends the analysis of randomized smoothing using $f$-Differential Privacy to certify the adaptive…

Machine Learning · Computer Science 2025-07-11 Saiyue Lyu , Shadab Shaikh , Frederick Shpilevskiy , Evan Shelhamer , Mathias Lécuyer

Robust Markov decision processes (MDPs) are used for applications of dynamic optimization in uncertain environments and have been studied extensively. Many of the main properties and algorithms of MDPs, such as value iteration and policy…

Optimization and Control · Mathematics 2023-12-14 Julien Grand-Clément , Marek Petrik

In classical reinforcement learning, when exploring an environment, agents accept arbitrary short term loss for long term gain. This is infeasible for safety critical applications, such as robotics, where even a single unsafe action may…

Machine Learning · Computer Science 2017-01-30 Matteo Turchetta , Felix Berkenkamp , Andreas Krause

We introduce a new formulation of the Hidden Parameter Markov Decision Process (HiP-MDP), a framework for modeling families of related tasks using low-dimensional latent embeddings. Our new framework correctly models the joint uncertainty…

Machine Learning · Statistics 2017-11-01 Taylor Killian , Samuel Daulton , George Konidaris , Finale Doshi-Velez

This paper presents an uncertainty compensation-based robust adaptive model predictive control (MPC) framework for linear systems with both matched and unmatched nonlinear uncertainties subject to both state and input constraints. In…

Systems and Control · Electrical Eng. & Systems 2024-09-27 Ran Tao , Pan Zhao , Ilya Kolmanovsky , Naira Hovakimyan

Task robust adaptation is a long-standing pursuit in sequential decision-making. Some risk-averse strategies, e.g., the conditional value-at-risk principle, are incorporated in domain randomization or meta reinforcement learning to…

Machine Learning · Computer Science 2025-05-16 Yun Qu , Qi Cheems Wang , Yixiu Mao , Yiqin Lv , Xiangyang Ji

Robust Markov Decision Processes (RMDPs) generalize classical MDPs that consider uncertainties in transition probabilities by defining a set of possible transition functions. An objective is a set of runs (or infinite trajectories) of the…

Artificial Intelligence · Computer Science 2025-05-08 Ali Asadi , Krishnendu Chatterjee , Ehsan Kafshdar Goharshady , Mehrdad Karrabi , Ali Shafiee