English
Related papers

Related papers: Complementary Meta-Reinforcement Learning for Faul…

200 papers

With the rapid evolution of Large Language Models (LLMs) and their large-scale experimentation in cloud-computing spaces, the challenge of guaranteeing their security and efficiency in a failure scenario has become a main issue. To ensure…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-18 Yihong Jin , Ze Yang , Xinhe Xu , Yihan Zhang , Shuyang Ji

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

Machine Learning · Computer Science 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

Due to changes in model dynamics or unexpected disturbances, an autonomous robotic system may experience unforeseen challenges during real-world operations which may affect its safety and intended behavior: in particular actuator and system…

Robotics · Computer Science 2023-05-31 Esen Yel , Nicola Bezzo

Model Predictive Control (MPC) is attracting tremendous attention in the autonomous driving task as a powerful control technique. The success of an MPC controller strongly depends on an accurate internal dynamics model. However, the static…

Machine Learning · Computer Science 2023-04-28 Yuan Zhang , Joschka Boedecker , Chuxuan Li , Guyue Zhou

The ability to exploit prior experience to solve novel problems rapidly is a hallmark of biological learning systems and of great practical importance for artificial ones. In the meta reinforcement learning literature much recent work has…

Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two recent continual-learning scenarios have opened new avenues of research. In meta-continual learning, the…

Model-reference adaptive systems refer to a consortium of techniques that guide plants to track desired reference trajectories. Approaches based on theories like Lyapunov, sliding surfaces, and backstepping are typically employed to advise…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mohammed Abouheaf , Wail Gueaieb , Davide Spinello , Salah Al-Sharhan

Efficiently adapting to new environments and changes in dynamics is critical for agents to successfully operate in the real world. Reinforcement learning (RL) based approaches typically rely on external reward feedback for adaptation.…

Machine Learning · Computer Science 2019-03-05 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Jie Tan , Chelsea Finn

Model agnostic meta-learning (MAML) is a popular state-of-the-art meta-learning algorithm that provides good weight initialization of a model given a variety of learning tasks. The model initialized by provided weight can be fine-tuned to…

Machine Learning · Computer Science 2021-06-11 Thanh Nguyen , Tung Luu , Trung Pham , Sanzhar Rakhimkul , Chang D. Yoo

Meta-learning has emerged as an important framework for learning new tasks from just a few examples. The success of any meta-learning model depends on (i) its fast adaptation to new tasks, as well as (ii) having a shared representation…

Machine Learning · Computer Science 2019-10-21 Daniel Jiwoong Im , Yibo Jiang , Nakul Verma

A fundamental problem in control is to learn a model of a system from observations that is useful for controller synthesis. To provide good performance guarantees, existing methods must assume that the real system is in the class of models…

Machine Learning · Computer Science 2012-07-04 Stephane Ross , J. Andrew Bagnell

Dynamically Adaptive Systems modify their behav- ior and structure in response to changes in their surrounding environment and according to an adaptation logic. Critical sys- tems increasingly incorporate dynamic adaptation capabilities;…

Software Engineering · Computer Science 2012-05-28 Alexandre Bartel , Benoit Baudry , Freddy Munoz , Jacques Klein , Tejeddine Mouelhi , Yves Le Traon

Reinforcement Learning (RL) is a powerful method for controlling dynamic systems, but its learning mechanism can lead to unpredictable actions that undermine the safety of critical systems. Here, we propose RL with Adaptive Regularization…

Machine Learning · Computer Science 2024-11-01 Haozhe Tian , Homayoun Hamedmoghadam , Robert Shorten , Pietro Ferraro

This paper presents a new data-driven fault identification and controller reconfiguration algorithm. The presented algorithm relies only on the system's input and output data, and it does not require a detailed system description. The…

Systems and Control · Computer Science 2019-02-27 Hasan Zakeri , Panos J. Antsaklis

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

Meta Reinforcement Learning (MRL) enables an agent to learn from a limited number of past trajectories and extrapolate to a new task. In this paper, we attempt to improve the robustness of MRL. We build upon model-agnostic meta-learning…

Machine Learning · Computer Science 2021-04-28 Shiqi Chen , Zhengyu Chen , Donglin Wang

Present incremental learning methods are limited in the ability to achieve reliable credit assignment over a large number time steps (or events). However, this situation is typical for cases where the dynamical system to be controlled…

Neural and Evolutionary Computing · Computer Science 2015-12-10 John W. Jameson

Learning-based controllers leverage nonlinear couplings and enhance transients but seldom offer guarantees under tight input constraints. Robust feedback like sliding-mode control (SMC) provides these guarantees but is conservative in…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Imran Sayyed , Nandan Kumar Sinha