English
Related papers

Related papers: A multi-level model for self-adaptive systems

200 papers

Reinforcement learning usually assumes a given or sometimes even fixed environment in which an agent seeks an optimal policy to maximize its long-term discounted reward. In contrast, we consider agents that are not limited to passive…

Machine Learning · Computer Science 2025-10-20 Ziqing Lu , Babak Hassibi , Lifeng Lai , Weiyu Xu

Automation systems are increasingly being used in dynamic and various operating conditions. With higher flexibility demands, they need to promptly respond to surrounding dynamic changes by adapting their operation. Context information…

Software Engineering · Computer Science 2022-07-12 Nada Sahlab , Nasser Jazdi , Michael Weyrich

We describe here our perception of complex systems, of how we feel the different layers of description are important part of a correct complex system simulation. We describe a rough models categorization between rules based and law based,…

Fluid Dynamics · Physics 2007-12-18 Pierrick Tranouez , Cyrille Bertelle , Damien Olivier

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

In the last two decades, the popularity of self-adaptive systems in the field of software and systems engineering has drastically increased. However, despite the extensive work on self-adaptive systems, the literature still lacks a common…

Software Engineering · Computer Science 2025-05-26 Ana Petrovska , Guan Erjiage , Stefan Kugele

A system s behavior is typically specified through models such as state diagrams that describe how the system should behave. According to researchers, it is not clear what a state actually represents regarding the system to be modeled.…

Software Engineering · Computer Science 2020-07-15 Sabah Al-Fedaghi

To assure performance on the fly, planning is arguably one of the most important steps for self-adaptive systems (SASs), especially when they are highly configurable with a daunting number of adaptation options. However, there has been…

Software Engineering · Computer Science 2022-03-24 Tao Chen

In this study, we investigate learning rate adaption at different levels based on the hyper-gradient descent framework and propose a method that adaptively learns the optimizer parameters by combining multiple levels of learning rates with…

Machine Learning · Computer Science 2021-05-12 Renlong Jie , Junbin Gao , Andrey Vasnev , Minh-Ngoc Tran

Mobile robots have received a great deal of research in recent years. A significant amount of research has been published in many aspects related to mobile robots. Most of the research is devoted to design and develop some control…

Robotics · Computer Science 2007-05-23 A. Albagul , Wahyudi

Adaptation to environmental change is a common property of biological systems. Cells initially respond to external changes in the environment, but after some time, they regain their original state. By considering an element consisting of…

Biological Physics · Physics 2015-05-13 Masayo Inoue , Kunihiko Kaneko

Multi-scale structures are prevalent in both natural and artificial systems, as they can handle increasing complexity. Several terms are employed almost interchangeably across various application domains to refer to the multi-scale concept…

Systems and Control · Electrical Eng. & Systems 2021-06-04 Ada Diaconescu , Louisa Jane Di Felice , Patricia Mellodge

This is the first of a series of papers that the authors propose to write on the subject of improving the speed of response of learning systems using multiple models. During the past two decades, the first author has worked on numerous…

Machine Learning · Computer Science 2015-11-02 Kumpati S. Narendra , Snehasis Mukhopadyhay , Yu Wang

In the natural world, life has found innumerable ways to survive and often thrive. Between and even within species, each individual is in some manner unique, and this diversity lends adaptability and robustness to life. In this work, we aim…

Machine Learning · Computer Science 2021-07-16 Kenneth Derek , Phillip Isola

Autonomous robots need to be able to adapt to unforeseen situations and to acquire new skills through trial and error. Reinforcement learning in principle offers a suitable methodological framework for this kind of autonomous learning.…

Robotics · Computer Science 2016-08-02 Nikolas J. Hemion

Stochastic modeling of reaction networks is a framework used to describe the time evolution of many natural and artificial systems, including, biochemical reactive systems at the molecular level, viral kinetics, the spread of epidemic…

Numerical Analysis · Mathematics 2014-06-10 Alvaro Moraes , Raul Tempone , Pedro Vilanova

Language is an effective medium for bi-directional communication in human-robot teams. To infer the meaning of many instructions, robots need to construct a model of their surroundings that describe the spatial, semantic, and metric…

Robotics · Computer Science 2019-09-24 Ethan Fahnestock , Siddharth Patki , Thomas M. Howard

We describe the dynamics of a simple adaptive network. The network architecture evolves to a number of disconnected components on which the dynamics is characterized by the possibility of differently synchronized nodes within the same…

Adaptation and Self-Organizing Systems · Physics 2015-05-28 V. Botella-Soler , P. Glendinning

This paper presents a novel two-level control architecture for a fully autonomous vehicle in a deterministic environment, which can handle traffic rules as specifications and low-level vehicle control with real-time performance. At the top…

Robotics · Computer Science 2021-05-07 Erfan Aasi , Cristian Ioan Vasile , Calin Belta

Systems of systems differ from traditional systems in that they are open at the top, open at the bottom, and continually (but slowly) evolving. "Open at the top" means that there is no pre-defined top level application. New applications may…

Multiagent Systems · Computer Science 2016-11-17 Russ Abbott

The fundamental concept of applying the system methodology to network analysis declares that network architecture should take into account services and applications which this network provides and supports. This work introduces a formal…

Networking and Internet Architecture · Computer Science 2015-09-03 Andrey A. Shchurov