English
Related papers

Related papers: Model-Based Runtime Monitoring with Interactive Im…

200 papers

Delays frequently occur in real-world environments, yet standard reinforcement learning (RL) algorithms often assume instantaneous perception of the environment. We study random sensor delays in POMDPs, where observations may arrive…

Machine Learning · Computer Science 2026-04-17 Armin Karamzade , Kyungmin Kim , JB Lanier , Davide Corsi , Roy Fox

Endowing robots with the human ability to learn a growing set of skills over the course of a lifetime as opposed to mastering single tasks is an open problem in robot learning. While multi-task learning approaches have been proposed to…

Robotics · Computer Science 2023-09-19 Muhammad Burhan Hafez , Stefan Wermter

Learning strategic robot behavior -- like that required in pursuit-evasion interactions -- under real-world constraints is extremely challenging. It requires exploiting the dynamics of the interaction, and planning through both physical…

Robotics · Computer Science 2023-08-31 Andrea Bajcsy , Antonio Loquercio , Ashish Kumar , Jitendra Malik

Robots operating in real-world human environments will likely encounter task execution failures. To address this, we would like to allow co-present humans to refine the robot's task model as errors are encountered. Existing approaches to…

Robotics · Computer Science 2018-10-03 Reymundo A. Gutierrez , Elaine Schaertl Short , Scott Niekum , Andrea L. Thomaz

Understanding human perceptions of robot performance is crucial for designing socially intelligent robots that can adapt to human expectations. Current approaches often rely on surveys, which can disrupt ongoing human-robot interactions. As…

In this paper, we study the problem of mobile user profiling, which is a critical component for quantifying users' characteristics in the human mobility modeling pipeline. Human mobility is a sequential decision-making process dependent on…

Artificial Intelligence · Computer Science 2021-01-08 Dongjie Wang , Pengyang Wang , Kunpeng Liu , Yuanchun Zhou , Charles Hughes , Yanjie Fu

We present a framework for learning human user models from joint-action demonstrations that enables the robot to compute a robust policy for a collaborative task with a human. The learning takes place completely automatically, without any…

Robotics · Computer Science 2017-06-15 Stefanos Nikolaidis , Keren Gu , Ramya Ramakrishnan , Julie Shah

Recent advancements in machine learning provide methods to train autonomous agents capable of handling the increasing complexity of sequential decision-making in robotics. Imitation Learning (IL) is a prominent approach, where agents learn…

Robotics · Computer Science 2025-05-01 Jonas Werner , Kun Chu , Cornelius Weber , Stefan Wermter

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

In this work we address the problem of performing a repetitive task when we have uncertain observations and dynamics. We formulate this problem as an iterative infinite horizon optimal control problem with output feedback. Previously, this…

Systems and Control · Electrical Eng. & Systems 2021-10-04 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

Autonomous mobile robots require accurate human motion predictions to safely and efficiently navigate among pedestrians, whose behavior may adapt to environmental changes. This paper introduces a self-supervised continual learning framework…

Robotics · Computer Science 2022-02-16 Luzia Knoedler , Chadi Salmi , Hai Zhu , Bruno Brito , Javier Alonso-Mora

Purpose of Review: To effectively synthesise and analyse multi-robot behaviour, we require formal task-level models which accurately capture multi-robot execution. In this paper, we review modelling formalisms for multi-robot systems under…

Robotics · Computer Science 2023-08-16 Charlie Street , Masoumeh Mansouri , Bruno Lacerda

Imitation learning is a paradigm to address complex motion planning problems by learning a policy to imitate an expert's behavior. However, relying solely on the expert's data might lead to unsafe actions when the robot deviates from the…

Robotics · Computer Science 2024-11-06 Amin Abyaneh , Hsiu-Chin Lin

Operators performing high-stakes, safety-critical tasks - such as air traffic controllers, surgeons, or mission control personnel - must maintain exceptional cognitive performance under variable and often stressful conditions. This paper…

Human-Computer Interaction · Computer Science 2025-06-30 Maciej Grzeszczuk , Grzegorz Pochwatko , Barbara Karpowicz , Stanisław Knapiński , Wiesław Kopeć

Runtime Monitoring is a lightweight and dynamic verification technique that involves observing the internal operations of a software system and/or its interactions with other external entities, with the aim of determining whether the system…

Logic in Computer Science · Computer Science 2017-08-25 Ian Cassar , Adrian Francalanza , Luca Aceto , Anna Ingólfsdóttir

Domain-specific systems-on-chip, a class of heterogeneous many-core systems, are recognized as a key approach to narrow down the performance and energy-efficiency gap between custom hardware accelerators and programmable processors.…

Hardware Architecture · Computer Science 2020-08-10 Anish Krishnakumar , Samet E. Arda , A. Alper Goksoy , Sumit K. Mandal , Umit Y. Ogras , Anderson L. Sartor , Radu Marculescu

In recent years, the development of robotics and artificial intelligence (AI) systems has been nothing short of remarkable. As these systems continue to evolve, they are being utilized in increasingly complex and unstructured environments,…

Machine Learning · Computer Science 2024-10-28 Maryam Zare , Parham M. Kebria , Abbas Khosravi , Saeid Nahavandi

Robots are required to autonomously respond to changing situations. Imitation learning is a promising candidate for achieving generalization performance, and extensive results have been demonstrated in object manipulation. However,…

Robotics · Computer Science 2021-01-21 Ayumu Sasagawa , Kazuki Fujimoto , Sho Sakaino , Toshiaki Tsuji

Machine learning-based forecasting models are commonly used in Intelligent Transportation Systems (ITS) to predict traffic patterns and provide city-wide services. However, most of the existing models are susceptible to adversarial attacks,…

Machine Learning · Computer Science 2023-06-27 Fan Liu , Weijia Zhang , Hao Liu

Imitation learning is a popular method for teaching robots new behaviors. However, most existing methods focus on teaching short, isolated skills rather than long, multi-step tasks. To bridge this gap, imitation learning algorithms must not…

Artificial Intelligence · Computer Science 2025-11-04 Leon Keller , Daniel Tanneberg , Jan Peters