English
Related papers

Related papers: Situationally-Aware Dynamics Learning

200 papers

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Training reinforcement learning (RL) agents using scalar reward signals is often infeasible when an environment has sparse and non-Markovian rewards. Moreover, handcrafting these reward functions before training is prone to…

Machine Learning · Computer Science 2023-10-04 Alessandro Abate , Yousif Almulla , James Fox , David Hyland , Michael Wooldridge

This work addresses the problem of multi-robot coordination under unknown robot transition models, ensuring that tasks specified by Time Window Temporal Logic are satisfied with user-defined probability thresholds. We present a bi-level…

Robotics · Computer Science 2025-02-17 Xiaoshan Lin , Roberto Tron

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

Identifying the dynamic properties of manipulated objects is essential for safe and accurate robot control. Most methods rely on low noise force torque sensors, long exciting signals, and solving nonlinear optimization problems, making the…

Robotics · Computer Science 2024-08-22 Donghoon Baek , Bo Peng , Saurabh Gupta , Joao Ramos

Mobile robots navigating in crowds trained using reinforcement learning are known to suffer performance degradation when faced with out-of-distribution scenarios. We propose that by properly accounting for the uncertainties of pedestrians,…

Robotics · Computer Science 2025-08-08 Jianpeng Yao , Xiaopan Zhang , Yu Xia , Zejin Wang , Amit K. Roy-Chowdhury , Jiachen Li

The increasing level of autonomy of robots poses challenges of trust and social acceptance, especially in human-robot interaction scenarios. This requires an interpretable implementation of robotic cognitive capabilities, possibly based on…

Artificial Intelligence · Computer Science 2025-01-14 Daniele Meli , Paolo Fiorini

We present an optimization-based method to plan the motion of an autonomous robot under the uncertainties associated with dynamic obstacles, such as humans. Our method bounds the marginal risk of collisions at each point in time by…

Robotics · Computer Science 2021-03-24 O. de Groot , B. Brito , L. Ferranti , D. Gavrila , J. Alonso-Mora

End-to-end learning robotic manipulation with high data efficiency is one of the key challenges in robotics. The latest methods that utilize human demonstration data and unsupervised representation learning has proven to be a promising…

Robotics · Computer Science 2021-10-22 Jin Li , Xianyuan Zhan , Zixu Xiao , Guyue Zhou

Generalization and adaptation of learned skills to novel situations is a core requirement for intelligent autonomous robots. Although contextual reinforcement learning provides a principled framework for learning and generalization of…

Machine Learning · Computer Science 2019-10-08 Pascal Klink , Hany Abdulsamad , Boris Belousov , Jan Peters

Data assimilation (DA) has increasingly emerged as a critical tool for state estimation across a wide range of applications. It is significantly challenging when the governing equations of the underlying dynamics are unknown. To this end,…

Machine Learning · Computer Science 2026-01-13 Ziyi Wang , Lijian Jiang

The performance of machine learning model can be further improved if contextual cues are provided as input along with base features that are directly related to an inference task. In offline learning, one can inspect historical training…

Machine Learning · Computer Science 2019-10-21 Kin Gwn Lore , Kishore K. Reddy

We present a novel framework for estimating accident-prone regions in everyday indoor scenes, aimed at improving real-time risk awareness in service robots operating in human-centric environments. As robots become integrated into daily…

Model-based Reinforcement Learning and Control have demonstrated great potential in various sequential decision making problem domains, including in robotics settings. However, real-world robotics systems often present challenges that limit…

Machine Learning · Computer Science 2023-10-24 Achkan Salehi , Steffen Rühl , Stephane Doncieux

Hidden Markov Models with an underlying Mixture of Gaussian structure have proven effective in learning Human-Robot Interactions from demonstrations for various interactive tasks via Gaussian Mixture Regression. However, a mismatch occurs…

Accurate and robust recognition and prediction of traffic situation plays an important role in autonomous driving, which is a prerequisite for risk assessment and effective decision making. Although there exist a lot of works dealing with…

Artificial Intelligence · Computer Science 2018-09-11 Jiachen Li , Hengbo Ma , Wei Zhan , Masayoshi Tomizuka

Accurately predicting the possible behaviors of traffic participants is an essential capability for autonomous vehicles. Since autonomous vehicles need to navigate in dynamically changing environments, they are expected to make accurate…

Robotics · Computer Science 2022-11-15 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

Multi-robot navigation in unknown, structurally constrained, and GPS-denied environments presents a fundamental trade-off between global strategic foresight and local tactical agility, particularly under limited communication. Centralized…

Robotics · Computer Science 2025-10-13 Zihao Mao , Yunheng Wang , Yunting Ji , Yi Yang , Wenjie Song

Reinforcement learning would enjoy better success on real-world problems if domain knowledge could be imparted to the algorithm by the modelers. Most problems have both hidden state and unknown dynamics. Partially observable Markov decision…

Machine Learning · Computer Science 2013-01-07 Christian R. Shelton