English
Related papers

Related papers: A Framework for On-line Learning of Underwater Veh…

200 papers

The recent increase in data availability and reliability has led to a surge in the development of learning-based model predictive control (MPC) frameworks for robot systems. Despite attaining substantial performance improvements over their…

Robotics · Computer Science 2023-08-02 Kong Yao Chee , Thales C. Silva , M. Ani Hsieh , George J. Pappas

Being able to quickly adapt to changes in dynamics is paramount in model-based control for object manipulation tasks. In order to influence fast adaptation of the inverse dynamics model's parameters, data efficiency is crucial. Given…

Robotics · Computer Science 2022-11-28 Kristen Morse , Neha Das , Yixin Lin , Austin S. Wang , Akshara Rai , Franziska Meier

This paper discusses online algorithms for inverse dynamics modelling in robotics. Several model classes including rigid body dynamics (RBD) models, data-driven models and semiparametric models (which are a combination of the previous two…

Machine Learning · Computer Science 2018-09-14 Diego Romeres , Mattia Zorzi , Raffaello Camoriano , Silvio Traversaro , Alessandro Chiuso

Autonomous mobile robots operating in remote, unstructured environments must adapt to new, unpredictable terrains that can change rapidly during operation. In such scenarios, a critical challenge becomes estimating the robot's dynamics on…

Robotics · Computer Science 2025-07-18 William Ward , Sarah Etter , Tyler Ingebrand , Christian Ellis , Adam J. Thorpe , Ufuk Topcu

Incremental learning is a form of online learning. Incremental learning can modify the parameters and structure of the deep learning model so that the model does not forget the old knowledge while learning new knowledge. Preventing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sheng Ren , Yan He , Neal N. Xiong , Kehua Guo

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

Robotics · Computer Science 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

Accurately predicting the dynamics of robotic systems is crucial for model-based control and reinforcement learning. The most common way to estimate dynamics is by fitting a one-step ahead prediction model and using it to recursively…

Machine Learning · Computer Science 2021-09-02 Nathan O. Lambert , Albert Wilcox , Howard Zhang , Kristofer S. J. Pister , Roberto Calandra

This work presents an online learning-based control method for improved trajectory tracking of unmanned aerial vehicles using both deep learning and expert knowledge. The proposed method does not require the exact model of the system to be…

Robotics · Computer Science 2019-05-28 Andriy Sarabakha , Erdal Kayacan

The paper presents a framework for online learning of the Koopman operator using streaming data. Many complex systems for which data-driven modeling and control are sought provide streaming sensor data, the abundance of which can present…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Kartik Loya , Phanindra Tallapragada

This work developed a meta-learning approach that adapts the control policy on the fly to different changing conditions for robust locomotion. The proposed method constantly updates the interaction model, samples feasible sequences of…

Robotics · Computer Science 2021-01-20 Timothée Anne , Jack Wilkinson , Zhibin Li

Realtime model learning proves challenging for complex dynamical systems, such as drones flying in variable wind conditions. Machine learning technique such as deep neural networks have high representation power but is often too slow to…

Robotics · Computer Science 2022-05-26 Michael O'Connell , Guanya Shi , Xichen Shi , Soon-Jo Chung

This paper studies how global dynamics and knowledge of high-level features can inform decision-making for robots in flow-like environments. Specifically, we investigate how coherent sets, an environmental feature found in these…

Robotics · Computer Science 2022-01-10 Tahiya Salam , Victoria Edwards , M. Ani Hsieh

Recently there has been substantial interest in spectral methods for learning dynamical systems. These methods are popular since they often offer a good tradeoff between computational and statistical efficiency. Unfortunately, they can be…

Machine Learning · Statistics 2015-11-05 Ahmed Hefny , Carlton Downey , Geoffrey Gordon

Learning effective visuomotor policies for robots purely from data is challenging, but also appealing since a learning-based system should not require manual tuning or calibration. In the case of a robot operating in a real environment the…

Robotics · Computer Science 2018-10-12 Homanga Bharadhwaj , Zihan Wang , Yoshua Bengio , Liam Paull

Learning the inverse dynamics of soft continuum robots remains challenging due to high-dimensional nonlinearities and complex actuation coupling. Conventional feedback-based controllers often suffer from control chattering due to corrective…

Robotics · Computer Science 2026-04-06 Hang Yang , Fangju Yang , Yangming Zhang , Ibrahim Alsarraj , Yuhao Wang , Zhenye Luo , Zixi Chen , Ke Wu

Reliable autonomous navigation requires adapting the control policy of a mobile robot in response to dynamics changes in different operational conditions. Hand-designed dynamics models may struggle to capture model variations due to a…

Robotics · Computer Science 2024-03-14 Abdullah Altawaitan , Jason Stanley , Sambaran Ghosal , Thai Duong , Nikolay Atanasov

We consider the problem of learning useful robotic skills from previously collected offline data without access to manually specified rewards or additional online exploration, a setting that is becoming increasingly important for scaling…

Reinforcement learning-based quadruped robots excel across various terrains but still lack the ability to swim in water due to the complex underwater environment. This paper presents the development and evaluation of a data-driven…

Robotics · Computer Science 2024-10-02 Cong Wang , Aoming Liang , Fei Han , Xinyu Zeng , Zhibin Li , Dixia Fan , Jens Kober

While deep reinforcement learning (RL) has been increasingly applied in designing car-following models in the last years, this study aims at investigating the feasibility of RL-based vehicle-following for complex vehicle dynamics and strong…

Computational Engineering, Finance, and Science · Computer Science 2022-07-08 Fabian Hart , Ostap Okhrin , Martin Treiber