English
Related papers

Related papers: Learning step-level dynamic soaring in shear flow

200 papers

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach

We present a data-driven feedforward control to attenuate large transient lift experienced by an airfoil disturbed by an extreme level of discrete vortex gust. The current analysis uses a nonlinear machine-learning technique to compress the…

Fluid Dynamics · Physics 2024-09-18 Kai Fukami , Hiroya Nakao , Kunihiko Taira

We investigate the important problem of certifying stability of reinforcement learning policies when interconnected with nonlinear dynamical systems. We show that by regulating the input-output gradients of policies, strong guarantees of…

Systems and Control · Computer Science 2018-10-30 Ming Jin , Javad Lavaei

Drones are becoming indispensable in many application domains. In data-driven missions, besides sensing, the drone must process the collected data at runtime to decide whether additional action must be taken on the spot, before moving to…

Robotics · Computer Science 2025-12-05 Giorgos Polychronis , Foivos Pournaropoulos , Christos D. Antonopoulos , Spyros Lalis

Solving robotic navigation tasks via reinforcement learning (RL) is challenging due to their sparse reward and long decision horizon nature. However, in many navigation tasks, high-level (HL) task representations, like a rough floor plan,…

Robotics · Computer Science 2021-11-08 Jan Wöhlke , Felix Schmitt , Herke van Hoof

Marine microorganisms must cope with complex flow patterns and even turbulence as they navigate the ocean. To survive they must avoid predation and find efficient energy sources. A major difficulty in analysing possible survival strategies…

Fluid Dynamics · Physics 2022-11-29 J. Qiu , N. Mousavi , K. Gustavsson , C. Xu , B. Mehlig , L. Zhao

We develop a deep reinforcement learning framework for controlling a bio-inspired jellyfish swimmer to navigate complex fluid environments with obstacles. While existing methods often rely on kinematic and geometric states, a key challenge…

Fluid Dynamics · Physics 2025-11-07 Yihao Chen , Yue Yang

Flow matching (FM) has shown promising results in data-driven planning. However, it inherently lacks formal guarantees for ensuring state and action constraints, whose satisfaction is a fundamental and crucial requirement for the safety and…

Machine Learning · Computer Science 2025-12-02 Tzu-Yuan Huang , Armin Lederer , Dai-Jie Wu , Xiaobing Dai , Sihua Zhang , Stefan Sosnowski , Shao-Hua Sun , Sandra Hirche

Model-based offline optimization with dynamics-aware policy provides a new perspective for policy learning and out-of-distribution generalization, where the learned policy could adapt to different dynamics enumerated at the training stage.…

Machine Learning · Computer Science 2022-06-09 Chengxing Jia , Hao Yin , Chenxiao Gao , Tian Xu , Lei Yuan , Zongzhang Zhang , Yang Yu

Maintenance scheduling is a complex decision-making problem in the production domain, where a number of maintenance tasks and resources has to be assigned and scheduled to production entities in order to prevent unplanned production…

Machine Learning · Computer Science 2021-08-30 Raphael Lamprecht , Ferdinand Wurst , Marco F. Huber

Hummingbirds and insects achieve outstanding flight performance by adapting their flapping motion to the flight requirements. Their wing kinematics can change from smooth flapping to highly dynamic waveforms, generating unsteady aerodynamic…

Fluid Dynamics · Physics 2024-08-07 Romain Poletti , Andre Calado , Lilla K. Koloszar , Joris Degroote , Miguel A. Mendez

Fish in schooling formations navigate complex flow-fields replete with mechanical energy in the vortex wakes of their companions. Their schooling behaviour has been associated with evolutionary advantages including collective energy…

Fluid Dynamics · Physics 2022-06-08 Siddhartha Verma , Guido Novati , Petros Koumoutsakos

This paper presents a technique for trajectory planning based on continuously parameterized high-level actions (motion primitives) of variable duration. This technique leverages deep reinforcement learning (Deep RL) to formulate a policy…

We address how to exploit power control data, gathered from a monitored environment, for performing power control in an unexplored environment. We adopt offline deep reinforcement learning, whereby the agent learns the policy to produce the…

Systems and Control · Electrical Eng. & Systems 2020-08-07 Mohammad G. Khoshkholgh , Halim Yanikomeroglu

Accurate and efficient fluid flow models are essential for applications relating to many physical phenomena including geophysical, aerodynamic, and biological systems. While these flows may exhibit rich and multiscale dynamics, in many…

Fluid Dynamics · Physics 2024-08-27 Benjamin D. Shaffer , Jeremy R. Vorenberg , M. Ani Hsieh

In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models.…

Robotics · Computer Science 2021-08-10 Andre Brandenburger , Diego Rodriguez , Sven Behnke

With the development of state-of-art deep reinforcement learning, we can efficiently tackle continuous control problems. But the deep reinforcement learning method for continuous control is based on historical data, which would make…

Robotics · Computer Science 2016-12-02 Xi Xiong , Jianqiang Wang , Fang Zhang , Keqiang Li

Jumping is essential for legged robots to traverse through difficult terrains. In this work, we propose a hierarchical framework that combines optimal control and reinforcement learning to learn continuous jumping motions for quadrupedal…

Robotics · Computer Science 2023-04-19 Yuxiang Yang , Xiangyun Meng , Wenhao Yu , Tingnan Zhang , Jie Tan , Byron Boots

This paper introduces a novel semantics-aware inspection planning policy derived through deep reinforcement learning. Reflecting the fact that within autonomous informative path planning missions in unknown environments, it is often only a…

Robotics · Computer Science 2025-05-21 Grzegorz Malczyk , Mihir Kulkarni , Kostas Alexis

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…