English
Related papers

Related papers: Multistep Inverse Is Not All You Need

200 papers

Model-based reinforcement learning is an appealing framework for creating agents that learn, plan, and act in sequential environments. Model-based algorithms typically involve learning a transition model that takes a state and an action and…

Machine Learning · Computer Science 2019-06-03 Kavosh Asadi , Dipendra Misra , Seungchan Kim , Michel L. Littman

This work aims to introduce a heuristic timestep-adaptive algorithm for Computational Fluid Dynamics (CFD) and Fluid-Structure Interaction (FSI) problems where the flow is dominated by the pressure. In such scenarios, many time-adaptive…

Numerical Analysis · Mathematics 2024-07-02 Ivan Prusak , Davide Torlo , Monica Nonino , Gianluigi Rozza

Machine learning (ML) tools such as encoder-decoder deep convolutional neural networks (CNN) are able to extract relationships between inputs and outputs of large complex systems directly from raw data. For time-varying systems the…

Accelerator Physics · Physics 2021-03-25 Alexander Scheinker , Frederick Cropp , Sergio Paiagua , Daniele Filippetto

Partially Observable Markov Decision Processes (POMDPs) remain a core challenge in reinforcement learning due to incomplete state information. We address this by reformulating POMDPs as fully observable processes with fixed-length…

Machine Learning · Computer Science 2025-09-16 Wuhao Wang , Zhiyong Chen

In the biomedical environment, experiments assessing dynamic processes are primarily performed by a human acquisition supervisor. Contemporary implementations of such experiments frequently aim to acquire a maximum number of relevant events…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Nils Friederich , Angelo Yamachui Sitcheu , Oliver Neumann , Süheyla Eroğlu-Kayıkçı , Roshan Prizak , Lennart Hilbert , Ralf Mikut

The task of action-driven human motion prediction aims to forecast future human motion based on the observed sequence while respecting the given action label. It requires modeling not only the stochasticity within human motion but the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Chunzhi Gu , Chao Zhang , Shigeru Kuriyama

Control-based continuation (CBC) is a general and systematic method to explore the dynamic response of a physical system and perform bifurcation analysis directly during experimental tests. Although CBC has been successfully demonstrated on…

Dynamical Systems · Mathematics 2024-11-05 Hamed Rezaee , Ludovic Renson

Imitation learning is an intuitive approach for teaching motion to robotic systems. Although previous studies have proposed various methods to model demonstrated movement primitives, one of the limitations of existing methods is that the…

Robotics · Computer Science 2020-09-24 Takayuki Osa , Shuhei Ikemoto

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical…

Machine Learning · Computer Science 2024-10-16 Dibyajyoti Chakraborty , Seung Whan Chung , Troy Arcomano , Romit Maulik

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

Machine Learning · Computer Science 2019-08-22 Tiancheng Yu , Suvrit Sra

Accurate path following is challenging for autonomous robots operating in uncertain environments. Adaptive and predictive control strategies are crucial for a nonlinear robotic system to achieve high-performance path following control. In…

Robotics · Computer Science 2022-12-27 Rui Yang , Lei Zheng , Jiesen Pan , Hui Cheng

It has been challenging to model the complex temporal-spatial dependencies between agents for trajectory prediction. As each state of an agent is closely related to the states of adjacent time steps, capturing the local temporal dependency…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yixin Yan , Yang Li , Yuanfan Wang , Xiaozhou Zhou , Beihao Xia , Manjiang Hu , Hongmao Qin

This work presents a scalable control framework based on nonlinear Model Predictive Control for high-dimensional dynamical systems. The proposed approach addresses the key challenges of model scalability and partial observability by…

This Ph.D. dissertation contains results in two different but related fields: the implementation of model predictive control (MPC) in embedded systems using first order methods, and restart schemes for accelerated first order methods…

Optimization and Control · Mathematics 2021-09-07 Pablo Krupa

We study the problem of optimal state-feedback tracking control for unknown discrete-time deterministic systems with input constraints. To handle input constraints, state-of-art methods utilize a certain nonquadratic stage cost function,…

Systems and Control · Electrical Eng. & Systems 2020-12-09 Alexandros Tanzanakis , John Lygeros

We propose a new method that uses deep learning techniques to accelerate the popular alternating direction method of multipliers (ADMM) solution for inverse problems. The ADMM updates consist of a proximity operator, a least squares…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Qi Wei , Kai Fan , Lawrence Carin , Katherine A. Heller

Inferring unknown initial states in shock-dominated compressible flows from sparse and noisy measurements is a challenging ill-posed inverse problem due to nonlinear wave interactions and limited sensing. In this work, we develop a…

Machine Learning · Computer Science 2026-05-20 Bipin Tiwari , Muhammad Abid , Omer San

Current model-free adaptive control (MFAC) can hardly deal with the time delay problem in multiple-input multiple-output (MIMO) systems. To solve this problem, a novel model-free adaptive predictive control (MFAPC) method is proposed.…

Systems and Control · Electrical Eng. & Systems 2023-11-21 Feilong Zhang

Sample-based learning model predictive control (LMPC) strategies have recently attracted attention due to their desirable theoretical properties and their good empirical performance on robotic tasks. However, prior analysis of LMPC…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Brijen Thananjeyan , Ashwin Balakrishna , Ugo Rosolia , Joseph E. Gonzalez , Aaron Ames , Ken Goldberg

Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce…

Machine Learning · Computer Science 2023-10-31 Dominik Straub , Matthias Schultheis , Heinz Koeppl , Constantin A. Rothkopf