English
Related papers

Related papers: A Generative Physics-Informed Reinforcement Learni…

200 papers

Markov state models (MSMs) are valuable for studying dynamics of protein conformational changes via statistical analysis of molecular dynamics (MD) simulations. In MSMs, the complex configuration space is coarse-grained into conformational…

Biological Physics · Physics 2024-06-11 Dedi Wang , Yunrui Qiu , Eric Beyerle , Xuhui Huang , Pratyush Tiwary

For seismic analysis in engineering structures, it is essential to consider the dynamic responses under seismic excitation, necessitating the description of seismic accelerations. Limit seismics samples lead to incomplete uncertainty…

Computational Engineering, Finance, and Science · Computer Science 2025-05-20 Shizhong Liang , Yuxiang Yang , Chen Li , Feng Wu

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Reinforcement learning (RL) approaches based on Markov Decision Processes (MDPs) are predominantly applied in the robot joint space, often relying on limited task-specific information and partial awareness of the 3D environment. In…

Robotics · Computer Science 2026-03-09 Bingkun Huang , Yuhe Gong , Zewen Yang , Tianyu Ren , Luis Figueredo

Many state-of-the-art methods for safety assessment and motion planning for automated driving require estimation of the probability of collision (POC). To estimate the POC, a shape approximation of the colliding actors and probability…

Robotics · Computer Science 2024-05-24 Leon Tolksdorf , Christian Birkner , Arturo Tejada , Nathan van de Wouw

For large model spaces, the potential entrapment of Markov chain Monte Carlo (MCMC) based methods with spike-and-slab priors poses significant challenges in posterior computation in regression models. On the other hand, maximum a posteriori…

Methodology · Statistics 2026-02-25 Shamriddha De , Joyee Ghosh

Particle Markov Chain Monte Carlo (PMCMC) is a general computational approach to Bayesian inference for general state space models. Our article scales up PMCMC in terms of the number of observations and parameters by generating the…

Methodology · Statistics 2023-07-04 David Gunawan , Chris Carter , Robert Kohn

Traditional motion planning methods for robots with many degrees-of-freedom, such as mobile manipulators, are often computationally prohibitive for real-world settings. In this paper, we propose a novel multi-model motion planning pipeline,…

Robotics · Computer Science 2025-06-11 Neşet Ünver Akmandor , Sarvesh Prajapati , Mark Zolotas , Taşkın Padır

We focus on generative autoencoders, such as variational or adversarial autoencoders, which jointly learn a generative model alongside an inference model. Generative autoencoders are those which are trained to softly enforce a prior on the…

Machine Learning · Computer Science 2017-01-13 Antonia Creswell , Kai Arulkumaran , Anil Anthony Bharath

This paper proposes a nonplanar model predictive control (MPC) framework for autonomous vehicles operating on nonplanar terrain. To approximate complex vehicle dynamics in such environments, we develop a geometry-aware modeling approach…

Robotics · Computer Science 2026-02-19 Ahmad Amine , Kabir Puri , Viet-Anh Le , Rahul Mangharam

The static density response of the uniform electron gas is of fundamental importance for numerous applications. Here, we employ the recently developed \textit{ab initio} permutation blocking path integral Monte Carlo (PB-PIMC) technique…

Strongly Correlated Electrons · Physics 2017-08-23 Tobias Dornheim , Simon Groth , Jan Vorberger , Michael Bonitz

The Hamiltonian Monte Carlo (HMC) algorithm is a powerful Markov Chain Monte Carlo (MCMC) method that uses Hamiltonian dynamics to generate samples from a target distribution. To fully exploit its potential, we must understand how…

Computation · Statistics 2025-01-27 Abraham Granados , Isaías Bañales

In this work, we propose a Model Predictive Control (MPC)-based Reinforcement Learning (RL) method for Autonomous Surface Vehicles (ASVs). The objective is to find an optimal policy that minimizes the closed-loop performance of a simplified…

Systems and Control · Electrical Eng. & Systems 2021-08-06 Wenqi Cai , Arash B. Kordabad , Hossein N. Esfahani , Anastasios M. Lekkas , Sebastien Gros

In this paper we study online Reinforcement Learning (RL) in partially observable dynamical systems. We focus on the Predictive State Representations (PSRs) model, which is an expressive model that captures other well-known models such as…

Machine Learning · Computer Science 2022-08-16 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

Cooperative control of groups of autonomous vehicles (AVs), i.e., platoons, is a promising direction to improving the efficiency of autonomous transportation systems. In this context, distributed co-optimization of both vehicle speed and…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Samuel Mallick , Gianpietro Battocletti , Dimitris Boskos , Azita Dabiri , Bart De Schutter

Integration of reinforcement learning and imitation learning is an important problem that has been studied for a long time in the field of intelligent robotics. Reinforcement learning optimizes policies to maximize the cumulative reward,…

Machine Learning · Computer Science 2023-01-18 Akira Kinose , Tadahiro Taniguchi

Gaussian Process (GP) regression is shown to be effective for learning unknown dynamics, enabling efficient and safety-aware control strategies across diverse applications. However, existing GP-based model predictive control (GP-MPC)…

Systems and Control · Electrical Eng. & Systems 2025-05-13 Manish Prajapat , Johannes Köhler , Amon Lahr , Andreas Krause , Melanie N. Zeilinger

With the developed "extended Monte Calro" (EMC) algorithm, we have studied the depinning transition in Ising-type lattice models by extensive numerical simulations, taking the random-field Ising model with a driving field and the driven…

Statistical Mechanics · Physics 2016-10-20 Lisha Sia , Xiaoyun Liao , Nengji Zhou

We develop a novel advanced Particle Markov chain Monte Carlo algorithm that is capable of sampling from the posterior distribution of non-linear state space models for both the unobserved latent states and the unknown model parameters. We…

Methodology · Statistics 2015-03-17 Gareth W. Peters , Geoff R. Hosack , Keith R. Hayes

Accurately simulating diverse behaviors of heterogeneous agents in various scenarios is fundamental to autonomous driving simulation. This task is challenging due to the multi-modality of behavior distribution, the high-dimensionality of…

Robotics · Computer Science 2024-10-27 Baotian He , Yibing Li