English
Related papers

Related papers: Bayesian Inverse Transition Learning: Learning Dyn…

200 papers

When hyperparameter optimization of a machine learning algorithm is repeated for multiple datasets it is possible to transfer knowledge to an optimization run on a new dataset. We develop a new hyperparameter-free ensemble model for…

Machine Learning · Statistics 2022-10-25 Matthias Feurer , Benjamin Letham , Frank Hutter , Eytan Bakshy

Deep learning is increasingly moving towards a transfer learning paradigm whereby large foundation models are fine-tuned on downstream tasks, starting from an initialization learned on the source task. But an initialization contains…

Machine Learning · Computer Science 2022-05-23 Ravid Shwartz-Ziv , Micah Goldblum , Hossein Souri , Sanyam Kapoor , Chen Zhu , Yann LeCun , Andrew Gordon Wilson

This paper presents an inverse reinforcement learning~(IRL) framework for Bayesian stopping time problems. By observing the actions of a Bayesian decision maker, we provide a necessary and sufficient condition to identify if these actions…

Machine Learning · Computer Science 2023-03-29 Kunal Pattanayak , Vikram Krishnamurthy

This study proposes a learning-based method with domain adaptability for input estimation of vehicle suspension systems. In a crowdsensing setting for bridge health monitoring, vehicles carry sensors to collect samples of the bridge's…

Machine Learning · Computer Science 2021-04-05 Liam M. Cronin , Soheil Sadeghi Eshkevari , Debarshi Sen , Shamim N. Pakzad

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

Machine Learning · Statistics 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

This paper presents a practical application of Relative Trajectory Balance (RTB), a recently introduced off-policy reinforcement learning (RL) objective that can asymptotically solve Bayesian inverse problems optimally. We extend the…

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

Machine Learning · Statistics 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

We consider a human-assisted autonomy sensor fusion for dynamic target localization in a Bayesian framework. Autonomous sensor-based tracking systems can suffer from observability and target detection failure. Humans possess valuable…

Robotics · Computer Science 2024-10-08 Min-Won Seo , Solmaz S. Kia

In indirect measurements, the measurand is determined by solving an inverse problem which requires a model of the measurement process. Such models are often approximations and introduce systematic errors leading to a bias of the posterior…

Methodology · Statistics 2025-09-22 Maren Casfor , Philipp Trunschke , Sebastian Heidenreich , Nando Hegemann

In this paper, we propose a Transformer-based framework for approximating solutions to infinite-dimensional optimization problems: calculus of variations problems and optimal control problems. Our approach leverages offline training on data…

Optimization and Control · Mathematics 2025-11-20 Gage MacLin , Venanzio Cichella , Andrew Patterson , Irene Gregory

We present a framework for the efficient computation of optimal Bayesian decisions under intractable likelihoods, by learning a surrogate model for the expected utility (or its distribution) as a function of the action and data spaces. We…

Machine Learning · Statistics 2023-11-13 Justin Alsing , Thomas D. P. Edwards , Benjamin Wandelt

We present new algorithms for inverse reinforcement learning (IRL, or inverse optimal control) in convex optimization settings. We argue that finite-space IRL can be posed as a convex quadratic program under a Bayesian inference framework…

Machine Learning · Computer Science 2013-01-22 Qifeng Qiao , Peter A. Beling

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Memory-based meta-learning is a technique for approximating Bayes-optimal predictors. Under fairly general conditions, minimizing sequential prediction error, measured by the log loss, leads to implicit meta-learning. The goal of this work…

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

Machine Learning · Computer Science 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

This work introduces an adaptive Bayesian algorithm for real-time trajectory prediction via intention inference, where a target's intentions and motion characteristics are unknown and subject to change. The method concurrently estimates two…

Robotics · Computer Science 2025-09-30 Shunan Yin , Zehui Lu , Shaoshuai Mou

Traditional imitation learning provides a set of methods and algorithms to learn a reward function or policy from expert demonstrations. Learning from demonstration has been shown to be advantageous for navigation tasks as it allows for…

Robotics · Computer Science 2021-08-03 Christian Ellis , Maggie Wigness , John G. Rogers , Craig Lennon , Lance Fiondella

By extending the extreme learning machine by additional control inputs, we achieved almost complete reproduction of bifurcation structures of dynamical systems. The learning ability of the proposed neural network system is striking in that…

Chaotic Dynamics · Physics 2024-10-21 Satoru Tadokoro , Akihiro Yamaguchi , Takao Namiki , Ichiro Tsuda

Limited data has become a major bottleneck in scaling up offline imitation learning (IL). In this paper, we propose enhancing IL performance under limited expert data by introducing a pre-training stage that learns dynamics representations,…

Robotics · Computer Science 2025-08-21 Haitong Ma , Bo Dai , Zhaolin Ren , Yebin Wang , Na Li