English
Related papers

Related papers: Towards Certified Sim-to-Real Transfer via Stochas…

200 papers

Functional verification constitutes one of the most challenging tasks in the development of modern hardware systems, and simulation-based verification techniques dominate the functional verification landscape. A dominant paradigm in…

Logic in Computer Science · Computer Science 2013-04-08 Supratik Chakraborty , Kuldeep S. Meel , Moshe Y. Vardi

In order to mitigate the sample complexity of real-world reinforcement learning, common practice is to first train a policy in a simulator where samples are cheap, and then deploy this policy in the real world, with the hope that it…

Machine Learning · Computer Science 2024-10-29 Andrew Wagenmaker , Kevin Huang , Liyiming Ke , Byron Boots , Kevin Jamieson , Abhishek Gupta

We introduce a method to construct a stochastic surrogate model from the results of dimensionality reduction in forward uncertainty quantification. The hypothesis is that the high-dimensional input augmented by the output of a computational…

Applications · Statistics 2026-02-12 Jungho Kim , Sang-ri Yi , Ziqi Wang

We want to enable fine manipulation with a multi-fingered robotic hand by using modern deep reinforcement learning methods. Key for fine manipulation is a spatially resolved tactile sensor. Here, we present a novel model of a tactile skin…

Robotics · Computer Science 2024-09-20 Ulf Kasolowsky , Berthold Bäuml

A task-sequencing simulator in robotics manipulation to integrate simulation-for-learning and simulation-for-execution is introduced. Unlike existing machine-learning simulation where a non-decomposed simulation is used to simulate a…

Robotics · Computer Science 2023-01-05 Kazuhiro Sasabuchi , Daichi Saito , Atsushi Kanehira , Naoki Wake , Jun Takamatsu , Katsushi Ikeuchi

We provide finite-sample performance guarantees for control policies executed on stochastic robotic systems. Given an open- or closed-loop policy and a finite set of trajectory rollouts under the policy, we bound the expected value,…

Robotics · Computer Science 2024-06-17 Joseph A. Vincent , Aaron O. Feldman , Mac Schwager

Predictive design and optimization methods for controlled quantum systems depend on the accuracy of the system model. Any distortion of the input fields in an experimental platform alters the model accuracy and eventually disturbs the…

Quantum Physics · Physics 2023-06-29 Juhi Singh , Robert Zeier , Tommaso Calarco , Felix Motzoi

Combining efficient and safe control for safety-critical systems is challenging. Robust methods may be overly conservative, whereas probabilistic controllers require a trade-off between efficiency and safety. In this work, we propose a…

Systems and Control · Electrical Eng. & Systems 2022-09-16 Tim Brüdigam , Robert Jacumet , Dirk Wollherr , Marion Leibold

In this paper, we compute finite sample bounds for data-driven approximations of the solution to stochastic reachability problems. Our approach uses a nonparametric technique known as kernel distribution embeddings, and provides…

Optimization and Control · Mathematics 2021-12-09 Adam J. Thorpe , Kendric R. Ortiz , Meeko M. K. Oishi

Synthetic simulation data and real-world human data provide scalable alternatives to circumvent the prohibitive costs of robot data collection. However, these sources suffer from the sim-to-real visual gap and the human-to-robot embodiment…

Robotics · Computer Science 2026-01-28 Kaipeng Fang , Weiqing Liang , Yuyang Li , Ji Zhang , Pengpeng Zeng , Lianli Gao , Jingkuan Song , Heng Tao Shen

This paper provides a novel approach for finding sparse state-space realizations of linear systems (e.g., controllers). Sparse controllers are commonly used in distributed control, where a controller is synthesized with some sparsity…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Yaozhi Du , Jing Shuang Li

Deep learning and reinforcement learning methods have been shown to enable learning of flexible and complex robot controllers. However, the reliance on large amounts of training data often requires data collection to be carried out in…

Robotics · Computer Science 2020-04-02 Zihan Ding , Nathan F. Lepora , Edward Johns

Navigation and manipulation are core capabilities in Embodied AI, yet training agents with these capabilities in the real world faces high costs and time complexity. Therefore, sim-to-real transfer has emerged as a key approach, yet the…

Robotics · Computer Science 2025-05-06 Lik Hang Kenny Wong , Xueyang Kang , Kaixin Bai , Jianwei Zhang

Stochastic simulation is a widely used method for estimating quantities in models of chemical reaction networks where uncertainty plays a crucial role. However, reducing the statistical uncertainty of the corresponding estimators requires…

Quantitative Methods · Quantitative Biology 2019-06-13 Michael Backenköhler , Luca Bortolussi , Verena Wolf

Recent work in visual end-to-end learning for robotics has shown the promise of imitation learning across a variety of tasks. Such approaches are expensive both because they require large amounts of real world training demonstrations and…

Simulation is a useful tool in situations where training data for machine learning models is costly to annotate or even hard to acquire. In this work, we propose a reinforcement learning-based method for automatically adjusting the…

Machine Learning · Computer Science 2019-05-15 Nataniel Ruiz , Samuel Schulter , Manmohan Chandraker

Studies on simulation input uncertainty often built on the availability of input data. In this paper, we investigate an inverse problem where, given only the availability of output data, we nonparametrically calibrate the input models and…

Optimization and Control · Mathematics 2018-01-09 Aleksandrina Goeva , Henry Lam , Huajie Qian , Bo Zhang

Recent advances in machine learning, specifically transformer architecture, have led to significant advancements in commercial domains. These powerful models have demonstrated superior capability to learn complex relationships and often…

Machine Learning · Computer Science 2024-05-29 Matthew L. Olson , Shusen Liu , Jayaraman J. Thiagarajan , Bogdan Kustowski , Weng-Keen Wong , Rushil Anirudh

Global dynamics in nonlinear stochastic systems is often difficult to analyze rigorously. Yet, many excellent numerical methods exist to approximate these systems. In this work, we propose a method to bridge the gap between computation and…

Dynamical Systems · Mathematics 2019-01-07 Maxime Breden , Christian Kuehn

This article deals with stochastic processes endowed with the Markov (memoryless) property and evolving over general (uncountable) state spaces. The models further depend on a non-deterministic quantity in the form of a control input, which…

Systems and Control · Computer Science 2015-09-11 Sofie Haesaert , Robert Babuska , Alessandro Abate