English
Related papers

Related papers: Sim and Real: Better Together

200 papers

Reinforcement learning has the potential to automate the acquisition of behavior in complex settings, but in order for it to be successfully deployed, a number of practical challenges must be addressed. First, in real world settings, when…

Machine Learning · Computer Science 2020-11-11 Kelvin Xu , Siddharth Verma , Chelsea Finn , Sergey Levine

Nested simulation is a natural approach to tackle nested estimation problems in operations research and financial engineering. The outer-level simulation generates outer scenarios and the inner-level simulations are run in each outer…

Risk Management · Quantitative Finance 2022-03-31 Kun Zhang , Ben Mingbin Feng , Guangwu Liu , Shiyu Wang

Learning effective policies for real-world problems is still an open challenge for the field of reinforcement learning (RL). The main limitation being the amount of data needed and the pace at which that data can be obtained. In this paper,…

Machine Learning · Computer Science 2022-02-04 Miguel Suau , Jinke He , Matthijs T. J. Spaan , Frans A. Oliehoek

Shared autonomy is an operational concept in which a user and an autonomous agent collaboratively control a robotic system. It provides a number of advantages over the extremes of full-teleoperation and full-autonomy in many settings.…

Robotics · Computer Science 2025-08-28 Takuma Yoneda , Luzhe Sun , Ge Yang , Bradly Stadie , Matthew Walter

With the rise of computers, simulation models have emerged beside the more traditional statistical and mathematical models as a third pillar for ecological analysis. Broadly speaking, a simulation model is an algorithm, typically…

Populations and Evolution · Quantitative Biology 2018-12-24 Florian Hartig

Learning-based robotic systems demand rigorous validation to assure reliable performance, but extensive real-world testing is often prohibitively expensive, and if conducted may still yield insufficient data for high-confidence guarantees.…

Robotics · Computer Science 2025-09-05 Rachel Luo , Heng Yang , Michael Watson , Apoorva Sharma , Sushant Veer , Edward Schmerling , Marco Pavone

How do we enable AI systems to efficiently learn in the real-world? First-principles models are widely used to simulate natural systems, but often fail to capture real-world complexity due to simplifying assumptions. In contrast, deep…

Machine Learning · Computer Science 2025-09-09 Lenart Treven , Bhavya Sukhija , Jonas Rothfuss , Stelian Coros , Florian Dörfler , Andreas Krause

Simulations are gaining increasingly significance in the field of autonomous driving due to the demand for rapid prototyping and extensive testing. Employing physics-based simulation brings several benefits at an affordable cost, while…

A network of agents attempt to learn some unknown state of the world drawn by nature from a finite set. Agents observe private signals conditioned on the true state, and form beliefs about the unknown state accordingly. Each agent may face…

Machine Learning · Computer Science 2015-03-13 Shahin Shahrampour , Mohammad Amin Rahimian , Ali Jadbabaie

Robotic assembly presents a long-standing challenge due to its requirement for precise, contact-rich manipulation. While simulation-based learning has enabled the development of robust assembly policies, their performance often degrades…

Robotics · Computer Science 2026-02-27 Yijie Guo , Iretiayo Akinola , Lars Johannsmeier , Hugo Hadfield , Abhishek Gupta , Yashraj Narang

As human-robot collaboration is becoming more widespread, there is a need for a more natural way of communicating with the robot. This includes combining data from several modalities together with the context of the situation and background…

Human-Computer Interaction · Computer Science 2024-04-03 Petr Vanc , Radoslav Skoviera , Karla Stepanova

A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline…

Robotics · Computer Science 2021-06-02 Shadi Endrawis , Gal Leibovich , Guy Jacob , Gal Novik , Aviv Tamar

In engineering, it is a common desire to couple existing simulation tools together into one big system by passing information from subsystems as parameters into the subsystems under influence. As executed at fixed time points, this data…

Numerical Analysis · Mathematics 2017-04-25 Thilo Moshagen

This paper discusses about the advantage of using asynchronous simulation in the case of interactive simulation in which user can steer and control parameters during a simulation in progress. synchronous models allow to compute each…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-11 Mengchen Wang , Nicolas Ferey , Patrick Bourdot , Frederic Magoules

Simulation is a crucial tool for accelerating the development of autonomous vehicles. Making simulation realistic requires models of the human road users who interact with such cars. Such models can be obtained by applying learning from…

Modeling how a robot interacts with the environment around it is an important prerequisite for designing control and planning algorithms. In fact, the performance of controllers and planners is highly dependent on the quality of the model.…

Machine Learning · Computer Science 2020-03-03 Clark Zhang , Arbaaz Khan , Santiago Paternain , Alejandro Ribeiro

Modern robotics is gravitating toward increasingly collaborative human robot interaction. Tools such as acceleration policies can naturally support the realization of reactive, adaptive, and compliant robots. These tools require us to model…

Robotics · Computer Science 2017-10-09 Daniel Kappler , Franziska Meier , Nathan Ratliff , Stefan Schaal

In the pursuit of artificial general intelligence, our most significant measurement of progress is an agent's ability to achieve goals in a wide range of environments. Existing platforms for constructing such environments are typically…

Learning collaborative behaviors is essential for multi-agent systems. Traditionally, multi-agent reinforcement learning solves this implicitly through a joint reward and centralized observations, assuming collaborative behavior will…

Robotics · Computer Science 2025-02-27 Zhengran Ji , Lingyu Zhang , Paul Sajda , Boyuan Chen

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system,…

Artificial Intelligence · Computer Science 2026-04-22 Krisztian Balog , ChengXiang Zhai