English
Related papers

Related papers: Chrono-Gymnasium: An Open-Source, Gymnasium-Compat…

200 papers

Learning effective reinforcement learning (RL) policies to solve real-world complex tasks can be quite challenging without a high-fidelity simulation environment. In most cases, we are only given imperfect simulators with simplified…

Machine Learning · Computer Science 2025-10-16 Haoyi Niu , Shubham Sharma , Yiwen Qiu , Ming Li , Guyue Zhou , Jianming Hu , Xianyuan Zhan

Testing and evaluation of robotics systems is a difficult and oftentimes tedious task due to the systems' complexity and a lack of tools to conduct reproducible robotics experiments. Additionally, almost all available tools are either…

Robotics · Computer Science 2024-09-12 Frederik Pasch , Florian Mirus , Yongzhou Zhang , Kay-Ulrich Scholl

Studies that broaden drone applications into complex tasks require a stable control framework. Recently, deep reinforcement learning (RL) algorithms have been exploited in many studies for robot control to accomplish complex tasks.…

Digital twins have emerged as a key technology for optimizing the performance of engineering products and systems. High-fidelity numerical simulations constitute the backbone of engineering design, providing an accurate insight into the…

Machine Learning · Computer Science 2023-06-28 G. I. Drakoulas , T. V. Gortsas , G. C. Bourantas , V. N. Burganos , D. Polyzos

Learning from few demonstrations to develop policies robust to variations in robot initial positions and object poses is a problem of significant practical interest in robotics. Compared to imitation learning, which often struggles to…

Robotics · Computer Science 2025-04-30 Haowen Sun , Han Wang , Chengzhong Ma , Shaolong Zhang , Jiawei Ye , Xingyu Chen , Xuguang Lan

Constructing robust simulators is essential for asking "what if?" questions and guiding policy in critical domains like healthcare and logistics. However, existing methods often struggle, either failing to generalize beyond historical data…

Machine Learning · Computer Science 2025-06-12 Samuel Holt , Max Ruiz Luyten , Antonin Berthon , Mihaela van der Schaar

Efficient multi-agent 3D mapping is essential for robotic teams operating in unknown environments, but dense representations hinder real-time exchange over constrained communication links. In multi-agent Simultaneous Localization and…

Robotics · Computer Science 2026-04-02 Monica M. Q. Li , Pierre-Yves Lajoie , Jialiang Liu , Giovanni Beltrame

Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, creating a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Xinze Chen , Guanghong Jia , Guan Huang , Wenjun Mei

We identify the need for a gamified self-driving simulator where game mechanics encourage high-quality data capture, and design and apply such a simulator to collecting lane-following training data. The resulting synthetic data enables a…

Robotics · Computer Science 2019-11-19 Joshua E. Siegel , Georgios Pappas , Konstantinos Politopoulos , Yongbin Sun

Large real-world robot datasets hold great potential to train generalist robot models, but scaling real-world human data collection is time-consuming and resource-intensive. Simulation has great potential in supplementing large-scale data,…

To alleviate hardware scarcity in training large deep neural networks (DNNs), particularly large language models (LLMs), we present FusionLLM, a decentralized training system designed and implemented for training DNNs using geo-distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Zhenheng Tang , Xueze Kang , Yiming Yin , Xinglin Pan , Yuxin Wang , Xin He , Qiang Wang , Rongfei Zeng , Kaiyong Zhao , Shaohuai Shi , Amelie Chi Zhou , Bo Li , Bingsheng He , Xiaowen Chu

Significant obstacles exist in scientific domains including genetics, climate modeling, and astronomy due to the management, preprocess, and training on complicated data for deep learning. Even while several large-scale solutions offer…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Arup Kumar Sarker , Aymen Alsaadi , Alexander James Halpern , Prabhath Tangella , Mikhail Titov , Niranda Perera , Mills Staylor , Gregor von Laszewski , Shantenu Jha , Geoffrey Fox

A world model is an internal model that simulates how the world evolves. Given past observations and actions, it predicts the future physical state of both the embodied agent and its environment. Accurate world models are essential for…

Machine Learning · Computer Science 2026-04-22 Zaishuo Xia , Yukuan Lu , Xinyi Li , Yifan Xu , Yubei Chen

Current research directions in deep reinforcement learning include bridging the simulation-reality gap, improving sample efficiency of experiences in distributed multi-agent reinforcement learning, together with the development of robust…

Machine Learning · Computer Science 2020-08-19 Wenshuai Zhao , Jorge Peña Queralta , Li Qingqing , Tomi Westerlund

Since the resurgence of CNNs the robotic vision community has developed a range of algorithms that perform classification, semantic segmentation and structure prediction (depths, normals, surface curvature) using neural networks. While some…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Andrew Spek , Thanuja Dharmasiri , Tom Drummond

Distributed deep neural networks (DNNs) have become a cornerstone for scaling machine learning to meet the demands of increasingly complex applications. However, the rapid growth in model complexity far outpaces CMOS technology scaling,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-12 Jonas Svedas , Hannah Watson , Nathan Laubeuf , Diksha Moolchandani , Abubakr Nada , Arjun Singh , Dwaipayan Biswas , James Myers , Debjyoti Bhattacharjee

We propose DeepSim, a reinforcement learning environment build toolkit for ROS and Gazebo. It allows machine learning or reinforcement learning researchers to access the robotics domain and create complex and challenging custom tasks in ROS…

Machine Learning · Computer Science 2022-05-18 Woong Gyu La , Lingjie Kong , Sunil Muralidhara , Pratik Nichat

Simulating physical systems is a core component of scientific computing, encompassing a wide range of physical domains and applications. Recently, there has been a surge in data-driven methods to complement traditional numerical simulations…

Machine Learning · Computer Science 2021-08-19 Karl Otness , Arvi Gjoka , Joan Bruna , Daniele Panozzo , Benjamin Peherstorfer , Teseo Schneider , Denis Zorin

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

We propose an open-source python platform for applications of Deep Reinforcement Learning (DRL) in fluid mechanics. DRL has been widely used in optimizing decision-making in nonlinear and high-dimensional problems. Here, an agent maximizes…

Fluid Dynamics · Physics 2024-06-19 Qiulei Wang , Lei Yan , Gang Hu , Chao Li , Yiqing Xiao , Hao Xiong , Jean Rabault , Bernd R. Noack