English
Related papers

Related papers: myGym: Modular Toolkit for Visuomotor Robotic Task…

200 papers

The emergence of 3D Gaussian Splatting for fast and high-quality novel view synthesize has opened up the possibility to construct photo-realistic simulations from video for robotic reinforcement learning. While the approach has been…

Robotics · Computer Science 2024-10-28 Liyou Zhou , Oleg Sinavski , Athanasios Polydoros

We propose VRGym, a virtual reality testbed for realistic human-robot interaction. Different from existing toolkits and virtual reality environments, the VRGym emphasizes on building and training both physical and interactive agents for…

Human-Computer Interaction · Computer Science 2019-04-04 Xu Xie , Hangxin Liu , Zhenliang Zhang , Yuxing Qiu , Feng Gao , Siyuan Qi , Yixin Zhu , Song-Chun Zhu

Applying Deep Reinforcement Learning (DRL) to complex tasks in the field of robotics has proven to be very successful in the recent years. However, most of the publications focus either on applying it to a task in simulation or to a task in…

Robotics · Computer Science 2020-11-17 Matteo Lucchi , Friedemann Zindler , Stephan Mühlbacher-Karrer , Horst Pichler

We present WebGym, the largest-to-date open-source environment for training realistic visual web agents. Real websites are non-stationary and diverse, making artificial or small-scale task sets insufficient for robust policy learning.…

Machine Learning · Computer Science 2026-05-05 Hao Bai , Alexey Taymanov , Tong Zhang , Aviral Kumar , Spencer Whitehead

Evaluating robot control policies is difficult: real-world testing is costly, and handcrafted simulators require manual effort to improve in realism and generality. We propose a world-model-based policy evaluation environment (WorldGym), an…

Robotics · Computer Science 2025-10-01 Julian Quevedo , Ansh Kumar Sharma , Yixiang Sun , Varad Suryavanshi , Percy Liang , Sherry Yang

Reinforcement learning (RL) has recently shown impressive performance in complex game AI and robotics tasks. To a large extent, this is thanks to the availability of simulated environments such as OpenAI Gym, Atari Learning Environment, or…

Computation and Language · Computer Science 2020-11-18 Rajkumar Ramamurthy , Rafet Sifa , Christian Bauckhage

Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training…

Robotics · Computer Science 2024-10-21 Shuguang Chu , Zebin Huang , Mingwei Lin , Dejun Li , Ignacio Carlucho

Modern Vision-Language Models (VLMs) remain poorly characterized in multi-step visual interactions, particularly in how they integrate perception, memory, and action over long horizons. We introduce VisGym, a gymnasium of 17 environments…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Zirui Wang , Junyi Zhang , Jiaxin Ge , Long Lian , Letian Fu , Lisa Dunlap , Ken Goldberg , XuDong Wang , Ion Stoica , David M. Chan , Sewon Min , Joseph E. Gonzalez

In this paper VisualEnv, a new tool for creating visual environment for reinforcement learning is introduced. It is the product of an integration of an open-source modelling and rendering software, Blender, and a python module used to…

Machine Learning · Computer Science 2021-12-02 Andrea Scorsoglio , Roberto Furfaro

This paper presents ModelicaGym toolbox that was developed to employ Reinforcement Learning (RL) for solving optimization and control tasks in Modelica models. The developed tool allows connecting models using Functional Mock-up Interface…

Software Engineering · Computer Science 2019-10-29 Oleh Lukianykhin , Tetiana Bogodorova

Autonomous learning of dexterous, long-horizon robotic skills has been a longstanding pursuit of embodied AI. Recent advances in robotic reinforcement learning (RL) have demonstrated remarkable performance and robustness in real-world…

Despite promising progress in reinforcement learning (RL), developing algorithms for autonomous driving (AD) remains challenging: one of the critical issues being the absence of an open-source platform capable of training and effectively…

Machine Learning · Computer Science 2021-11-16 Parth Kothari , Christian Perone , Luca Bergamini , Alexandre Alahi , Peter Ondruska

Bionic underwater robots have demonstrated their superiority in many applications. Yet, training their intelligence for a variety of tasks that mimic the behavior of underwater creatures poses a number of challenges in practice, mainly due…

Robotics · Computer Science 2022-06-06 Wenji Liu , Kai Bai , Xuming He , Shuran Song , Changxi Zheng , Xiaopei Liu

Reinforcement learning (RL)-based biomechanical simulations have the potential to revolutionise HCI research and interaction design, but currently lack usability and interpretability. Using the Human Action Cycle as a design lens, we…

Human-Computer Interaction · Computer Science 2026-02-18 Ankit Bhattarai , Hannah Selder , Florian Fischer , Arthur Fleig , Per Ola Kristensson

Recent advances in reinforcement learning (RL) have increased the promise of introducing cognitive assistance and automation to robot-assisted laparoscopic surgery (RALS). However, progress in algorithms and methods depends on the…

This paper presents Gym-Ignition, a new framework to create reproducible robotic environments for reinforcement learning research. It interfaces with the new generation of Gazebo, part of the Ignition Robotics suite, which provides three…

Robotics · Computer Science 2020-04-17 Diego Ferigo , Silvio Traversaro , Giorgio Metta , Daniele Pucci

While reinforcement learning (RL) can empower autonomous agents by enabling self-improvement through interaction, its practical adoption remains challenging due to costly rollouts, limited task diversity, unreliable reward signals, and…

Autonomous robots have the potential to serve as versatile caregivers that improve quality of life for millions of people worldwide. Yet, conducting research in this area presents numerous challenges, including the risks of physical…

Robotics · Computer Science 2019-10-11 Zackory Erickson , Vamsee Gangaram , Ariel Kapusta , C. Karen Liu , Charles C. Kemp

Vision language models (VLMs) achieve strong performance on general image understanding but struggle to think with medical images, especially when performing multi-step reasoning through iterative visual interaction. Medical VLMs often rely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Meng Lu , Yuxing Lu , Yuchen Zhuang , Megan Mullins , Yang Xie , Guanghua Xiao , Charles Fleming , Wenqi Shi , Xuan Wang

It is essential for autonomous robots to be socially compliant while navigating in human-populated environments. Machine Learning and, especially, Deep Reinforcement Learning have recently gained considerable traction in the field of Social…

Robotics · Computer Science 2023-07-10 Aditya Kapoor , Sushant Swamy , Luis Manso , Pilar Bachiller
‹ Prev 1 2 3 10 Next ›