English
Related papers

Related papers: Virtual Reality for Robots

200 papers

Reinforcement learning is considered as a promising direction for driving policy learning. However, training autonomous driving vehicle with reinforcement learning in real environment involves non-affordable trial-and-error. It is more…

Artificial Intelligence · Computer Science 2017-09-27 Xinlei Pan , Yurong You , Ziyan Wang , Cewu Lu

Understanding and controlling engineered quantum systems is key to developing practical quantum technology. However, given the current technological limitations, such as fabrication imperfections and environmental noise, this is not always…

Training robots for operation in the real world is a complex, time consuming and potentially expensive task. Despite significant success of reinforcement learning in games and simulations, research in real robot applications has not been…

Artificial Intelligence · Computer Science 2017-09-28 Markus Wulfmeier , Ingmar Posner , Pieter Abbeel

The use of machine learning in cyber-physical systems has attracted the interest of both industry and academia. However, no general solution has yet been found against the unpredictable behavior of neural networks and reinforcement learning…

Robotics · Computer Science 2025-05-01 Federico Nesti , Gianluca D'Amico , Mauro Marinoni , Giorgio Buttazzo

Formalisms based on quantum theory have been used in Cognitive Science for decades due to their descriptive features. A quantum-like (QL) approach provides descriptive features such as state superposition and probabilistic interference…

Robotics · Computer Science 2020-06-05 Davide Lanza , Paolo Solinas , Fulvio Mastrogiovanni

The field of robotics has made significant advances towards generalist robot manipulation policies. However, real-world evaluation of such policies is not scalable and faces reproducibility challenges, which are likely to worsen as policies…

For robots to handle the numerous factors that can affect them in the real world, they must adapt to changes and unexpected events. Evolutionary robotics tries to solve some of these issues by automatically optimizing a robot for a specific…

Robotics · Computer Science 2018-05-10 Tønnes F. Nygaard , Charles P. Martin , Eivind Samuelsen , Jim Torresen , Kyrre Glette

The manual design of soft robots and their controllers is notoriously challenging, but it could be augmented---or, in some cases, entirely replaced---by automated design tools. Machine learning algorithms can automatically propose, test,…

An increasing number of studies employ virtual reality (VR) to evaluate interactions between autonomous vehicles (AVs) and pedestrians. VR simulators are valued for their cost-effectiveness, flexibility in developing various traffic…

Human-Computer Interaction · Computer Science 2024-03-19 Tram Thi Minh Tran , Callum Parker , Martin Tomitsch

Developing control policies in simulation is often more practical and safer than directly running experiments in the real world. This applies to policies obtained from planning and optimization, and even more so to policies obtained from…

The field of visual representation learning has seen explosive growth in the past years, but its benefits in robotics have been surprisingly limited so far. Prior work uses generic visual representations as a basis to learn (task-specific)…

Robotics · Computer Science 2023-08-16 Jianren Wang , Sudeep Dasari , Mohan Kumar Srirama , Shubham Tulsiani , Abhinav Gupta

Robots can learn preferences from human demonstrations, but their success depends on how informative these demonstrations are. Being informative is unfortunately very challenging, because during teaching, people typically get no…

Robotics · Computer Science 2019-11-07 Sandy H. Huang , Isabella Huang , Ravi Pandya , Anca D. Dragan

A realistic simulation environment is an essential tool in every roboticist's toolkit, with uses ranging from planning and control to training policies with reinforcement learning. Despite the centrality of simulation in modern robotics,…

Robotics · Computer Science 2022-07-18 Brian Acosta , William Yang , Michael Posa

Voxel-based soft robots (VSRs) are aggregations of soft blocks whose design is amenable to optimization. We here present a software, 2D-VSR-Sim, for facilitating research concerning the optimization of VSRs body and brain. The software,…

Robotics · Computer Science 2020-01-28 Eric Medvet , Alberto Bartoli , Andrea De Lorenzo , Stefano Seriani

Social robots often rely on visual perception to understand their users and the environment. Recent advancements in data-driven approaches for computer vision have demonstrated great potentials for applying deep-learning models to enhance a…

Robotics · Computer Science 2024-03-07 Wangjie Zhong , Leimin Tian , Duy Tho Le , Hamid Rezatofighi

The increasing affordability of robot hardware is accelerating the integration of robots into everyday activities. However, training a robot to automate a task requires expensive trajectory data where a trained human annotator moves a…

Human-Computer Interaction · Computer Science 2024-08-06 Jun Wang , Chun-Cheng Chang , Jiafei Duan , Dieter Fox , Ranjay Krishna

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost- and time-efficient solution for developing…

Human-Computer Interaction · Computer Science 2024-09-17 Jan Hendrik Plümer , Kevin Yu , Ulrich Eck , Denis Kalkofen , Philipp Steininger , Nassir Navab , Markus Tatzgern

This article presents a novel telepresence system for advancing aerial manipulation in dynamic and unstructured environments. The proposed system not only features a haptic device, but also a virtual reality (VR) interface that provides…

This work-in-progress paper discusses the use of student-centered pedagogy to teach clinical oculomotor examination via Virtual Reality (VR). Traditional methods, such as PowerPoint slides and lab activities, are often insufficient for…

Computational Engineering, Finance, and Science · Computer Science 2024-05-28 Austin Finlayson , Rui Wu , Chia-Cheng Lin , Brian Sylcott

The Metaverse and its promises are fast becoming reality as maturing technologies are empowering the different facets. One of the highlights of the Metaverse is that it offers the possibility for highly immersive and interactive…

Networking and Internet Architecture · Computer Science 2023-03-09 Wenhan Yu , Terence Jie Chua , Jun Zhao