English
Related papers

Related papers: A Virtual Reality Simulation Pipeline for Online M…

200 papers

Constructing physically accurate simulation environments (Real2Sim) traditionally relies on manual system identification or rigid, exhaustive exploration routines. These task-agnostic pipelines often fail to leverage semantic scene context,…

Robotics · Computer Science 2026-05-19 Alessandro Adami , Sebastian Zudaire , Ruggero Carli , Pietro Falco

We present the design of a mixed reality (MR) telehealth training system that aims to close the gap between in-person and distance training and re-training for medical procedures. Our system uses real-time volumetric capture as a means for…

Human-Computer Interaction · Computer Science 2023-12-18 Manuel Rebol , Krzysztof Pietroszek , Claudia Ranniger , Colton Hood , Adam Rutenberg , Neal Sikka , Christian Guetl

Learning robotic manipulation policies directly in the real world can be expensive and time-consuming. While reinforcement learning (RL) policies trained in simulation present a scalable alternative, effective sim-to-real transfer remains…

Robotics · Computer Science 2026-03-09 Maggie Wang , Stephen Tian , Aiden Swann , Ola Shorinwa , Jiajun Wu , Mac Schwager

Virtual Platforms (VPs) enable early software validation of autonomous systems' electronics, reducing costs and time-to-market. While many VPs support both functional and non-functional simulation (e.g., timing, power), they lack the…

Computational psychiatry faces a fundamental trade-off: traditional reinforcement learning (RL) models offer interpretability but lack behavioral realism, while large language model (LLM) agents generate realistic behaviors but lack…

Artificial Intelligence · Computer Science 2026-03-06 Zuo Fei , Kezhi Wang , Xiaomin Chen , Yizhou Huang

Virtual Reality (VR) can support effective and scalable training of psychomotor skills in manufacturing. However, many industry training modules offer experiences that are close-ended and do not allow for human error. We aim to address this…

Human-Computer Interaction · Computer Science 2023-10-27 Hing Lie , Kachina Studer , Zhen Zhao , Ben Thomson , Dishita G Turakhia , John Liu

In this paper, we introduce a novel conceptual model for a robot's behavioral adaptation in its long-term interaction with humans, integrating dynamic robot role adaptation with principles of flow experience from psychology. This…

Robotics · Computer Science 2024-01-08 Huili Chen , Sharifa Alghowinem , Cynthia Breazeal , Hae Won Park

Model-based Deep Reinforcement Learning (RL) assumes the availability of a model of an environment's underlying transition dynamics. This model can be used to predict future effects of an agent's possible actions. When no such model is…

Machine Learning · Computer Science 2021-12-15 Andreas Sedlmeier , Michael Kölle , Robert Müller , Leo Baudrexel , Claudia Linnhoff-Popien

Traditional robot simulators focus on physical process modeling and realistic rendering, often suffering from high computational costs, inefficiencies, and limited adaptability. To handle this issue, we concentrate on behavior simulation in…

Robotics · Computer Science 2025-09-09 Jianan Wang , Bin Li , Jingtao Qi , Xueying Wang , Fu Li , Hanxun Li

High-fidelity social simulation is pivotal for addressing complex Web societal challenges, yet it demands agents capable of authentically replicating the dynamic spectrum of human interaction. Current LLM-based multi-agent frameworks,…

Multiagent Systems · Computer Science 2026-03-27 Weiwei Fang , Lin Li , Kaize Shi , Yu Yang , Jianwei Zhang

Recent advances in large language model (LLM) have empowered autonomous agents to perform multi-turn interactions with tools and environments. However, scaling such agent training is limited by the lack of diverse and reliable environments.…

Artificial Intelligence · Computer Science 2026-05-26 Zhaoyang Wang , Canwen Xu , Boyi Liu , Yite Wang , Siwei Han , Zhewei Yao , Huaxiu Yao , Yuxiong He

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

Robotics · Computer Science 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin

Several researchers have focused on studying driver cognitive behavior and mental load for in-vehicle interaction while driving. Adaptive interfaces that vary with mental and perceptual load levels could help in reducing accidents and…

Human-Computer Interaction · Computer Science 2022-09-30 Amr Gomaa , Alexandra Alles , Elena Meiser , Lydia Helene Rupp , Marco Molz , Guillermo Reyes

Model-based reinforcement learning (MBRL) has achieved remarkable success in robotics due to its high sample efficiency and planning capability. However, extending MBRL to physical multi-robot cooperation remains challenging due to the…

Robotics · Computer Science 2026-04-07 Zijie Zhao , Honglei Guo , Shengqian Chen , Kaixuan Xu , Bo Jiang , Yuanheng Zhu , Dongbin Zhao

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Multi-robot systems hold significant promise for social environments such as homes and hospitals, yet existing multi-robot works treat robots as functionally identical, overlooking how robots individual identity shape user perception and…

Robotics · Computer Science 2026-04-15 Shaid Hasan , Breenice Lee , Sujan Sarker , Tariq Iqbal

Maintaining situational awareness (SA) is critical in human-robot teams. Yet, under high workload and dynamic conditions, operators often experience SA gaps. Automated detection of SA gaps could provide timely assistance for operators.…

Virtual reality has proved to be useful in applications in several fields ranging from gaming, medicine, and training to development of interfaces that enable human-robot collaboration. It empowers designers to explore applications outside…

Human-Computer Interaction · Computer Science 2023-07-24 Debasmita Mukherjee , Ritwik Singhai , Homayoun Najjaran

Operationalizing AI has become a major endeavor in both research and industry. Automated, operationalized pipelines that manage the AI application lifecycle will form a significant part of tomorrow's infrastructure workloads. To optimize…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-24 Thomas Rausch , Waldemar Hummer , Vinod Muthusamy