English
Related papers

Related papers: A Full Body Avatar-Based Telepresence System for D…

200 papers

The realism of digital avatars is crucial in enabling telepresence applications with self-expression and customization. While physical simulations can produce realistic motions for clothed humans, they require high-quality garment assets…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yifei Li , Hsiao-yu Chen , Egor Larionov , Nikolaos Sarafianos , Wojciech Matusik , Tuur Stuyck

Remote telepresence via next-generation mixed reality platforms can provide higher levels of immersion for computer-mediated communications, allowing participants to engage in a wide spectrum of activities, previously not possible in 2D…

Human-Computer Interaction · Computer Science 2022-04-04 Mohammad Keshavarzi , Michael Zollhoefer , Allen Y. Yang , Patrick Peluse , Luisa Caldas

Alignment between real and virtual objects is a challenging task required for the deployment of Mixed Reality (MR) into manufacturing, medical, and construction applications. To face this challenge, a series of methods have been proposed.…

Human-Computer Interaction · Computer Science 2022-11-17 Alejandro Martin-Gomez , Alexander Winkler , Rafael de la Tijera Obert , Javad Fotouhi , Daniel Roth , Ulrich Eck , Nassir Navab

Interaction with the physical environment and different users is essential to foster a collaborative experience. For this, we propose an interaction based on a central point represented by an Augmented Reality marker in which several users…

Human-Computer Interaction · Computer Science 2023-01-09 Bianca Marques , Rui Nóbrega , Carmen Morgado

We present the design of a mixed reality (MR) telehealth training system that aims to close the gap between in-person and distance training and re-training for medical procedures. Our system uses real-time volumetric capture as a means for…

Human-Computer Interaction · Computer Science 2023-12-18 Manuel Rebol , Krzysztof Pietroszek , Claudia Ranniger , Colton Hood , Adam Rutenberg , Neal Sikka , Christian Guetl

We present a volumetric communication system that is designed for remote assistance of procedural tasks. The system allows a remote expert to visually guide a local operator. The two parties share a view that is spatially identical, but for…

Human-Computer Interaction · Computer Science 2022-08-08 Manuel Rebol , Colton Hood , Claudia Ranniger , Adam Rutenberg , Neal Sikka , Erin Maria Horan , Christian Gütl , Krzysztof Pietroszek

VR telepresence consists of interacting with another human in a virtual space represented by an avatar. Today most avatars are cartoon-like, but soon the technology will allow video-realistic ones. This paper aims in this direction and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Hang Chu , Shugao Ma , Fernando De la Torre , Sanja Fidler , Yaser Sheikh

Today there is a high variety of haptic devices capable of providing tactile feedback. Although most of existing designs are aimed at realistic simulation of the surface properties, their capabilities are limited in attempts of displaying…

Robotics · Computer Science 2021-04-20 Aleksey Fedoseev , Nikita Chernyadev , Dzmitry Tsetserukou

Augmented Reality (AR) teleconferencing allows separately located users to interact with each other in 3D through agents in their own physical environments. Existing methods leveraging volumetric capturing and reconstruction can provide a…

Human-Computer Interaction · Computer Science 2024-01-05 Xuanyu Wang , Weizhan Zhang , Christian Sandor , Hongbo Fu

We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Kaiyue Shen , Chen Guo , Manuel Kaufmann , Juan Jose Zarate , Julien Valentin , Jie Song , Otmar Hilliges

Immersive telepresence aims to transform human interaction in AR/VR applications by enabling lifelike full-body holographic representations for enhanced remote collaboration. However, existing systems rely on hardware-intensive multi-camera…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Fangyu Lin , Yingdong Hu , Zhening Liu , Yufan Zhuang , Zehong Lin , Jun Zhang

We present Better Together, a method that simultaneously solves the human pose estimation problem while reconstructing a photorealistic 3D human avatar from multi-view videos. While prior art usually solves these problems separately, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Arthur Moreau , Mohammed Brahimi , Richard Shaw , Athanasios Papaioannou , Thomas Tanay , Zhensong Zhang , Eduardo Pérez-Pellitero

Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset and controllers,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Daniele Reda , Jungdam Won , Yuting Ye , Michiel van de Panne , Alexander Winkler

Photorealistic 3D avatar generation has rapidly improved in recent years, and realistic avatars that match a user's true appearance are more feasible in Mixed Reality (MR) than ever before. Yet, there are known risks to sharing one's…

Human-Computer Interaction · Computer Science 2025-07-31 Ethan Wilson , Vincent Bindschaedler , Sophie Jörg , Sean Sheikholeslam , Kevin Butler , Eakta Jain

Immersive VR telepresence ideally means being able to interact and communicate with digital avatars that are indistinguishable from and precisely reflect the behaviour of their real counterparts. The core technical challenge is two fold:…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jianchun Chen , Jian Wang , Yinda Zhang , Rohit Pandey , Thabo Beeler , Marc Habermann , Christian Theobalt

Immersive Virtual Reality typically requires a head-mounted display (HMD) to visualize the environment and hand-held controllers to interact with the virtual objects. Recently, many applications display full-body avatars to represent the…

Human-Computer Interaction · Computer Science 2024-07-12 Jose Luis Ponton , Reza Keshavarz , Alejandro Beacco , Nuria Pelechano

Robotic avatar systems can enable immersive telepresence with locomotion, manipulation, and communication capabilities. We present such an avatar system, based on the key components of immersive 3D visualization and transparent…

In the era of the metaverse, self-avatars are gaining popularity, as they can enhance presence and provide embodiment when a user is immersed in Virtual Reality. They are also very important in collaborative Virtual Reality to improve…

Human-Computer Interaction · Computer Science 2023-07-20 Jose Luis Ponton , Víctor Ceballos , Lesly Acosta , Alejandro Ríos , Eva Monclús , Nuria Pelechano

Robotic teleoperation is a key technology for a wide variety of applications. It allows sending robots instead of humans in remote, possibly dangerous locations while still using the human brain with its enormous knowledge and creativity,…

Robotics · Computer Science 2023-01-03 Christian Lenz , Sven Behnke

Using a robotic platform for telepresence applications has gained paramount importance in this decade. Scenarios such as remote meetings, group discussions, and presentations/talks in seminars and conferences get much attention in this…