English

WOC: A Handy Webcam-based 3D Online Chatroom

Human-Computer Interaction 2023-03-20 v2 Computer Vision and Pattern Recognition
Authors: Chuanhang Yan , Yu Sun , Qian Bao , Jinhui Pang , Wu Liu , Tao Mei
View on arXiv ↗ PDF ↗ DOI ↗

Abstract

We develop WOC, a webcam-based 3D virtual online chatroom for multi-person interaction, which captures the 3D motion of users and drives their individual 3D virtual avatars in real-time. Compared to the existing wearable equipment-based solution, WOC offers convenient and low-cost 3D motion capture with a single camera. To promote the immersive chat experience, WOC provides high-fidelity virtual avatar manipulation, which also supports the user-defined characters. With the distributed data flow service, the system delivers highly synchronized motion and voice for all users. Deployed on the website and no installation required, users can freely experience the virtual online chat at https://yanch.cloud.

Cite

@article{arxiv.2209.00776,
  title  = {WOC: A Handy Webcam-based 3D Online Chatroom},
  author = {Chuanhang Yan and Yu Sun and Qian Bao and Jinhui Pang and Wu Liu and Tao Mei},
  journal= {arXiv preprint arXiv:2209.00776},
  year   = {2023}
}

Related papers

View all related →
Computer Vision and Pattern Recognition · Computer Science
ICo3D: An Interactive Conversational 3D Virtual Human
Richard Shaw, Youngkyoon Jang, Athanasios Papaioannou, Arthur Moreau +3
2026-01-21
Computer Vision and Pattern Recognition · Computer Science
OOD-HOI: Text-Driven 3D Whole-Body Human-Object Interactions Generation Beyond Training Domains
Yixuan Zhang, Hui Yang, Chuanchen Luo, Junran Peng +2
2024-12-02
Human-Computer Interaction · Computer Science
AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning
Chanhyuk Park, Jungbin Cho, Junwan Kim, Seongmin Lee +2
2024-09-04
Computer Vision and Pattern Recognition · Computer Science
TrackOcc: Camera-based 4D Panoptic Occupancy Tracking
Zhuoguang Chen, Kenan Li, Xiuyu Yang, Tao Jiang +2
2025-03-12
Human-Computer Interaction · Computer Science
3DTouch: Towards a Wearable 3D Input Device for 3D Applications
Anh Nguyen
2017-06-02
Computer Vision and Pattern Recognition · Computer Science
MetaOcc: Spatio-Temporal Fusion of Surround-View 4D Radar and Camera for 3D Occupancy Prediction with Dual Training Strategies
Long Yang, Lianqing Zheng, Wenjin Ai, Minghao Liu +7
2025-08-11
Computer Vision and Pattern Recognition · Computer Science
VirtualCube: An Immersive 3D Video Communication System
Yizhong Zhang, Jiaolong Yang, Zhen Liu, Ruicheng Wang +3
2021-12-30
Human-Computer Interaction · Computer Science
3DTouch: A wearable 3D input device with an optical sensor and a 9-DOF inertial measurement unit
Anh Nguyen, Amy Banic
2015-07-20
Image and Video Processing · Electrical Eng. & Systems
Optical Camera Communications: Survey, Use Cases, Challenges, and Future Trends
Nasir Saeed, Shuaishuai Guo, Ki-Hong Park, Tareq Y. Al-Naffouri +1
2019-10-17
Networking and Internet Architecture · Computer Science
OCC: Physical-Layer Assisted Congestion Control for Real-Time Communications
Yufan Zhuang, Zili Meng, Zehong Lin, Jun Zhang
2026-04-27
Networking and Internet Architecture · Computer Science
WoT Store: a Thing and Application Management Ecosystem for the W3C Web of Things
Luca Sciullo, Cristiano Aguzzi, Lorenzo Gigli, Luca Roffia +3
2019-11-18
Multimedia · Computer Science
Cloud Rendering-based Volumetric Video Streaming System for Mixed Reality Services
Serhan Gül, Dimitri Podborski, Jangwoo Son, Gurdeep Singh Bhullar +3
2020-07-17
Computer Vision and Pattern Recognition · Computer Science
SA-Occ: Satellite-Assisted 3D Occupancy Prediction in Real World
Chen Chen, Zhirui Wang, Taowei Sheng, Yi Jiang +7
2025-03-21
Human-Computer Interaction · Computer Science
Nods of Agreement: Webcam-Driven Avatars Improve Meeting Outcomes and Avatar Satisfaction Over Audio-Driven or Static Avatars in All-Avatar Work Videoconferencing
Fang Ma, Ju Zhang, Lev Tankelevitch, Payod Panda +8
2025-01-20
Human-Computer Interaction · Computer Science
The Configuration of Space: Probing the Way Social Interaction and Perception are Affected by Task-Specific Spatial Representations in Online Video Communication
Yihuan Chen, Kexue Fu, Qianyi Chen, Zhicong Lu +1
2026-02-16
Computer Vision and Pattern Recognition · Computer Science
ChatCam: Empowering Camera Control through Conversational AI
Xinhang Liu, Yu-Wing Tai, Chi-Keung Tang
2024-09-27
Computer Vision and Pattern Recognition · Computer Science
HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidance
Soshi Shimada, Vladislav Golyanik, Zhi Li, Patrick Pérez +2
2022-07-27
Computer Vision and Pattern Recognition · Computer Science
Audio- and Gaze-driven Facial Animation of Codec Avatars
Alexander Richard, Colin Lea, Shugao Ma, Juergen Gall +2
2020-08-13
Computer Vision and Pattern Recognition · Computer Science
HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data
Mengqi Zhang, Yang Fu, Zheng Ding, Sifei Liu +2
2024-03-19
Human-Computer Interaction · Computer Science
ECHO: An Open Research Platform for Evaluation of Chat, Human Behavior, and Outcomes
Jiqun Liu, Nischal Dinesh, Ran Yu
2026-02-12
Computer Vision and Pattern Recognition · Computer Science
VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understanding
Ruoyu Wang, Yong Liu, Sheng Tao, Yuhang Lin +1
2026-05-29
Computer Vision and Pattern Recognition · Computer Science
SHOW3D: Capturing Scenes of 3D Hands and Objects in the Wild
Patrick Rim, Kevin Harris, Braden Copple, Shangchen Han +7
2026-03-31
Human-Computer Interaction · Computer Science
WoW -- A System for Self-Service Collaborative Design Workshops
Ilyasse Belkacem, Vasile Ciorna, Frank Petry, Mohammad Ghoniem
2024-08-20
Multimedia · Computer Science
Multi-party Holomeetings: Toward a New Era of Low-Cost Volumetric Holographic Meetings in Virtual Reality
Sergi Fernández, Mario Montagud, Gianluca Cernigliaro, David Rincón
2022-06-14
Audio and Speech Processing · Electrical Eng. & Systems
Multimodal active speaker detection and virtual cinematography for video conferencing
Ross Cutler, Ramin Mehran, Sam Johnson, Cha Zhang +3
2022-05-26
R2 v1 2026-06-28T00:36:26.957Z