English
Related papers

Related papers: Side-channel Inference of User Activities in AR/VR…

200 papers

The drive to create thinner, lighter, and more energy efficient devices has resulted in modern SoCs being forced to balance a delicate tradeoff between power consumption, heat dissipation, and execution speed (i.e., frequency). While…

Cryptography and Security · Computer Science 2023-05-23 Hritvik Taneja , Jason Kim , Jie Jeff Xu , Stephan van Schaik , Daniel Genkin , Yuval Yarom

One of the main challenges of social interaction in virtual reality settings is that head-mounted displays occlude a large portion of the face, blocking facial expressions and thereby restricting social engagement cues among users. Hence,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Steven Hickson , Nick Dufour , Avneesh Sud , Vivek Kwatra , Irfan Essa

With built-in eye-tracking cameras, the recently released Apple Vision Pro (AVP) mixed reality (MR) headset features gaze-based interaction, eye image rendering on external screens, and iris recognition for device unlocking. One of the…

Human-Computer Interaction · Computer Science 2024-08-15 Zehao Huang , Gancheng Zhu , Xiaoting Duan , Rong Wang , Yongkai Li , Shuai Zhang , Zhiguo Wang

Over the past years, literature has shown that attacks exploiting the microarchitecture of modern processors pose a serious threat to the privacy of mobile phone users. This is because applications leave distinct footprints in the…

Cryptography and Security · Computer Science 2020-07-09 Berk Gulmezoglu , Andreas Zankl , M. Caner Tol , Saad Islam , Thomas Eisenbarth , Berk Sunar

The concept of an intelligent augmented reality (AR) assistant has significant, wide-ranging applications, with potential uses in medicine, military, and mechanics domains. Such an assistant must be able to perceive the environment and…

Extended reality (XR) devices have become ubiquitous. They are equipped with arrays of sensors, collecting extensive user and environmental data, allowing inferences about sensitive user information users may not realize they are sharing.…

Human-Computer Interaction · Computer Science 2025-03-17 Viktorija Paneva , Verena Winterhalter , Naga Sai Surya Vamsy Malladi , Marvin Strauss , Stefan Schneegass , Florian Alt

The advent and growing popularity of Virtual Reality (VR) and Mixed Reality (MR) solutions have revolutionized the way we interact with digital platforms. The cutting-edge gaze-controlled typing methods, now prevalent in high-end models of…

Human-Computer Interaction · Computer Science 2024-09-13 Hanqiu Wang , Zihao Zhan , Haoqi Shan , Siqi Dai , Max Panoff , Shuo Wang

Facial motion capture in mixed reality headsets enables real-time avatar animation, allowing users to convey non-verbal cues during virtual interactions. However, as facial motion data constitutes a behavioral biometric, its use raises…

Cryptography and Security · Computer Science 2025-07-16 Adriano Castro , Simon Hanisch , Matin Fallahi , Thorsten Strufe

Current Virtual Reality (VR) input devices make it possible to navigate a virtual environment and record immersive, personalized data regarding the user's movement and specific behavioral habits, which brings the question of the user's…

Human-Computer Interaction · Computer Science 2023-02-07 Aryabrata Basu , Mohammad Jahed Murad Sunny , Jayasri Sai Nikitha Guthula

Virtual Reality (VR) technologies are increasingly employed in numerous applications across various areas. Therefore, it is essential to ensure the security of interactions between users and VR devices. In this paper, we disclose a new…

Cryptography and Security · Computer Science 2024-12-20 Tao Ni , Yuefeng Du , Qingchuan Zhao , Cong Wang

Due to the openness of the wireless medium, smartphone users are susceptible to user privacy attacks, where user privacy information is inferred from encrypted Wi-Fi wireless traffic. Existing attacks are limited to recognizing mobile apps…

Cryptography and Security · Computer Science 2025-11-06 Yong Huang , Zhibo Dong , Xiaoguang Yang , Dalong Zhang , Qingxian Wang , Zhihua Wang

The quality of Virtual Reality (VR) apps is vital, particularly the rendering quality of the VR Graphical User Interface (GUI). Different from traditional 2D apps, VR apps create a 3D digital scene for users, by rendering two distinct 2D…

Software Engineering · Computer Science 2024-10-30 Shuqing Li , Cuiyun Gao , Jianping Zhang , Yujia Zhang , Yepang Liu , Jiazhen Gu , Yun Peng , Michael R. Lyu

Users readily embrace the rapid advancements in virtual reality (VR) technology within various everyday contexts, such as gaming, social interactions, shopping, and commerce. In order to facilitate transactions and payments, VR systems…

Cryptography and Security · Computer Science 2023-06-06 Jingjie Li , Sunpreet Singh Arora , Kassem Fawaz , Younghyun Kim , Can Liu , Sebastian Meiser , Mohsen Minaei , Maliheh Shirvanian , Kim Wagner

3D video avatars can empower virtual communications by providing compression, privacy, entertainment, and a sense of presence in AR/VR. Best 3D photo-realistic AR/VR avatars driven by video, that can minimize uncanny effects, rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Lele Chen , Chen Cao , Fernando De la Torre , Jason Saragih , Chenliang Xu , Yaser Sheikh

With the development of virtualization and AI, real-time facial avatar animation is widely used in entertainment, office, business and other fields. Against this background, blendshapes have become a common industry animation solution…

Graphics · Computer Science 2026-01-14 Shuxian Li , Tianyue Wang , Chris Twombly

Gaze-tracking is a novel way of interacting with computers which allows new scenarios, such as enabling people with motor-neuron disabilities to control their computers or doctors to interact with patient information without touching screen…

Artificial Intelligence · Computer Science 2020-10-13 Jatin Sharma , Jon Campbell , Pete Ansell , Jay Beavers , Christopher O'Dowd

Integrated VR (IVR) systems consist of a head-mounted display (HMD) and body-tracking capabilities. They enable users to translate their physical movements into corresponding avatar movements in real-time, allowing them to perceive their…

Human-Computer Interaction · Computer Science 2026-01-15 Marie Luisa Fiedler , Christian Merz , Jonathan Tschanter , Carolin Wienrich , Marc Erich Latoschik

This work investigates how to monitor access to Android zero-permission sensors which could cause privacy leakage to users. Moreover, monitoring such sensitive access allows security researchers to characterize potential sensor abuse…

Cryptography and Security · Computer Science 2025-07-04 Yan Long , Jiancong Cui , Yuqing Yang , Tobias Alam , Zhiqiang Lin , Kevin Fu

With developments in computer graphics, hardware technology, perception engineering, and human-computer interaction, virtual reality and virtual environments are becoming more integrated into our daily lives. Head-mounted displays, however,…

Human-Computer Interaction · Computer Science 2022-03-30 Efe Bozkir

Video anomaly detection (VAD) systems often prioritize accuracy while overlooking privacy concerns, limiting their suitability for real-world deployment. We propose the Orthogonal Projection Layer (OPL), a lightweight module that removes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lei Wang , Wenxiang Diao , Andrew Busch , Jun Zhou , Yongsheng Gao