English
Related papers

Related papers: AUTOVR: Automated UI Exploration for Detecting Sen…

200 papers

Given the rapid advance in ITS technologies, future mobility is pointing to vehicular autonomy. However, there is still a long way before full automation, and human intervention is required. This work sheds light on understanding human…

Human-Computer Interaction · Computer Science 2023-12-05 Zheng Xu

Recent research has increasingly focused on how autonomous vehicles (AVs) communicate with pedestrians in complex traffic situations involving multiple vehicles and pedestrians. VR is emerging as an effective tool to simulate these…

Human-Computer Interaction · Computer Science 2024-10-22 Tram Thi Minh Tran , Callum Parker

Virtual reality (VR) platforms enable a wide range of applications, however, pose unique privacy risks. In particular, VR devices are equipped with a rich set of sensors that collect personal and sensitive information (e.g., body motion,…

Human-Computer Interaction · Computer Science 2024-09-24 Ismat Jarin , Yu Duan , Rahmadi Trimananda , Hao Cui , Salma Elmalaki , Athina Markopoulou

Evaluating and ensuring the adversarial robustness of autonomous driving (AD) systems is a critical and unresolved challenge. This paper introduces MetAdv, a novel adversarial testing platform that enables realistic, dynamic, and…

The Graphical User Interface (GUI) is how users interact with mobile apps. To ensure it functions properly, testing engineers have to make sure it functions as intended, based on test requirements that are typically written in natural…

Software Engineering · Computer Science 2024-07-15 Yongxiang Hu , Xuan Wang , Yingchuan Wang , Yu Zhang , Shiyu Guo , Chaoyi Chen , Xin Wang , Yangfan Zhou

Over the past decade, AR/VR devices have drastically changed how we interact with the digital world. Users often share sensitive information, such as their location, browsing history, and even financial data, within third-party apps…

Cryptography and Security · Computer Science 2025-09-16 Seonghun Son , Chandrika Mukherjee , Reham Mohamed Aburas , Berk Gulmezoglu , Z. Berkay Celik

Advancements in heterogeneous computing technologies enable the significant potential of virtual reality (VR) applications. To offer the best user experience (UX), a system should adopt an untethered, wireless-network-based architecture to…

Networking and Internet Architecture · Computer Science 2021-01-20 Alec Rohloff , Zackary Allen , Kung-Min Lin , Joshua Okrend , Chengyi Nie , Yu-Chia Liu , Hung-Wei Tseng

Autonomous agents capable of navigating Graphical User Interfaces (GUIs) hold the potential to revolutionize digital productivity. However, achieving true digital autonomy extends beyond reactive element matching; it necessitates a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hongxin Li , Xiping Wang , Jingran Su , Zheng Ju , Yuntao Chen , Qing Li , Zhaoxiang Zhang

Autonomous GUI agents based on vision-language models (VLMs) often assume deterministic environment responses, generating actions without verifying whether previous operations succeeded. In real-world settings with network latency,…

Computation and Language · Computer Science 2026-04-08 Yuzhe Zhang , Xianwei Xue , Xingyong Wu , Mengke Chen , Chen Liu , Xinran He , Run Shao , Feiran Liu , Huanmin Xu , Qiutong Pan , Haiwei Wang

Due to the importance of Android app quality assurance, many automated GUI testing tools have been developed. Although the test algorithms have been improved, the impact of GUI rendering has been overlooked. On the one hand, setting a long…

Software Engineering · Computer Science 2023-02-28 Sidong Feng , Mulong Xie , Chunyang Chen

Virtual reality (VR) platforms and apps collect user sensor data, including motion, facial, eye, and hand data, in abstracted form. These data may expose users to unique privacy risks without their knowledge or meaningful awareness, yet the…

Cryptography and Security · Computer Science 2026-01-21 Ismat Jarin , Olivia Figueira , Yu Duan , Tu Le , Athina Markopoulou

Mobile applications increasingly rely on sensor data to infer user context and deliver personalized experiences. Yet the mechanisms behind this personalization remain opaque to users and researchers alike. This paper presents a sandbox…

Human-Computer Interaction · Computer Science 2025-11-04 Ibrahim Khalilov , Chaoran Chen , Ziang Xiao , Tianshi Li , Toby Jia-Jun Li , Yaxing Yao

GUI testing is significant in the SE community. Most existing frameworks are intrusive and only support some specific platforms. With the development of distinct scenarios, diverse embedded systems or customized operating systems on…

Software Engineering · Computer Science 2023-12-19 Shengcheng Yu , Chunrong Fang , Mingzhe Du , Yuchen Ling , Zhenyu Chen , Zhendong Su

The use of Immersive Technologies has shown its potential to revolutionize many sectors such as health, entertainment, education, and industrial sectors. Immersive technologies such as Virtual Reality (VR), Augmented reality (AR), and Mixed…

Cryptography and Security · Computer Science 2025-10-21 Keshav Sood , Sanjay Selvaraj , Youyang Qu

Urban design is a highly visual discipline that requires visualization for informed decision making. However, traditional urban design tools are mostly limited to representations on 2D displays that lack intuitive awareness. The popularity…

Human-Computer Interaction · Computer Science 2021-09-14 Chi Zhang , Wei Zeng , Ligang Liu

Mobile agents can autonomously complete user-assigned tasks through GUI interactions. However, existing mainstream evaluation benchmarks, such as AndroidWorld, operate by connecting to a system-level Android emulator and provide evaluation…

Artificial Intelligence · Computer Science 2026-04-14 Yunfei Feng , Xi Zhao , Cheng Zhang , Dahu Feng , Daolin Cheng , Jianqi Yu , Yubin Xia , Erhu Feng

Various industries have widely adopted Virtual Reality (VR) and Augmented Reality (AR) technologies to enhance productivity and user experiences. However, their integration introduces significant security challenges. This systematic…

Cryptography and Security · Computer Science 2024-07-24 Sarina Dastgerdy

With the proliferation of consumer virtual reality (VR) headsets and creative tools, content creators have started to experiment with new forms of interactive audience experience using immersive media. Understanding user attention and…

Human-Computer Interaction · Computer Science 2020-05-21 Mu Mu , Murtada Dohan , Alison Goodyear , Gary Hill , Cleyon Johns , Andreas Mauthe

Recent advancements in GUI agents have significantly expanded their ability to interpret natural language commands to manage software interfaces. However, acquiring GUI data remains a significant challenge. Existing methods often involve…

Artificial Intelligence · Computer Science 2025-11-11 Xiangwu Guo , Difei Gao , Mike Zheng Shou

GUI-based models extracted from Android app execution traces, events, or source code can be extremely useful for challenging tasks such as the generation of scenarios or test cases. However, extracting effective models can be an expensive…

Software Engineering · Computer Science 2018-01-22 Mario Linares-Vasquez , Martin White , Carlos Bernal-Cardenas , Kevin Moran , Denys Poshyvanyk