中文
相关论文

相关论文: AUTOVR: Automated UI Exploration for Detecting Sen…

200 篇论文

Given the rapid advance in ITS technologies, future mobility is pointing to vehicular autonomy. However, there is still a long way before full automation, and human intervention is required. This work sheds light on understanding human…

人机交互 · 计算机科学 2023-12-05 Zheng Xu

Recent research has increasingly focused on how autonomous vehicles (AVs) communicate with pedestrians in complex traffic situations involving multiple vehicles and pedestrians. VR is emerging as an effective tool to simulate these…

人机交互 · 计算机科学 2024-10-22 Tram Thi Minh Tran , Callum Parker

Virtual reality (VR) platforms enable a wide range of applications, however, pose unique privacy risks. In particular, VR devices are equipped with a rich set of sensors that collect personal and sensitive information (e.g., body motion,…

人机交互 · 计算机科学 2024-09-24 Ismat Jarin , Yu Duan , Rahmadi Trimananda , Hao Cui , Salma Elmalaki , Athina Markopoulou

Evaluating and ensuring the adversarial robustness of autonomous driving (AD) systems is a critical and unresolved challenge. This paper introduces MetAdv, a novel adversarial testing platform that enables realistic, dynamic, and…

机器人学 · 计算机科学 2025-11-05 Aishan Liu , Jiakai Wang , Tianyuan Zhang , Hainan Li , Jiangfan Liu , Siyuan Liang , Yilong Ren , Xianglong Liu , Dacheng Tao

The Graphical User Interface (GUI) is how users interact with mobile apps. To ensure it functions properly, testing engineers have to make sure it functions as intended, based on test requirements that are typically written in natural…

软件工程 · 计算机科学 2024-07-15 Yongxiang Hu , Xuan Wang , Yingchuan Wang , Yu Zhang , Shiyu Guo , Chaoyi Chen , Xin Wang , Yangfan Zhou

Over the past decade, AR/VR devices have drastically changed how we interact with the digital world. Users often share sensitive information, such as their location, browsing history, and even financial data, within third-party apps…

密码学与安全 · 计算机科学 2025-09-16 Seonghun Son , Chandrika Mukherjee , Reham Mohamed Aburas , Berk Gulmezoglu , Z. Berkay Celik

Advancements in heterogeneous computing technologies enable the significant potential of virtual reality (VR) applications. To offer the best user experience (UX), a system should adopt an untethered, wireless-network-based architecture to…

网络与互联网体系结构 · 计算机科学 2021-01-20 Alec Rohloff , Zackary Allen , Kung-Min Lin , Joshua Okrend , Chengyi Nie , Yu-Chia Liu , Hung-Wei Tseng

Autonomous agents capable of navigating Graphical User Interfaces (GUIs) hold the potential to revolutionize digital productivity. However, achieving true digital autonomy extends beyond reactive element matching; it necessitates a…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Hongxin Li , Xiping Wang , Jingran Su , Zheng Ju , Yuntao Chen , Qing Li , Zhaoxiang Zhang

Autonomous GUI agents based on vision-language models (VLMs) often assume deterministic environment responses, generating actions without verifying whether previous operations succeeded. In real-world settings with network latency,…

计算与语言 · 计算机科学 2026-04-08 Yuzhe Zhang , Xianwei Xue , Xingyong Wu , Mengke Chen , Chen Liu , Xinran He , Run Shao , Feiran Liu , Huanmin Xu , Qiutong Pan , Haiwei Wang

Due to the importance of Android app quality assurance, many automated GUI testing tools have been developed. Although the test algorithms have been improved, the impact of GUI rendering has been overlooked. On the one hand, setting a long…

软件工程 · 计算机科学 2023-02-28 Sidong Feng , Mulong Xie , Chunyang Chen

Virtual reality (VR) platforms and apps collect user sensor data, including motion, facial, eye, and hand data, in abstracted form. These data may expose users to unique privacy risks without their knowledge or meaningful awareness, yet the…

密码学与安全 · 计算机科学 2026-01-21 Ismat Jarin , Olivia Figueira , Yu Duan , Tu Le , Athina Markopoulou

Mobile applications increasingly rely on sensor data to infer user context and deliver personalized experiences. Yet the mechanisms behind this personalization remain opaque to users and researchers alike. This paper presents a sandbox…

人机交互 · 计算机科学 2025-11-04 Ibrahim Khalilov , Chaoran Chen , Ziang Xiao , Tianshi Li , Toby Jia-Jun Li , Yaxing Yao

GUI testing is significant in the SE community. Most existing frameworks are intrusive and only support some specific platforms. With the development of distinct scenarios, diverse embedded systems or customized operating systems on…

软件工程 · 计算机科学 2023-12-19 Shengcheng Yu , Chunrong Fang , Mingzhe Du , Yuchen Ling , Zhenyu Chen , Zhendong Su

The use of Immersive Technologies has shown its potential to revolutionize many sectors such as health, entertainment, education, and industrial sectors. Immersive technologies such as Virtual Reality (VR), Augmented reality (AR), and Mixed…

密码学与安全 · 计算机科学 2025-10-21 Keshav Sood , Sanjay Selvaraj , Youyang Qu

Urban design is a highly visual discipline that requires visualization for informed decision making. However, traditional urban design tools are mostly limited to representations on 2D displays that lack intuitive awareness. The popularity…

人机交互 · 计算机科学 2021-09-14 Chi Zhang , Wei Zeng , Ligang Liu

Mobile agents can autonomously complete user-assigned tasks through GUI interactions. However, existing mainstream evaluation benchmarks, such as AndroidWorld, operate by connecting to a system-level Android emulator and provide evaluation…

人工智能 · 计算机科学 2026-04-14 Yunfei Feng , Xi Zhao , Cheng Zhang , Dahu Feng , Daolin Cheng , Jianqi Yu , Yubin Xia , Erhu Feng

Various industries have widely adopted Virtual Reality (VR) and Augmented Reality (AR) technologies to enhance productivity and user experiences. However, their integration introduces significant security challenges. This systematic…

密码学与安全 · 计算机科学 2024-07-24 Sarina Dastgerdy

With the proliferation of consumer virtual reality (VR) headsets and creative tools, content creators have started to experiment with new forms of interactive audience experience using immersive media. Understanding user attention and…

人机交互 · 计算机科学 2020-05-21 Mu Mu , Murtada Dohan , Alison Goodyear , Gary Hill , Cleyon Johns , Andreas Mauthe

Recent advancements in GUI agents have significantly expanded their ability to interpret natural language commands to manage software interfaces. However, acquiring GUI data remains a significant challenge. Existing methods often involve…

人工智能 · 计算机科学 2025-11-11 Xiangwu Guo , Difei Gao , Mike Zheng Shou

GUI-based models extracted from Android app execution traces, events, or source code can be extremely useful for challenging tasks such as the generation of scenarios or test cases. However, extracting effective models can be an expensive…

软件工程 · 计算机科学 2018-01-22 Mario Linares-Vasquez , Martin White , Carlos Bernal-Cardenas , Kevin Moran , Denys Poshyvanyk