English
Related papers

Related papers: AURORA: Navigating UI Tarpits via Automated Neural…

200 papers

Scientists and science journalists, among others, often need to make sense of a large number of papers and how they compare with each other in scope, focus, findings, or any other important factors. However, with a large corpus of papers,…

Human-Computer Interaction · Computer Science 2023-03-14 Joyce Zhou , Elena Glassman , Daniel S. Weld

Inertial measurement units (IMUs), have been prevalently used in a wide range of mobile perception applications such as activity recognition and user authentication, where a large amount of labelled data are normally required to train a…

Machine Learning · Computer Science 2025-12-02 Yunzhe Li , Facheng Hu , Hongzi Zhu , Shifan Zhang , Liang Zhang , Shan Chang , Minyi Guo

Recent object detection approaches rely on pretrained vision-language models for image-text alignment. However, they fail to detect the Mobile User Interface (MUI) element since it contains additional OCR information, which describes its…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhangxuan Gu , Zhuoer Xu , Haoxing Chen , Jun Lan , Changhua Meng , Weiqiang Wang

Conventional online surveys provide limited personalization, often resulting in low engagement and superficial responses. Although AI survey chatbots improve convenience, most are still reactive: they rely on fixed dialogue trees or static…

Human-Computer Interaction · Computer Science 2025-11-10 Jinwen Tang , Yi Shang

The objective of the image inpainting task is to fill missing regions of an image in a visually plausible way. Recently, deep-learning-based image inpainting networks have generated outstanding results, and some utilize their models as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Changsuk Oh , H. Jin Kim

Autonomous navigation in maritime domains is accelerating alongside advances in artificial intelligence, sensing, and connectivity. Opaque decision-making and poorly calibrated human-automation interaction remain key barriers to safe…

Human-Computer Interaction · Computer Science 2025-09-22 Zhuoyue Zhang , Haitong Xu

Mobile graphical user interface (GUI) agents are designed to automate everyday tasks on smartphones. Recent advances in large language models (LLMs) have significantly enhanced the capabilities of mobile GUI agents. However, most…

Human-Computer Interaction · Computer Science 2026-01-27 Mingxian Yu , Siqi Luo , Xu Chen

Recent advancements in artificial intelligence (AI) and its widespread integration into mobile software applications have received significant attention, highlighting the growing prominence of AI capabilities in modern software systems.…

Software Engineering · Computer Science 2025-12-01 Pei Liu , Terry Zhuo , Jiawei Deng , Thong James , Shidong Pan , Sherry Xu , Zhenchang Xing , Qinghua Lu , Xiaoning Du , Hongyu Zhang

Desktop accessibility metadata enables AI agents to interpret screens and supports users who depend on tools like screen readers. Yet, many applications remain largely inaccessible due to incomplete or missing metadata provided by…

Machine Learning · Computer Science 2025-07-23 Viktor Muryn , Marta Sumyk , Mariya Hirna , Sofiya Garkot , Maksym Shamrai

This work investigates how to monitor access to Android zero-permission sensors which could cause privacy leakage to users. Moreover, monitoring such sensitive access allows security researchers to characterize potential sensor abuse…

Cryptography and Security · Computer Science 2025-07-04 Yan Long , Jiancong Cui , Yuqing Yang , Tobias Alam , Zhiqiang Lin , Kevin Fu

A major challenge with off-road autonomous navigation is the lack of maps or road markings that can be used to plan a path for autonomous robots. Classical path planning methods mostly assume a perfectly known environment without accounting…

Robotics · Computer Science 2023-09-19 Charles Moore , Shaswata Mitra , Nisha Pillai , Marc Moore , Sudip Mittal , Cindy Bethel , Jingdao Chen

Systematic Literature Reviews (SLRs) are fundamental to scientific progress, yet the process is hindered by a fragmented tool ecosystem that imposes a high cognitive load. This friction suppresses the iterative, exploratory nature of…

Human-Computer Interaction · Computer Science 2026-03-13 Runlong Ye , Naaz Sibia , Angela Zavaleta Bernuy , Tingting Zhu , Carolina Nobre , Viktoria Pammer-Schindler , Michael Liut

Security Orchestration, Automation, and Response (SOAR) platforms integrate and orchestrate a wide variety of security tools to accelerate the operational activities of Security Operation Center (SOC). Integration of security tools in a…

Cryptography and Security · Computer Science 2022-01-21 Zarrin Tasnim Sworna , Chadni Islam , Muhammad Ali Babar

There is a growing demand for mobile user interface (UI) automation, driven by its broad applications across industries. With the advent of visual language models (VLMs), GUI automation has progressed from generating text-based instructions…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Neeraj Anand , Rishabh Jain , Sohan Patnaik , Balaji Krishnamurthy , Mausoom Sarkar

The rapid adoption of mobile graphical user interface (GUI) agents, which autonomously control applications and operating systems (OS), exposes new system-level attack surfaces. Existing backdoors against web GUI agents and general GenAI…

Cryptography and Security · Computer Science 2026-03-25 Yutao Luo , Haotian Zhu , Shuchao Pang , Zhigang Lu , Tian Dong , Yongbin Zhou , Minhui Xue

Next-generation (NextG) cellular networks are expected to manage dynamic traffic while sustaining high performance. Large language models (LLMs) provide strategic reasoning for 6G planning, but their computational cost and latency limit…

Networking and Internet Architecture · Computer Science 2025-11-25 Narjes Nourzad , Mingyu Zong , Bhaskar Krishnamachari

The ability to predict collision-free future trajectories from egocentric observations is crucial in applications such as humanoid robotics, VR / AR, and assistive navigation. In this work, we introduce the challenging problem of predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Boxiao Pan , Adam W. Harley , C. Karen Liu , Leonidas J. Guibas

Computer architecture simulation is essential for evaluating new designs without the need for costly tapeout. The community has developed dozens of valuable simulators that have enabled significant architectural advances. However, using and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-01 Sabila Al Jannat , Ying Li , Mengyang He , Xuzhong Wang , Huizhi Zhao , Jingxiang Sun , Daoxuan Xu , Enze Xu , Yifan Sun

Screen user interfaces (UIs) and infographics, sharing similar visual language and design principles, play important roles in human communication and human-machine interaction. We introduce ScreenAI, a vision-language model that specializes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Gilles Baechler , Srinivas Sunkara , Maria Wang , Fedir Zubach , Hassan Mansoor , Vincent Etter , Victor Cărbune , Jason Lin , Jindong Chen , Abhanshu Sharma

Architecture erosion (AEr) can adversely affect software development and has received significant attention in the last decade. However, there is an absence of a comprehensive understanding of the state of research about the reasons and…

Software Engineering · Computer Science 2022-02-14 Ruiyin Li , Peng Liang , Mohamed Soliman , Paris Avgeriou