English
Related papers

Related papers: From UI to Code: Mobile Ads Detection via LLM-Unif…

200 papers

In recent years, the graph partitioning problem gained importance as a mandatory preprocessing step for distributed graph processing on very large graphs. Existing graph partitioning algorithms minimize partitioning latency by assigning…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-31 Christian Mayer , Ruben Mayer , Muhammad Adnan Tariq , Heiko Geppert , Larissa Laich , Lukas Rieger , Kurt Rothermel

The fragmentation problem has extended from Android to different platforms, such as iOS, mobile web, and even mini-programs within some applications (app). In such a situation, recording and replaying test scripts is a popular automated…

Software Engineering · Computer Science 2021-02-23 Shengcheng Yu , Chunrong Fang , Yexiao Yun , Yang Feng

Gaze event detection is fundamental to vision science, human-computer interaction, and applied analytics. However, current workflows often require specialized programming knowledge and careful handling of heterogeneous raw data formats.…

Human-Computer Interaction · Computer Science 2026-04-16 Dongyang Guo , Yasmeen Abdrabou , Enkelejda Kasneci

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the development of technology and aesthetics, the visual effects of the GUI are more…

Software Engineering · Computer Science 2020-09-08 Zhe Liu , Chunyang Chen , Junjie Wang , Yuekai Huang , Jun Hu , Qing Wang

Autonomous agents operating on the graphical user interfaces (GUIs) of various applications hold immense practical value. Unlike the large language model (LLM)-based methods which rely on structured texts and customized backends, the…

Artificial Intelligence · Computer Science 2024-11-05 Xuetian Chen , Hangcheng Li , Jiaqing Liang , Sihang Jiang , Deqing Yang

This paper introduces adF, a novel system for analyzing the vulnerability of different devices, Operating Systems (OSes), and browsers to web fingerprinting. adF performs its measurements from code inserted in ads. We have used our system…

Cryptography and Security · Computer Science 2025-12-11 Miguel A. Bermejo-Agueda , Patricia Callejo , Rubén Cuevas , Ángel Cuevas

Harnessing publicly available, large-scale web data, such as street view and satellite imagery, urban socio-economic sensing is of paramount importance for achieving global sustainable development goals. With the emergence of Large…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Tianhui Liu , Hetian Pang , Xin Zhang , Jie Feng , Yong Li , Pan Hui

Mobile apps bring us many conveniences, such as online shopping and communication, but some use malicious designs called dark patterns to trick users into doing things that are not in their best interest. Many works have been done to…

Human-Computer Interaction · Computer Science 2024-12-02 Jieshan Chen , Jiamou Sun , Sidong Feng , Zhenchang Xing , Qinghua Lu , Xiwei Xu , Chunyang Chen

Mobile Advertisement is a location-aware dissemination solution built on top of a vehicular ad-hoc network. We envision a network of WiFi access points that dynamically disseminate data to clients running on the car's smart device. The…

Networking and Internet Architecture · Computer Science 2012-02-14 Ciprian Dobre , George Cristian Tudor

Over the past decade, advertising has emerged as the primary source of revenue for many web sites and apps. In this paper we report a first-of-its-kind study that seeks to broadly understand the features, mechanisms and dynamics of display…

Computers and Society · Computer Science 2014-07-07 Paul Barford , Igor Canadi , Darja Krushevskaja , Qiang Ma , S. Muthukrishnan

Recommendation systems power engagement and monetization across feeds, ads, and short-video platforms, but translating the latest advances in Large Language Models into Recommendation Systems (RecSys) gains remains rare, particularly in…

Large Language Models (LLMs) have shown strong capabilities in Natural Language Understanding and Generation, but deploying them directly in online advertising systems is often impractical due to strict millisecond-level latency…

The rapid growth of mobile applications has escalated Android malware threats. Although there are numerous detection methods, they often struggle with evolving attacks, dataset biases, and limited explainability. Large Language Models…

Cryptography and Security · Computer Science 2025-04-23 Xingzhi Qian , Xinran Zheng , Yiling He , Shuo Yang , Lorenzo Cavallaro

Mobile app GUI (Graphical User Interface) pages now contain rich visual information, with the visual semantics of each page helping users understand the application logic. However, these complex visual and functional logic present new…

Software Engineering · Computer Science 2024-12-05 Zhe Liu , Cheng Li , Chunyang Chen , Junjie Wang , Mengzhuo Chen , Boyu Wu , Yawen Wang , Jun Hu , Qing Wang

Advertisement videos serve as a rich and valuable source of purpose-driven information, encompassing high-quality visual, textual, and contextual cues designed to engage viewers. They are often more complex than general videos of similar…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zheyuan Zhang , Monica Dou , Linkai Peng , Hongyi Pan , Ulas Bagci , Boqing Gong

In the development and maintenance of Android apps, the quick and accurate reproduction of user-reported bugs is crucial to ensure application quality and improve user satisfaction. However, this process is often time-consuming and complex.…

Software Engineering · Computer Science 2026-04-01 Xiangyang Xiao , Huaxun Huang , Rongxin Wu

Vision Language Models (VLMs) have demonstrated strong capabilities in understanding visual content, yet their ability to predict where humans look on user interfaces remains unexplored. We present UIGaze, a study investigating how closely…

Human-Computer Interaction · Computer Science 2026-04-30 Min Song , Yoonseong Lee , Yeonhu Seo

A wide variety of smartphone applications today rely on third-party advertising services, which provide libraries that are linked into the hosting application. This situation is undesirable for both the application author and the…

Operating Systems · Computer Science 2015-03-20 Shashi Shekhar , Michael Dietz , Dan S. Wallach

The HyperText Markup Language 5 (HTML5) <canvas> is useful for creating visual-centric web applications. However, unlike traditional web applications, HTML5 <canvas> applications render objects onto the <canvas> bitmap without representing…

Software Engineering · Computer Science 2025-01-17 Finlay Macklon , Cor-Paul Bezemer

In this work, we propose GUIPilot, an approach for detecting inconsistencies between the mobile design and their implementations. The mobile design usually consists of design mock-ups that specify (1) the expected screen appearances (e.g.,…

Software Engineering · Computer Science 2025-06-10 Ruofan Liu , Xiwen Teoh , Yun Lin , Guanjie Chen , Ruofei Ren , Denys Poshyvanyk , Jin Song Dong