English
Related papers

Related papers: From UI to Code: Mobile Ads Detection via LLM-Unif…

200 papers

The importance of computational modeling of mobile user interfaces (UIs) is undeniable. However, these require a high-quality UI dataset. Existing datasets are often outdated, collected years ago, and are frequently noisy with mismatches in…

Human-Computer Interaction · Computer Science 2024-05-14 Sidong Feng , Suyu Ma , Han Wang , David Kong , Chunyang Chen

Sponsored search ads appear next to search results when people look for products and services on search engines. In recent years, they have become one of the most lucrative channels for marketing. As the fundamental basis of search ads,…

Information Retrieval · Computer Science 2021-04-27 Chaozhuo Li , Bochen Pang , Yuming Liu , Hao Sun , Zheng Liu , Xing Xie , Tianqi Yang , Yanling Cui , Liangjie Zhang , Qi Zhang

Given the massive market of advertising and the sharply increasing online multimedia content (such as videos), it is now fashionable to promote advertisements (ads) together with the multimedia content. It is exhausted to find relevant ads…

Multimedia · Computer Science 2020-01-06 Huaizheng Zhang , Yong Luo , Qiming Ai , Yonggang Wen

Nowadays, many applications do not exist independently but rely on various frameworks or libraries. The frequent evolution and the complex implementation of framework APIs induce many unexpected post-release crashes. Starting from the crash…

Software Engineering · Computer Science 2024-08-23 Jiwei Yan , Jinhao Huang , Chunrong Fang , Jun Yan , Jian Zhang

Large Vision-Language Models (LVLMs) empower autonomous mobile agents, yet their security under realistic mobile deployment constraints remains underexplored. While agents are vulnerable to visual prompt injections, stealthily executing…

Cryptography and Security · Computer Science 2026-04-10 Renhua Ding , Xiao Yang , Zhengwei Fang , Jun Luo , Kun He , Jun Zhu

VLM-based mobile agents are increasingly popular due to their capabilities to interact with smartphone GUIs and XML-structured texts and to complete daily tasks. However, existing online benchmarks struggle with obtaining stable reward…

Computation and Language · Computer Science 2026-02-03 Weikai Xu , Zhizheng Jiang , Yuxuan Liu , Pengzhi Gao , Wei Liu , Jian Luan , Yuanchun Li , Yunxin Liu , Bin Wang , Bo An

Automatic vision inspection holds significant importance in industry inspection. While multimodal large language models (MLLMs) exhibit strong language understanding capabilities and hold promise for this task, their performance remains…

Information Retrieval · Computer Science 2026-04-06 Kai Zhang , Zekai Zhang , Xihe Sun , Anpeng Wang , Jingmeng Nie , Qinghui Chen , Han Hao , Jianyuan Guo , Jinglin Zhang

Large language models (LLMs) are increasingly used for text-rich graph machine learning tasks such as node classification in high-impact domains like fraud detection and recommendation systems. Yet, despite a surge of interest, the field…

Computation and Language · Computer Science 2026-03-03 Ben Finkelshtein , Silviu Cucerzan , Sujay Kumar Jauhar , Ryen White

Graphical User Interface (GUI) has become one of the most significant parts of mobile applications (apps). It is a direct bridge between mobile apps and end users, which directly affects the end user's experience. Neglecting GUI quality can…

Software Engineering · Computer Science 2025-10-21 Shengcheng Yu , Chunrong Fang , Ziyuan Tuo , Quanjun Zhang , Chunyang Chen , Zhenyu Chen , Zhendong Su

Detecting AI-generated text is an increasing necessity to combat misuse of LLMs in education, business compliance, journalism, and social media, where synthetic fluency can mask misinformation or deception. While prior detectors often rely…

Computation and Language · Computer Science 2026-02-26 Advik Raj Basani , Pin-Yu Chen

AI agents operating on user interfaces must understand how interfaces communicate state and feedback to act reliably. As a core communicative modality, animations are increasingly used in modern interfaces, serving critical functional…

Human-Computer Interaction · Computer Science 2026-04-30 Chen Liang , Xirui Jiang , Naihao Deng , Eytan Adar , Anhong Guo

Image-based advertisements are complex multimodal stimuli that often contain unusual visual elements and figurative language. Previous research on automatic ad understanding has reported impressive zero-shot accuracy of contrastive…

Computation and Language · Computer Science 2024-06-03 A. Bavaresco , A. Testoni , R. Fernández

Video-based ads are a vital medium for brands to engage consumers, with social media platforms leveraging user data to optimize ad delivery and boost engagement. A crucial but under-explored aspect is the 'hooking period', the first three…

Multimedia · Computer Science 2026-02-27 Kunpeng Zhang , Poppy Zhang , Shawndra Hill , Amel Awadelkarim

Traffic sign detection is a critical task in the operation of Autonomous Vehicles (AV), as it ensures the safety of all road users. Current DNN-based sign classification systems rely on pixel-level features to detect traffic signs and can…

Artificial Intelligence · Computer Science 2023-09-08 Zahra Chaghazardi , Saber Fallah , Alireza Tamaddoni-Nezhad

Mobile app markets host millions of apps, yet undesired behaviors (e.g., disruptive ads, illegal redirection, payment deception) remain hard to catch because they often do not rely on permission-protected APIs and can be easily camouflaged…

Cryptography and Security · Computer Science 2025-10-17 Zichen Liu , Shao Yang , Xusheng Xiao

Coding agents powered by large language models (LLMs) have gained traction for automating code generation through iterative problem-solving with minimal human involvement. Despite the emergence of various frameworks, e.g., LangChain,…

Machine Learning · Computer Science 2025-08-19 Junpeng Wang , Yuzhong Chen , Menghai Pan , Chin-Chia Michael Yeh , Mahashweta Das

Online advertising is a huge, rapidly growing advertising market in today's world. One common form of online advertising is using image ads. A decision is made (often in real time) every time a user sees an ad, and the advertiser is eager…

Computer Vision and Pattern Recognition · Computer Science 2015-09-03 Michael Fire , Jonathan Schler

Raw videos have been proven to own considerable feature redundancy where in many cases only a portion of frames can already meet the requirements for accurate recognition. In this paper, we are interested in whether such redundancy can be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Lianyu Hu , Liqing Gao , Zekang Liu , Chi-Man Pun , Wei Feng

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the upgrading of mobile devices and the development of aesthetics, the visual…

Software Engineering · Computer Science 2022-05-30 Zhe Liu , Chunyang Chen , Junjie Wang , Yuekai Huang , Jun Hu , Qing Wang

Cross-Modal sponsored search displays multi-modal advertisements (ads) when consumers look for desired products by natural language queries in search engines. Since multi-modal ads bring complementary details for query-ads matching, the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Yuanmin Tang , Jing Yu , Keke Gai , Yujing Wang , Yue Hu , Gang Xiong , Qi Wu