English
Related papers

Related papers: Screen2AX: Vision-Based Approach for Automatic mac…

200 papers

With the rapid advancement of intelligent transportation systems, text-driven image generation and editing techniques have demonstrated significant potential in providing rich, controllable visual scene data for applications such as traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Feng Lv , Haoxuan Feng , Zilu Zhang , Chunlong Xia , Yanfeng Li

Scene graph generation is a sophisticated task because there is no specific recognition pattern (e.g., "looking at" and "near" have no conspicuous difference concerning vision, whereas "near" could occur between entities with different…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Xiaoguang Chang , Teng Wang , Changyin Sun , Wenzhe Cai

Neural architecture search (NAS) automates the design process of high-performing architectures, but remains bottlenecked by expensive performance evaluation. Most existing studies that achieve faster evaluation are mostly tied to cell-based…

Machine Learning · Computer Science 2025-10-07 Shiwen Qin , Alexander Auras , Shay B. Cohen , Elliot J. Crowley , Michael Moeller , Linus Ericsson , Jovita Lukasik

Image segmentation is a powerful computer vision technique for scene understanding. However, real-world deployment is stymied by the need for high-quality, meticulously labeled datasets. Synthetic data provides high-quality labels while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Edward Humes , Xiaomin Lin , Boxun Hu , Rithvik Jonna , Tinoosh Mohsenin

Despite remarkable progress in Text-to-Image models, many real-world applications require generating coherent image sets with diverse consistency requirements. Existing consistent methods often focus on a specific domain with specific…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Chengyou Jia , Xin Shen , Zhuohang Dang , Zhuohang Dang , Changliang Xia , Weijia Wu , Xinyu Zhang , Hangwei Qian , Ivor W. Tsang , Minnan Luo

Bias in generative Text-to-Image (T2I) models is a known issue, yet systematically analyzing such models' outputs to uncover it remains challenging. We introduce the Visual Bias Explorer (ViBEx) to interactively explore the output space of…

Human-Computer Interaction · Computer Science 2026-03-17 Johannes Eschner , Roberto Labadie-Tamayo , Matthias Zeppelzauer , Manuela Waldner

With the rapid advancement of generative artificial intelligence technology, Graphical User Interface (GUI) agents have demonstrated tremendous potential for autonomously managing daily tasks through natural language instructions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Fengxian Ji , Jingpu Yang , Zirui Song , Yuanxi Wang , Zhexuan Cui , Yuke Li , Qian Jiang , Miao Fang , Xiuying Chen

This article aims to use graphic engines to simulate a large number of training data that have free annotations and possibly strongly resemble to real-world data. Between synthetic and real, a two-level domain gap exists, involving content…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yue Yao , Liang Zheng , Xiaodong Yang , Milind Napthade , Tom Gedeon

Converting hand-drawn sketches into structured 3D geometries remains challenging due to the difficulty of representing non-Euclidean surfaces and maintaining topological consistency. Existing generative models such as GANs, NeRFs, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Wenda Wang , Anqi Liu , Junqi Yang , Lei He , Luying Wang , Jiachen Lu , Weixin Huang

Multi-window mobile scenarios, such as split-screen and foldable modes, make GUI display defects more likely by forcing applications to adapt to changing window sizes and dynamic layout reflow. Existing detection techniques are limited in…

Software Engineering · Computer Science 2026-04-22 Xinyao Zhang , Rui Wang , Jinhao Cui , Haotian Huang , Wei Xue , Wenhua Hu , Jianwen Xiang , Rui Hao

The Graphical User Interface (GUI) plays a central role in mobile applications, directly affecting usability and user satisfaction. Poor GUI performance, such as lag or unresponsiveness, can lead to negative user experience and decreased…

Software Engineering · Computer Science 2025-02-07 Wei Liu , Feng Lin , Linqiang Guo , Tse-Hsun Chen , Ahmed E. Hassan

GUI responsiveness is critical for a positive user experience in mobile applications. Even brief delays in visual feedback can frustrate users and lead to negative reviews. However, detecting and quantifying such user-perceived delays…

Software Engineering · Computer Science 2025-08-05 Wei Liu , Linqiang Guo , Yi Wen Heng , Chenglin Li , Tse-Hsun , Chen , Ahmed E. Hassan

Inspired by the effectiveness of 3D Gaussian Splatting (3DGS) in reconstructing detailed 3D scenes within multi-view setups and the emergence of large 2D human foundation models, we introduce Arc2Avatar, the first SDS-based method utilizing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Dimitrios Gerogiannis , Foivos Paraperas Papantoniou , Rolandos Alexandros Potamias , Alexandros Lattas , Stefanos Zafeiriou

The exponential growth of scientific production makes secondary literature abridgements increasingly demanding. We introduce a new open-source framework for systematic reviews that significantly reduces time and workload for collecting and…

Digital Libraries · Computer Science 2022-02-24 Angelo D'Ambrosio , Hajo Grundmann , Tjibbe Donker

Detecting user interface (UI) controls from software screenshots is a critical task for automated testing, accessibility, and software analytics, yet it remains challenging due to visual ambiguities, design variability, and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari

Synthetic data is emerging as a promising solution to the scalability issue of supervised deep learning, especially when real data are difficult to acquire or hard to annotate. Synthetic data generation, however, can itself be prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Aayush Prakash , Shoubhik Debnath , Jean-Francois Lafleche , Eric Cameracci , Gavriel State , Stan Birchfield , Marc T. Law

Table of contents (ToC) extraction aims to extract headings of different levels in documents to better understand the outline of the contents, which can be widely used for document understanding and information retrieval. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Pengfei Hu , Zhenrong Zhang , Jianshu Zhang , Jun Du , Jiajia Wu

Automating GUI tasks remains challenging due to reliance on textual representations, platform-specific action spaces, and limited reasoning capabilities. We introduce Aguvis, a unified vision-based framework for autonomous GUI agents that…

Computation and Language · Computer Science 2025-05-06 Yiheng Xu , Zekun Wang , Junli Wang , Dunjie Lu , Tianbao Xie , Amrita Saha , Doyen Sahoo , Tao Yu , Caiming Xiong

Image-to-code generation tests whether a vision-language model (VLM) can recover the structure of an image enough to express it as executable code. Existing benchmarks either focus on narrow visual domains, depend on paired executable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ajay Vikram Periasami , Junlin Wang , Bhuwan Dhingra

Developing simple and expressive access controls -- interfaces to specify policies that define who should have access to resources and under what circumstances -- is a longstanding challenge in usable security. We present Sketch-based…

Human-Computer Interaction · Computer Science 2026-05-12 Kyzyl Monteiro , Sauvik Das