English
Related papers

Related papers: Object Detection for Graphical User Interface: Old…

200 papers

Graphical user interface testing is significantly challenging, and automating it even more so. Test-driven development is impractical: it generally requires an initial implementation of the GUI to generate golden images or to construct…

Software Engineering · Computer Science 2020-06-09 Donald Beaver

Graphical user interface (GUI) has become integral to modern society, making it crucial to be understood for human-centric systems. However, unlike natural images or documents, GUIs comprise artificially designed graphical elements arranged…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ziwei Wang , Weizhi Chen , Leyang Yang , Sheng Zhou , Shengchu Zhao , Hanbei Zhan , Jiongchao Jin , Liangcheng Li , Zirui Shao , Jiajun Bu

Since the first Graphical User Interface (GUI) prototype was invented in the 1970s, GUI systems have been deployed into various personal computer systems and server platforms. Recently, with the development of artificial intelligence (AI)…

Cryptography and Security · Computer Science 2020-01-28 Ning Yu , Zachary Tuttle , Carl Jake Thurnau , Emmanuel Mireku

With the advent of state-of-the-art machine learning and deep learning technologies, several industries are moving towards the field. Applications of such technologies are highly diverse ranging from natural language processing to computer…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Viny Saajan Victor , Pramod Vadiraja , Jan-Tobias Sohns , Heike Leitte

Object Detection (OD) is an important computer vision problem for industry, which can be used for quality control in the production lines, among other applications. Recently, Deep Learning (DL) methods have enabled practitioners to train OD…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Igor Garcia Ballhausen Sampaio , Luigy Machaca , José Viterbo , Joris Guérin

Automation of existing Graphical User Interfaces (GUIs) is important but hard to achieve. Upstream of making the GUI user-accessible or somehow scriptable, even the data-collection to understand the original interface poses significant…

Human-Computer Interaction · Computer Science 2025-04-15 Iason Chaimalas , Arnas Vyšniauskas , Gabriel Brostow

The generation of high-quality images has become widely accessible and is a rapidly evolving process. As a result, anyone can generate images that are indistinguishable from real ones. This leads to a wide range of applications, including…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Sergey Sinitsa , Ohad Fried

Graphical user interface (GUI) agents have recently emerged as an intriguing paradigm for human-computer interaction, capable of automatically executing user instructions to operate intelligent terminal devices. However, when encountering…

Machine Learning · Computer Science 2025-11-25 Zheng Wu , Pengzhou Cheng , Zongru Wu , Lingzhong Dong , Zhuosheng Zhang

Segmentation of organs or lesions from medical images plays an essential role in many clinical applications such as diagnosis and treatment planning. Though Convolutional Neural Networks (CNN) have achieved the state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Xiangde Luo , Guotai Wang , Tao Song , Jingyang Zhang , Michael Aertsen , Jan Deprest , Sebastien Ourselin , Tom Vercauteren , Shaoting Zhang

User Interface (UI) prototyping is a necessary step in the early stages of application development. Transforming sketches of a Graphical User Interface (UI) into a coded UI application is an uninspired but time-consuming task performed by a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Vanita Jain , Piyush Agrawal , Subham Banga , Rishabh Kapoor , Shashwat Gulyani

Deep Learning (DL) has become a crucial technology for Artificial Intelligence (AI). It is a powerful technique to automatically extract high-level features from complex data which can be exploited for applications such as computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Gael Kamdem De Teyou

The rapid development of deep learning techniques has created new challenges in identifying the origin of digital images because generative adversarial networks and variational autoencoders can create plausible digital images whose contents…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Rong Huang , Fuming Fang , Huy H. Nguyen , Junichi Yamagishi , Isao Echizen

This study introduces an advanced gesture recognition and user interface (UI) interaction system powered by deep learning, highlighting its transformative impact on UI design and functionality. By utilizing optimized convolutional neural…

Human-Computer Interaction · Computer Science 2024-11-26 Qi Sun , Tong Zhang , Shang Gao , Liuqingqing Yang , Fenghua Shao

Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus forming higher-order perceptual units such as tab, menu, card or…

Human-Computer Interaction · Computer Science 2023-05-25 Mulong Xie , Zhenchang Xing , Sidong Feng , Chunyang Chen , Liming Zhu , Xiwei Xu

In this work, we propose and address a new computer vision task, which we call fashion item detection, where the aim is to detect various fashion items a person in the image is wearing or carrying. The types of fashion items we consider in…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Kota Hara , Vignesh Jagadeesh , Robinson Piramuthu

In autonomous Vehicles technology Image segmentation was a major problem in visual perception. This image segmentation process is mainly used in medical applications. Here we adopted an image segmentation process to visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tirumalapudi Raviteja , Rajay Vedaraj . I. S

Most existing AU detection works considering AU relationships are relying on probabilistic graphical models with manually extracted features. This paper proposes an end-to-end deep learning framework for facial AU detection with graph…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Zhilei Liu , Jiahui Dong , Cuicui Zhang , Longbiao Wang , Jianwu Dang

This survey paper specially analyzed computer vision-based object detection challenges and solutions by different techniques. We mainly highlighted object detection by three different trending strategies, i.e., 1) domain adaptive deep…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Muhammed Muzammul , Xi Li

As an emerging and challenging problem in the computer vision community, weakly supervised object localization and detection plays an important role for developing new generation computer vision systems and has received significant…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Dingwen Zhang , Junwei Han , Gong Cheng , Ming-Hsuan Yang

Automated software testing is integral to the software development process, streamlining workflows and ensuring product reliability. Visual testing, particularly for user interface (UI) and user experience (UX) validation, plays a vital…

Software Engineering · Computer Science 2025-10-08 Milad Moradi , Ke Yan , David Colwell , Rhona Asgari