English
Related papers

Related papers: UIClip: A Data-driven Model for Assessing User Int…

200 papers

Searching for relative mobile user interface (UI) design examples can aid interface designers in gaining inspiration and comparing design alternatives. However, finding such design examples is challenging, especially as current search…

Human-Computer Interaction · Computer Science 2021-02-11 Sara Bunian , Kai Li , Chaima Jemmali , Casper Harteveld , Yun Fu , Magy Seif El-Nasr

The most important aspect of any Software is the operability for the intended audience. This factor of operability is encompassed in the user interface, which serves as the only window to the features of the system. It is thus essential…

Human-Computer Interaction · Computer Science 2014-09-16 Rishabh Jain , Rupanta Rwiteej Dutta , Rajat Tandon

The layout of a mobile screen is a critical data source for UI design research and semantic understanding of the screen. However, UI layouts in existing datasets are often noisy, have mismatches with their visual representation, or consists…

Human-Computer Interaction · Computer Science 2022-01-14 Gang Li , Gilles Baechler , Manuel Tragut , Yang Li

The process of developing a mobile application typically starts with the ideation and conceptualization of its user interface. This concept is then translated into a set of mock-ups to help determine how well the user interface embodies the…

Software Engineering · Computer Science 2019-01-07 Carlos Bernal-Cardenas , Kevin Moran , Michele Tufano , Zichang Liu , Linyong Nan , Zhehan Shi , Denys Poshyvanyk

In the area of computer vision, deep learning techniques have recently been used to predict whether urban scenes are likely to be considered beautiful: it turns out that these techniques are able to make accurate predictions. Yet they fall…

Computers and Society · Computer Science 2020-01-17 Sagar Joglekar , Daniele Quercia , Miriam Redi , Luca Maria Aiello , Tobias Kauer , Nishanth Sastry

User interface (UI) design is an iterative process in which designers progressively refine their work with design software such as Figma or Sketch. Recent advances in vision language models (VLMs) with tool invocation suggest these models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Daeheon Jeong , Seoyeon Byun , Kihoon Son , Dae Hyun Kim , Juho Kim

In the field of design patent analysis, traditional tasks such as patent classification and patent image retrieval heavily depend on the image data. However, patent images -- typically consisting of sketches with abstract and structural…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Zhu Wang , Homaira Huda Shomee , Sathya N. Ravi , Sourav Medya

Interfaces are recognized as an important mechanism to define contracts governing interactions between semi-independent software modules. Well-designed interfaces significantly reduce software complexity and ease maintainability by…

Software Engineering · Computer Science 2013-10-01 Hani Abdeen , Osama Shata , Abdelkarim Erradi

Developing and testing user interfaces (UIs) and training AI agents to interact with them are challenging due to the dynamic and diverse nature of real-world mobile environments. Existing methods often rely on cumbersome physical devices or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jiannan Xiang , Yun Zhu , Lei Shu , Maria Wang , Lijun Yu , Gabriel Barcik , James Lyon , Srinivas Sunkara , Jindong Chen

Different types of user interfaces differ significantly in the number of elements and how they are displayed. To examine how such differences affect the way users look at UIs, we collected and analyzed a large eye-tracking-based dataset,…

Human-Computer Interaction · Computer Science 2024-02-09 Yue Jiang , Luis A. Leiva , Paul R. B. Houssel , Hamed R. Tavakoli , Julia Kylmälä , Antti Oulasvirta

IUIs aim to incorporate intelligent automated capabilities in human computer interaction, where the net impact is a human-computer interaction that improves performance or usability in critical ways. It also involves designing and…

Human-Computer Interaction · Computer Science 2017-02-20 Daniel Sonntag

This article proposes the so-called large user interface models (LUIMs) to enable the generation of user interfaces and prediction of usability using artificial intelligence in the context of mobile applications.

Human-Computer Interaction · Computer Science 2024-05-08 Abdallah Namoun , Ahmed Alrehaili , Zaib Un Nisa , Hani Almoamari , Ali Tufail

Today, a large proportion of end user information systems have their Graphical User Interfaces (GUI) built with web-based technology (JavaScript, CSS, and HTML). Some of these web-based systems include: Internet of Things (IOT),…

Human-Computer Interaction · Computer Science 2023-01-24 Ebenezer Agbozo

Usability evaluation is an essential method to support the design of effective and intuitive user interfaces (UIs). However, it commonly relies on resource-intensive, expert-driven methods, which limit its accessibility, especially for…

Software Engineering · Computer Science 2026-04-13 Sebastian Lubos , Alexander Felfernig , Damian Garber , Gerhard Leitner , Julian Schwazer , Manuel Henrich

With the rapid development of generative technologies, AI-Generated Images (AIGIs) have been widely applied in various aspects of daily life. However, due to the immaturity of the technology, the quality of the generated images varies, so…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhenchen Tang , Zichuan Wang , Bo Peng , Jing Dong

There has been a widespread emergence of computing devices in the past few years that go beyond the capabilities of traditional desktop computers. However, users want to use the same kinds of applications and access the same data and…

Human-Computer Interaction · Computer Science 2007-05-23 Mir Farooq Ali , Manuel A. Perez-Quinones , Eric Shell , Marc Abrams

Designing user interfaces that align with user preferences is a time-consuming process, which requires iterative cycles of prototyping, user testing, and refinement. Recent advancements in LLM-based UI generation have enabled efficient UI…

Human-Computer Interaction · Computer Science 2026-01-27 Yimeng Liu , Misha Sra , Chang Xiao

Selecting an optimal set of icons is a crucial step in the pipeline of visual design to structure and navigate through content. However, designing the icons sets is usually a difficult task for which expert knowledge is required. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Manuel Lagunas , Elena Garces , Diego Gutierrez

Aesthetics or "look and feel" is one of the most important features of any graphical user interface. Better aesthetics makes the interface user-friendlier and more popular. Better aesthetics helps the user to understand the meaning of…

Human-Computer Interaction · Computer Science 2014-04-29 Umakant Mishra

Selecting relevant data subsets from large, unfamiliar datasets can be difficult. We address this challenge by modeling and visualizing two kinds of auxiliary information: (1) quality - the validity and appropriateness of data required to…

Human-Computer Interaction · Computer Science 2023-03-06 Arpit Narechania , Fan Du , Atanu R Sinha , Ryan A. Rossi , Jane Hoffswell , Shunan Guo , Eunyee Koh , Shamkant B. Navathe , Alex Endert