English
Related papers

Related papers: Auto Completion of User Interface Layout Design Us…

200 papers

The visualization of an image collection is the process of displaying a collection of images on a screen under some specific layout requirements. This paper focuses on an important problem that is not well addressed by the previous methods:…

Multimedia · Computer Science 2016-11-15 Xintong Han , Chongyang Zhang , Weiyao Lin , Mingliang Xu , Bin Sheng , Tao Mei

Transformers have become the architecture of choice for learning long-range dependencies, yet their adoption in hyperspectral imaging (HSI) is still emerging. We reviewed more than 300 papers published up to 2025 and present the first…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Guyang Zhang , Waleed Abdulla

Imaging system design is a complex, time-consuming, and largely manual process; LiDAR design, ubiquitous in mobile devices, autonomous vehicles, and aerial imaging platforms, adds further complexity through unique spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Nikhil Behari , Aaron Young , Tzofi Klinghoffer , Akshat Dave , Ramesh Raskar

Transformers have become the de-facto standard in the natural language processing (NLP) field. They have also gained momentum in computer vision and other domains. Transformers can enable artificial intelligence (AI) models to dynamically…

Machine Learning · Computer Science 2021-11-09 Liya Wang , Amy Mykityshyn , Craig Johnson , Jillian Cheng

Parameter Efficient Tuning (PET) has gained attention for reducing the number of parameters while maintaining performance and providing better hardware resource savings, but few studies investigate dense prediction tasks and interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Zunnan Xu , Zhihong Chen , Yong Zhang , Yibing Song , Xiang Wan , Guanbin Li

In recent years, fully differentiable end-to-end autonomous driving systems have become a research hotspot in the field of intelligent transportation. Among various research directions, automatic parking is particularly critical as it aims…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Hangyu Du , Chee-Meng Chew

Approximately 50% of development resources are devoted to UI development tasks [9]. Occupying a large proportion of development resources, developing icons can be a time-consuming task, because developers need to consider not only effective…

Human-Computer Interaction · Computer Science 2022-04-20 Sidong Feng , Minmin Jiang , Tingting Zhou , Yankun Zhen , Chunyang Chen

The past year has witnessed the rapid development of applying the Transformer module to vision problems. While some researchers have demonstrated that Transformer-based models enjoy a favorable ability of fitting data, there are still…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Zhengsu Chen , Lingxi Xie , Jianwei Niu , Xuefeng Liu , Longhui Wei , Qi Tian

Currently, domestic service robots have an insufficient ability to interact naturally through language. This is because understanding human instructions is complicated by various ambiguities and missing information. In existing methods, the…

Robotics · Computer Science 2021-07-05 Shintaro Ishikawa , Komei Sugiura

AI agents that interact with graphical user interfaces (GUIs) require effective observation representations for reliable grounding. The accessibility tree is a commonly used text-based format that encodes UI element attributes, but it…

Computation and Language · Computer Science 2026-05-04 Michito Takeshita , Takuro Kawada , Takumi Ohashi , Shunsuke Kitada , Hitoshi Iyatomi

Theory of tree transducers provides a foundation for understanding expressiveness and complexity of analysis problems for specification languages for transforming hierarchically structured data such as XML documents. We introduce streaming…

Formal Languages and Automata Theory · Computer Science 2012-02-23 Rajeev Alur , Loris D'Antoni

The Transformer architecture is shown to provide a powerful machine transduction framework for online handwritten gestures corresponding to glyph strokes of natural language sentences. The attention mechanism is successfully used to create…

Computation and Language · Computer Science 2023-05-08 G. C. M. Silvestre , F. Balado , O. Akinremi , M. Ramo

We present Magic Layouts; a method for parsing screenshots or hand-drawn sketches of user interface (UI) layouts. Our core contribution is to extend existing detectors to exploit a learned structural prior for UI designs, enabling robust…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Dipu Manandhar , Hailin Jin , John Collomosse

Astounding results from Transformer models on natural language tasks have intrigued the vision community to study their application to computer vision problems. Among their salient benefits, Transformers enable modeling long dependencies…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Salman Khan , Muzammal Naseer , Munawar Hayat , Syed Waqas Zamir , Fahad Shahbaz Khan , Mubarak Shah

The automation of user interface development has the potential to accelerate software delivery by mitigating intensive manual implementation. Despite the advancements in Large Multimodal Models for design-to-code translation, existing…

Information Retrieval · Computer Science 2025-12-24 Xian Wu , Ming Zhang , Zhiyu Fang , Fei Li , Bin Wang , Yong Jiang , Hao Zhou

Transformers are crucial across many AI fields, such as large language models, computer vision, and reinforcement learning. This prominence stems from the architecture's perceived universality and scalability compared to alternatives. This…

Machine Learning · Computer Science 2025-12-23 Amirreza Abbasi , Mohsen Hooshmand

As generative artificial intelligence advances, Large Language Models (LLMs) are being explored for automated graphical user interface (GUI) design. This study investigates the usability and adaptability of LLM-generated interfaces by…

Human-Computer Interaction · Computer Science 2026-02-02 Bartosz Sawicki , Tomasz Les , Dariusz Parzych , Aleksandra Wycisk-Ficek , Pawel Trebacz , Pawel Zawadzki

Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficult challenge. Prior work that uses pure language-only models…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hao Liu , Lisa Lee , Kimin Lee , Pieter Abbeel

Recommender Systems (RS) aim to generate personalized ranked lists for each user and are evaluated using ranking metrics. Although personalized ranking is a fundamental aspect of RS, this critical property is often overlooked in the design…

Information Retrieval · Computer Science 2025-03-24 Sirui Chen , Shen Han , Jiawei Chen , Binbin Hu , Sheng Zhou , Gang Wang , Yan Feng , Chun Chen , Can Wang

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen