English
Related papers

Related papers: PixelWeb: The First Web GUI Dataset with Pixel-Wis…

200 papers

The performance of deep networks for semantic image segmentation largely depends on the availability of large-scale training images which are labelled at the pixel level. Typically, such pixel-level image labellings are obtained manually by…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xiang Zhang , Wei Zhang , Jinye Peng , Jianping Fan

Pixel wise image labeling is an interesting and challenging problem with great significance in the computer vision community. In order for a dense labeling algorithm to be able to achieve accurate and precise results, it has to consider the…

Computer Vision and Pattern Recognition · Computer Science 2016-12-15 Spyros Gidaris , Nikos Komodakis

For web agents to be practically useful, they must adapt to the continuously evolving web environment characterized by frequent updates to user interfaces and content. However, most existing benchmarks only capture the static aspects of the…

Computation and Language · Computer Science 2024-07-17 Yichen Pan , Dehan Kong , Sida Zhou , Cheng Cui , Yifei Leng , Bing Jiang , Hangyu Liu , Yanyi Shang , Shuyan Zhou , Tongshuang Wu , Zhengyang Wu

With the deep integration of artificial intelligence and interactive technology, Graphical User Interface (GUI) Agent, as the carrier connecting goal-oriented natural language and real-world devices, has received widespread attention from…

Artificial Intelligence · Computer Science 2025-11-13 Leyang Yang , Ziwei Wang , Xiaoxuan Tang , Sheng Zhou , Dajun Chen , Wei Jiang , Yong Li

During software front-end development, the work to convert Graphical User Interface(GUI) image to the corresponding front-end code is an inevitable tedious work. There have been some attempts to make this work to be automatic. However, the…

Machine Learning · Computer Science 2020-07-08 Xiaoling Huang , Feng Liao

GUI agents that interact with graphical interfaces on behalf of users represent a promising direction for practical AI assistants. However, training such agents is hindered by the scarcity of suitable environments. We present InfiniteWeb, a…

Computation and Language · Computer Science 2026-01-09 Ziyun Zhang , Zezhou Wang , Xiaoyi Zhang , Zongyu Guo , Jiahao Li , Bin Li , Yan Lu

An increasing number of public datasets have shown a transformative impact on automated medical segmentation. However, these datasets are often with varying label quality, ranging from manual expert annotations to AI-generated…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yixiong Chen , Zongwei Zhou , Alan Yuille

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

Autonomous driving requires various computer vision algorithms, such as object detection and tracking.Precisely-labeled datasets (i.e., objects are fully contained in bounding boxes with only a few extra pixels) are preferred for training…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Govind Rathore , Wan-Yi Lin , Ji Eun Kim

To address the scarcity of high-quality part annotations in existing datasets, we introduce PartImageNet++ (PIN++), a dataset that provides detailed part annotations for all categories in ImageNet-1K. With 100 annotated images per category,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Xiao Li , Zilong Liu , Yining Liu , Zhuhong Li , Na Dong , Sitian Qin , Xiaolin Hu

Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus forming higher-order perceptual units such as tab, menu, card or…

Human-Computer Interaction · Computer Science 2023-05-25 Mulong Xie , Zhenchang Xing , Sidong Feng , Chunyang Chen , Liming Zhu , Xiwei Xu

Today, a large proportion of end user information systems have their Graphical User Interfaces (GUI) built with web-based technology (JavaScript, CSS, and HTML). Some of these web-based systems include: Internet of Things (IOT),…

Human-Computer Interaction · Computer Science 2023-01-24 Ebenezer Agbozo

Biomedical text tagging systems are plagued by the dearth of labeled training data. There have been recent attempts at using pre-trained encoders to deal with this issue. Pre-trained encoder provides representation of the input text which…

Computation and Language · Computer Science 2020-01-16 Gaurav Singh , Zahra Sabet , John Shawe-Taylor , James Thomas

Pre-training backbone networks on a general annotated dataset (e.g., ImageNet) that comprises numerous manually collected images with category annotations has proven to be indispensable for enhancing the generalization capacity of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Dengyang Jiang , Haoyu Wang , Lei Zhang , Wei Wei , Guang Dai , Mengmeng Wang , Jingdong Wang , Yanning Zhang

In this study, we introduce CobWeb 1.0 which is a graphical user interface tailored explicitly for accurate image segmentation and representative elementary volume analysis of digital rock images derived from high resolution tomography. The…

Human-Computer Interaction · Computer Science 2018-04-10 Swarup Chauhan , Kathleen Sell , Frieder Enzmann , Wolfram Rühaak , Thorsten Wille , Ingo Sass , Michael Kersten

With the rapid accumulation of text data produced by data-driven techniques, the task of extracting "data annotations"--concise, high-quality data summaries from unstructured raw text--has become increasingly important. The recent advances…

Human-Computer Interaction · Computer Science 2023-04-03 Xiaoyu Zhang , Xiwei Xuan , Alden Dima , Thurston Sexton , Kwan-Liu Ma

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the upgrading of mobile devices and the development of aesthetics, the visual…

Software Engineering · Computer Science 2022-05-30 Zhe Liu , Chunyang Chen , Junjie Wang , Yuekai Huang , Jun Hu , Qing Wang

Complementary-label learning (CLL) is a weakly-supervised learning paradigm that aims to train a multi-class classifier using only complementary labels, which indicate classes to which an instance does not belong. Despite numerous…

Machine Learning · Computer Science 2025-06-17 Hsiu-Hsuan Wang , Tan-Ha Mai , Nai-Xuan Ye , Wei-I Lin , Hsuan-Tien Lin

We propose an end-to-end learning framework for segmenting generic objects in both images and videos. Given a novel image or video, our approach produces a pixel-level mask for all "object-like" regions---even for object categories never…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Bo Xiong , Suyog Dutt Jain , Kristen Grauman

Pixel-wise segmentation is one of the most data and annotation hungry tasks in our field. Providing representative and accurate annotations is often mission-critical especially for challenging medical applications. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Simon Reiß , Constantin Seibold , Alexander Freytag , Erik Rodner , Rainer Stiefelhagen