English
Related papers

Related papers: Playing for Data: Ground Truth from Computer Games

200 papers

Semantic segmentation is one of the basic topics in computer vision, it aims to assign semantic labels to every pixel of an image. Unbalanced semantic label distribution could have a negative influence on segmentation accuracy. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Shuangting Liu , Jiaqi Zhang , Yuxin Chen , Yifan Liu , Zengchang Qin , Tao Wan

Major advancements in computer vision can primarily be attributed to the use of labeled datasets. However, acquiring labels for datasets often results in errors which can harm model performance. Recent works have proposed methods to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Maya Srikanth , Jeremy Irvin , Brian Wesley Hill , Felipe Godoy , Ishan Sabane , Andrew Y. Ng

Training convolutional networks for semantic segmentation requires per-pixel ground truth labels, which are very time consuming and hence costly to obtain. Therefore, in this work, we research and develop a hierarchical deep network…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Panagiotis Meletis , Gijs Dubbelman

Preparing training data for deep vision models is a labor-intensive task. To address this, generative models have emerged as an effective solution for generating synthetic data. While current generative models produce image-level category…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Quang Nguyen , Truong Vu , Anh Tran , Khoi Nguyen

Semantic segmentation is a key computer vision task that has been actively researched for decades. In recent years, supervised methods have reached unprecedented accuracy, however they require many pixel-level annotations for every new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Nir Zabari , Yedid Hoshen

This research sets out to assess the viability of using game engines to generate synthetic training data for machine learning in the context of pallet segmentation. Using synthetic data has been proven in prior research to be a viable means…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jouveer Naidoo , Nicholas Bates , Trevor Gee , Mahla Nejati

There have been remarkable improvements in the semantic labelling task in the recent years. However, the state of the art methods rely on large-scale pixel-level annotations. This paper studies the problem of training a pixel-wise semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-07-17 Seong Joon Oh , Rodrigo Benenson , Anna Khoreva , Zeynep Akata , Mario Fritz , Bernt Schiele

GameTileNet is a dataset designed to provide semantic labels for low-resolution digital game art, advancing procedural content generation (PCG) and related AI research as a vision-language alignment task. Large Language Models (LLMs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Yi-Chun Chen , Arnav Jhala

Convolutional Neural Networks (CNNs) traditionally require large amounts of data to train models with good performance. However, data collection is an expensive process, both in time and resources. Generated synthetic images are a good…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Leandro Arab Marcomini , Andre Luiz Cunha

Game maps are useful for human players, general-game-playing agents, and data-driven procedural content generation. These maps are generally made by hand-assembling manually-created screenshots of game levels. Besides being tedious and…

Artificial Intelligence · Computer Science 2017-07-14 Joseph C. Osborn , Adam Summerville , Michael Mateas

Although the availability of a large amount of data is usually given for granted, there are relevant scenarios where this is not the case; for instance, in the biomedical/healthcare domain, some applications require to build huge datasets…

Machine Learning · Computer Science 2023-10-24 Pierangela Bruno , Francesco Calimeri , Cinzia Marte , Simona Perri

Image- and video-based 3D human recovery (i.e., pose and shape estimation) have achieved substantial progress. However, due to the prohibitive cost of motion capture, existing datasets are often limited in scale and diversity. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Zhongang Cai , Mingyuan Zhang , Jiawei Ren , Chen Wei , Daxuan Ren , Zhengyu Lin , Haiyu Zhao , Lei Yang , Chen Change Loy , Ziwei Liu

Annotating images for semantic segmentation requires intense manual labor and is a time-consuming and expensive task especially for domains with a scarcity of experts, such as Forensic Anthropology. We leverage the evolving nature of images…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Sara Mousavi , Zhenning Yang , Kelley Cross , Dawnie Steadman , Audris Mockus

Labeling semantic segmentation datasets is a costly and laborious process if compared with tasks like image classification and object detection. This is especially true for remote sensing applications that not only work with extremely high…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Matheus Barros Pereira , Jefersson Alex dos Santos

Text-based games are becoming commonly used in reinforcement learning as real-world simulation environments. They are usually imperfect information games, and their interactions are only in the textual modality. To challenge these games, it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Tsunehiko Tanaka , Daiki Kimura , Michiaki Tatsubori

Deep models have demonstrated recent success in single-image dehazing. Most prior methods consider fully supervised training and learn from paired clean and hazy images, where a hazy image is synthesized based on a clean image and its…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Zhengyang Lou , Huan Xu , Fangzhou Mu , Yanli Liu , Xiaoyu Zhang , Liang Shang , Jiang Li , Bochen Guan , Yin Li , Yu Hen Hu

Semantic segmentation requires a detailed labeling of image pixels by object category. Information derived from local image patches is necessary to describe the detailed shape of individual objects. However, this information is ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Hexiang Hu , Zhiwei Deng , Guang-Tong Zhou , Fei Sha , Greg Mori

Data seems cheap to get, and in many ways it is, but the process of creating a high quality labeled dataset from a mass of data is time-consuming and expensive. With the advent of rich 3D repositories, photo-realistic rendering systems…

Computer Vision and Pattern Recognition · Computer Science 2016-09-09 Yair Movshovitz-Attias , Takeo Kanade , Yaser Sheikh

Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is contingent on the availability of high-quality imaging data…

On-screen game footage contains rich contextual information that players process when playing and experiencing a game. Learning pixel representations of games can benefit artificial intelligence across several downstream tasks including…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Chintan Trivedi , Konstantinos Makantasis , Antonios Liapis , Georgios N. Yannakakis