English
Related papers

Related papers: Toward Mining Visual Log of Software

200 papers

The inception of a mobile app often takes form of a mock-up of the Graphical User Interface (GUI), represented as a static image delineating the proper layout and style of GUI widgets that satisfy requirements. Following this initial…

Software Engineering · Computer Science 2018-04-09 Kevin Moran , Boyang Li , Carlos Bernal-Cárdenas , Dan Jelf , Denys Poshyvanyk

CodeSight is an end-to-end system designed to anticipate deadline compliance in software development workflows. It captures development and deployment data directly from GitHub, transforming it into process mining logs for detailed…

Software Engineering · Computer Science 2025-11-03 Antía Dorado , Iván Folgueira , Sofía Martín , Gonzalo Martín , Álvaro Porto , Alejandro Ramos , John Wallace

This paper presents DIALOG (Digital Investigation Ontology); a framework for the management, reuse, and analysis of Digital Investigation knowledge. DIALOG provides a general, application independent vocabulary that can be used to describe…

Digital Libraries · Computer Science 2019-03-08 Damir Kahvedzic , Tahar Kechadi

Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems because they are often the only…

Software Engineering · Computer Science 2021-06-02 Shilin He , Pinjia He , Zhuangbin Chen , Tianyi Yang , Yuxin Su , Michael R. Lyu

Event sequence data record series of discrete events in the time order of occurrence. They are commonly observed in a variety of applications ranging from electronic health records to network logs, with the characteristics of large-scale,…

Human-Computer Interaction · Computer Science 2020-06-26 Yi Guo , Shunan Guo , Zhuochen Jin , Smiti Kaul , David Gotz , Nan Cao

Vision systems, i.e., systems that allow to detect and track objects in images, have gained substantial importance over the past decades. They are used in quality assurance applications, e.g., for finding surface defects in products during…

Software Engineering · Computer Science 2021-05-11 Franz Wotawa , Lorenz Klampfl , Ledio Jahaj

One of the most useful techniques to help visual data analysis systems is interactive filtering (brushing). However, visualization techniques often suffer from overlap of graphical items and multiple attributes complexity, making visual…

Graphics · Computer Science 2015-07-07 Jose Rodrigues , Luciana Romani , Agma Traina , Caetano Traina

Visual Analytics might be defined as data mining assisted by interactive visual interfaces. The field has been receiving prominent consideration by researchers, developers and the industry. The literature, however, is complex because it…

Computers and Society · Computer Science 2017-10-30 Renato Fabbri , Maria Cristina Ferreira de Oliveira

Graphical User Interface (GUI) agents are designed to automate complex tasks on digital devices, such as smartphones and desktops. Most existing GUI agents interact with the environment through extracted structured data, which can be…

Human-Computer Interaction · Computer Science 2024-02-26 Kanzhi Cheng , Qiushi Sun , Yougang Chu , Fangzhi Xu , Yantao Li , Jianbing Zhang , Zhiyong Wu

All methodologies for detecting plagiarism to date have focused on the final digital "outcome", such as a document or source code. Our novel approach takes the creation process into account using logged events collected by special software…

Other Computer Science · Computer Science 2017-07-21 Johannes Schneider , Avi Bernstein , Jan Vom Brocke , Kostadin Damevski , David C. Shepherd

The understanding of the behavioral aspects of a software system is an essential enabler for many software engineering activities, such as adaptation. This involves collecting runtime data from the system so that it is possible to analyze…

Software Engineering · Computer Science 2021-03-31 Jhonny Mertz , Ingrid Nunes

We introduce NeuralOS, a neural framework that simulates graphical user interfaces (GUIs) of operating systems by directly predicting screen frames in response to user inputs such as mouse movements, clicks, and keyboard events. NeuralOS…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Luke Rivard , Sun Sun , Hongyu Guo , Wenhu Chen , Yuntian Deng

Prior HCI studies often analyzed smartphone app usage data for usability and user experience research purposes. App usage videos are often collected by a screen recording app in order to better analyze the app usage behaviors (e.g., app…

Human-Computer Interaction · Computer Science 2022-05-31 Hansoo Lee , Sangwook Lee , Youngji Koh , Uichin Lee

One important step in software development is testing the finished product with actual users. These tests aim, among other goals, at determining unintuitive behavior of the software as it is presented to the end-user. Moreover, they aim to…

Software Engineering · Computer Science 2025-05-26 Tim Rosenbach , David Heidrich , Alexander Weinert

Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus forming higher-order perceptual units such as tab, menu, card or…

Human-Computer Interaction · Computer Science 2023-05-25 Mulong Xie , Zhenchang Xing , Sidong Feng , Chunyang Chen , Liming Zhu , Xiwei Xu

Context: Visual GUI testing (VGT) is referred to as the latest generation GUI-based testing. It is a tool-driven technique, which uses image recognition for interacting with and asserting the behavior of the system under test. Motivated by…

Computer system log data is commonly used in system monitoring, performance characteristic investigation, workflow modeling and anomaly detection. Log data is inherently unstructured or semi-structured, which makes it harder to understand…

Software Engineering · Computer Science 2022-02-16 Isuru Boyagane , Oshadha Katulanda , Surangika Ranathunga , Srinath Perera

Aesthetics or "look and feel" is one of the most important features of any graphical user interface. Better aesthetics makes the interface user-friendlier and more popular. Better aesthetics helps the user to understand the meaning of…

Human-Computer Interaction · Computer Science 2014-04-29 Umakant Mishra

VOSviewer is a computer program for creating, visualizing, and exploring bibliometric maps of science. In this report, the new text mining functionality of VOSviewer is presented. A number of examples are given of applications in which…

Digital Libraries · Computer Science 2011-09-12 Nees Jan van Eck , Ludo Waltman

The growing popularity and widespread adoption of large language models (LLMs) necessitates the development of tools that enhance the effectiveness of user interactions with these models. Understanding the structures and functions of these…

Human-Computer Interaction · Computer Science 2025-03-03 Divya Perumal , Swaroop Panda