English
Related papers

Related papers: Preprocessing: A Prerequisite for Discovering Patt…

200 papers

Log anomaly detection, which is critical for identifying system failures and preempting security breaches, detects irregular patterns within large volumes of log data, and impacts domains such as service reliability, performance…

Software Engineering · Computer Science 2025-11-19 Shenglin Zhang , Ziang Chen , Zijing Que , Yilun Liu , Yongqian Sun , Sicheng Wei , Dan Pei , Hailin Li

Recently, information systems like ERP, CRM and WFM record different business events or activities in a log named as event log. Process mining aims at extracting information from event logs to capture business process as it is being…

Software Engineering · Computer Science 2015-07-22 Saiqa Aleem , Luiz Fernando Capretz , Faheem Ahmed

Web usage mining: automatic discovery of patterns in clickstreams and associated data collected or generated as a result of user interactions with one or more Web sites. This paper describes web usage mining for our college log files to…

Databases · Computer Science 2013-10-10 Dhanamma Jagli , Sangeeta Oswal

Pretraining language models directly on web-scale corpora is the de facto paradigm. We study an alternative where the model is initially exposed to abstract structured data to ease the subsequent acquisition of rich semantic knowledge, much…

Computation and Language · Computer Science 2026-05-29 Liangze Jiang , Zachary Shinnick , Anton van den Hengel , Hemanth Saratchandran , Damien Teney

Raman spectroscopy's capability to provide meaningful composition predictions is heavily reliant on a pre-processing step to remove insignificant spectral variation. This is crucial in biofluid analysis. Widespread adoption of diagnostics…

Signal Processing · Electrical Eng. & Systems 2019-04-05 Emily E Storey , Amr S. Helmy

Process mining enables the reconstruction and evaluation of business processes based on digital traces in IT systems. An increasingly important technique in this context is process prediction. Given a sequence of events of an ongoing trace,…

Machine Learning · Computer Science 2021-06-09 Dominic A. Neu , Johannes Lahann , Peter Fettke

The main purpose of data mining and analytics is to find novel, potentially useful patterns that can be utilized in real-world applications to derive beneficial knowledge. For identifying and evaluating the usefulness of different kinds of…

Encoding methods are employed across several process mining tasks, including predictive process monitoring, anomalous case detection, trace clustering, etc. These methods are usually performed as preprocessing steps and are responsible for…

Machine Learning · Computer Science 2023-01-06 Sylvio Barbon , Paolo Ceravolo , Rafael S. Oyamada , Gabriel M. Tavares

Careful curation of data sources can significantly improve the performance of LLM pre-training, but predominant approaches rely heavily on intuition or costly trial-and-error, making them difficult to generalize across different data…

Machine Learning · Computer Science 2025-03-28 Thomson Yen , Andrew Wei Tung Siah , Haozhe Chen , Tianyi Peng , Daniel Guetta , Hongseok Namkoong

This thesis focuses on process mining on event data where such a normative specification is absent and, as a result, the event data is less structured. The thesis puts special emphasis on one application domain that fits this description:…

Artificial Intelligence · Computer Science 2019-09-05 Niek Tax

Data preparation aims to denoise raw datasets, uncover cross-dataset relationships, and extract valuable insights from them, which is essential for a wide range of data-centric applications. Driven by (i) rising demands for…

NetFlow data is a popular network log format used by many network analysts and researchers. The advantages of using NetFlow over deep packet inspection are that it is easier to collect and process, and it is less privacy intrusive. Many…

Machine Learning · Computer Science 2025-01-09 Clinton Cao , Annibale Panichella , Sicco Verwer , Agathe Blaise , Filippo Rebecchi

High-quality training data is fundamental to large language model (LLM) performance, yet existing preprocessing pipelines often struggle to effectively remove noise and unstructured content from web-scale corpora. This paper presents…

Computation and Language · Computer Science 2025-12-04 Gowtham , Sai Rupesh , Sanjay Kumar , Saravanan , Venkata Chaithanya

Software effort estimation requires high accuracy, but accurate estimations are difficult to achieve. Increasingly, data mining is used to improve an organization's software process quality, e. g. the accuracy of effort estimations . There…

Software Engineering · Computer Science 2013-10-22 Sumeet Kaur Sehra , Jasneet Kaur , Sukhjit Singh Sehra

Many existing data mining algorithms use feature values directly in their model, making them sensitive to units/scales used to measure/represent data. Pre-processing of data based on rank transformation has been suggested as a potential…

Machine Learning · Computer Science 2021-11-09 Arbind Agrahari Baniya , Sunil Aryal , Santosh KC

Large language models are trained on massive scrapes of the web, which are often unstructured, noisy, and poorly phrased. Current scaling laws show that learning from such data requires an abundance of both compute and data, which grows…

Computation and Language · Computer Science 2024-01-30 Pratyush Maini , Skyler Seto , He Bai , David Grangier , Yizhe Zhang , Navdeep Jaitly

Data preparation, especially data cleaning, is very important to ensure data quality and to improve the output of automated decision systems. Since there is no single tool that covers all steps required, a combination of tools -- namely a…

Databases · Computer Science 2023-08-29 Valerie Restat

We are in the era of data analytics and data science which is on full bloom. There is abundance of all kinds of data for example biometrics based data, satellite images data, chip-seq data, social network data, sensor based data etc. from a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Farhana Javed Zareen , Suraiya Jabin

Computer-based assessments routinely generate detailed interaction logs -- commonly referred to as process data -- that record every action a respondent performs during task completion, yet systematic preprocessing guidance, integrated…

Applications · Statistics 2026-04-21 Daeun Hwangbo , Junyeong Park , Minjeong Jeon , Ick Hoon Jin

Predictive Process Monitoring is a branch of process mining that aims to predict the outcome of an ongoing process. Recently, it leveraged machine-and-deep learning architectures. In this paper, we extend our prior LLM-based Predictive…

Artificial Intelligence · Computer Science 2026-01-19 Alessandro Padella , Massimiliano de Leoni , Marlon Dumas