English
Related papers

Related papers: Preprocessing: A Prerequisite for Discovering Patt…

200 papers

The data preprocessing stage is crucial in clustering. Features may describe entities using different scales. To rectify this, one usually applies feature normalisation aiming at rescaling features so that none of them overpowers the others…

Machine Learning · Computer Science 2021-04-26 Renato Cordeiro de Amorim , Vladimir Makarenkov

This paper describes the approach of the THUIR team at the WSDM Cup 2023 Pre-training for Web Search task. This task requires the participant to rank the relevant documents for each query. We propose a new data pre-processing method and…

Information Retrieval · Computer Science 2023-03-09 Haitao Li , Jia Chen , Weihang Su , Qingyao Ai , Yiqun Liu

Industrial applications of machine learning face unique challenges due to the nature of raw industry data. Preprocessing and preparing raw industrial data for machine learning applications is a demanding task that often takes more time and…

Machine Learning · Computer Science 2021-09-09 Philipp Fleck , Manfred Kügel , Michael Kommenda

Data mining algorithms are now able to efficiently deal with huge amount of data. Various kinds of patterns may be discovered and may have some great impact on the general development of knowledge. In many domains, end users may want to…

Artificial Intelligence · Computer Science 2009-02-09 Baptiste Jeudy , Christine Largeron , François Jacquenet

Log parsing, which involves log template extraction from semi-structured logs to produce structured logs, is the first and the most critical step in automated log analysis. However, current log parsers suffer from limited effectiveness for…

Software Engineering · Computer Science 2024-03-01 Junjielong Xu , Ruichun Yang , Yintong Huo , Chengyu Zhang , Pinjia He

Pattern extraction algorithms are enabling insights into the ever-growing amount of today's datasets by translating reoccurring data properties into compact representations. Yet, a practical problem arises: With increasing data volumes and…

Information Retrieval · Computer Science 2018-07-05 Michael Behrisch , Robert Krueger , Fritz Lekschas , Tobias Schreck , Nils Gehlenborg , Hanspeter Pfister

Artificial intelligence (AI) - and specifically machine learning (ML) - applications for climate prediction across timescales are proliferating quickly. The emergence of these methods prompts a revisit to the impact of data preprocessing, a…

Advancements in artificial intelligence, machine learning, and deep learning have catalyzed the transformation of big data analytics and management into pivotal domains for research and application. This work explores the theoretical…

Web Data Extraction is an important problem that has been studied by means of different scientific tools and in a broad range of applications. Many approaches to extracting data from the Web have been designed to solve specific problems and…

Information Retrieval · Computer Science 2017-03-07 Emilio Ferrara , Pasquale De Meo , Giacomo Fiumara , Robert Baumgartner

Recent advancements in code large language models (Code-LLMs) have demonstrated remarkable capabilities in resolving programming related tasks. Meanwhile, researchers have recognized that the quality of pre-training data is crucial for…

Software Engineering · Computer Science 2026-04-10 Chengli Xing , Zhengran Zeng , Gexiang Fang , Rui Xie , Wei Ye , Shikun Zhang

Web Usage Mining is an application of Data Mining Techniques to discover interesting usage patterns from web data in order to understand and better serve the needs of web-based applications. The paper proposes an algorithm for finding these…

Artificial Intelligence · Computer Science 2018-05-01 Pritish Yuvraj , Suneetha K. R

Successful data-driven science requires complex data engineering pipelines to clean, transform, and alter data in preparation for machine learning, and robust results can only be achieved when each step in the pipeline can be justified, and…

Databases · Computer Science 2024-04-08 Adriane Chapman , Luca Lauro , Paolo Missier , Riccardo Torlone

Process mining methods allow analysts to use logs of historical executions of business processes in order to gain knowledge about the actual behavior of these processes. One of the most widely studied process mining operations is automated…

Software Engineering · Computer Science 2018-06-11 Fabrizio Maria Maggi , Andrea Marrella , Fredrik Milani , Allar Soo , Silva Kasela

Web forms are one of the primary ways to collect personal information online, yet they are relatively under-studied. Unlike web tracking, data collection through web forms is explicit and contextualized. Users (i) are asked to input…

Cryptography and Security · Computer Science 2024-08-30 Hao Cui , Rahmadi Trimananda , Athina Markopoulou

The performance of a large language model (LLM) depends heavily on the quality and size of its pretraining dataset. However, the pretraining datasets for state-of-the-art open LLMs like Llama 3 and Mixtral are not publicly available and…

Computation and Language · Computer Science 2024-11-01 Guilherme Penedo , Hynek Kydlíček , Loubna Ben allal , Anton Lozhkov , Margaret Mitchell , Colin Raffel , Leandro Von Werra , Thomas Wolf

Process mining is a new emerging research trend over the last decade which focuses on analyzing the processes using event log and data. The raising integration of information systems for the operation of business processes provides the…

Software Engineering · Computer Science 2019-09-16 B. Kamala

Workflow technology is rapidly evolving and, rather than being limited to modeling the control flow in business processes, is becoming a key mechanism to perform advanced data management, such as big data analytics. This survey focuses on…

Databases · Computer Science 2017-01-27 Georgia Kougka , Anastasios Gounaris , Alkis Simitsis

Text classification is a significant branch of natural language processing, and has many applications including document classification and sentiment analysis. Unsurprisingly, those who do text classification are concerned with the run-time…

Computation and Language · Computer Science 2021-04-09 Wilson Fearn , Orion Weller , Kevin Seppi

Despite recent advancements in automatic summarization, state-of-the-art models do not summarize all documents equally well, raising the question: why? While prior research has extensively analyzed summarization models, little attention has…

Computation and Language · Computer Science 2025-04-09 Steven Koniaev , Ori Ernst , Jackie Chi Kit Cheung

Process discovery aims to discover descriptive process models from event logs. These discovered process models depict the actual execution of a process and serve as a foundational element for conformance checking, performance analyses, and…

Formal Languages and Automata Theory · Computer Science 2024-09-02 Ali Norouzifar , Marcus Dees , Wil van der Aalst