中文
相关论文

相关论文: Preprocessing: A Prerequisite for Discovering Patt…

200 篇论文

Session data has been widely used for understanding user's behavior in e-commerce. Researchers are trying to leverage session data for different tasks, such as purchase intention prediction, remaining length prediction, recommendation,…

信息检索 · 计算机科学 2024-03-06 Zixuan Li , Lizi Liao , Yunshan Ma , Tat-Seng Chua

Data mining is the task of discovering interesting patterns from large amounts of data. There are many data mining tasks, such as classification, clustering, association rule mining, and sequential pattern mining. Sequential pattern mining…

数据库 · 计算机科学 2010-02-08 Mahdi Esmaeili , Fazekas Gabor

Consensus Sequences of event logs are often used in process mining to quickly grasp the core sequence of events to be performed in a process, or to represent the backbone of the process for doing other analyses. However, it is still not…

人工智能 · 计算机科学 2021-07-05 Zhichao Xu , Shuhong Chen

A significant portion of the effort involved in advanced process control, process analytics, and machine learning involves acquiring and preparing data. Literature often emphasizes increasingly complex modelling techniques with incremental…

系统与控制 · 电气工程与系统科学 2023-04-07 Lim C. Siang , Shams Elnawawi , Lee D. Rippon , Daniel L. O'Connor , R. Bhushan Gopaluni

Sensor monitoring networks and advances in big data analytics have guided the reliability engineering landscape to a new era of big machinery data. Low-cost sensors, along with the evolution of the internet of things and industry 4.0, have…

机器学习 · 统计学 2021-10-11 Sergio Cofre-Martel , Enrique Lopez Droguett , Mohammad Modarres

One of the first pre-processing steps for constructing web-scale LLM pretraining datasets involves extracting text from HTML. Despite the immense diversity of web content, existing open-source datasets predominantly apply a single fixed…

The web page usage mining plays a vital role in enriching the page's content and structure based on the feedbacks received from the user's interactions with the page. This paper proposes a model for micro-managing the tracking activities by…

信息检索 · 计算机科学 2012-03-13 K. S. Kuppusamy , G. Aghila

Advancements in artificial intelligence, machine learning, and deep learning have catalyzed the transformation of big data analytics and management into pivotal domains for research and application. This work explores the theoretical…

Process mining (PM) aims to construct, from event logs, process maps that can help discover, automate, improve, and monitor organizational processes. Robotic process automation (RPA) uses software robots to perform some tasks usually…

软件工程 · 计算机科学 2023-09-26 Najah Mary El-Gharib , Daniel Amyot

Artificial intelligence (AI) - and specifically machine learning (ML) - applications for climate prediction across timescales are proliferating quickly. The emergence of these methods prompts a revisit to the impact of data preprocessing, a…

Now a days, the text document is spontaneously increasing over the internet, e-mail and web pages and they are stored in the electronic database format. To arrange and browse the document it becomes difficult. To overcome such problem the…

计算与语言 · 计算机科学 2013-03-05 Leena H. Patil , Mohammed Atique

Pretraining data of large language models composes multiple domains (e.g., web texts, academic papers, codes), whose mixture proportions crucially impact the competence of outcome models. While existing endeavors rely on heuristics or…

计算与语言 · 计算机科学 2025-03-21 Jiasheng Ye , Peiju Liu , Tianxiang Sun , Jun Zhan , Yunhua Zhou , Xipeng Qiu

Data cleaning is a crucial yet challenging task in data analysis, often requiring significant manual effort. To automate data cleaning, previous systems have relied on statistical rules derived from erroneous data, resulting in low accuracy…

数据库 · 计算机科学 2024-10-22 Shuo Zhang , Zezhou Huang , Eugene Wu

The performance of large language models (LLMs) and large multimodal models (LMMs) depends heavily on the quality and scale of their pre-training datasets. Recent research shows that large multimodal models trained on natural documents…

Successful data-driven science requires complex data engineering pipelines to clean, transform, and alter data in preparation for machine learning, and robust results can only be achieved when each step in the pipeline can be justified, and…

数据库 · 计算机科学 2024-04-08 Adriane Chapman , Luca Lauro , Paolo Missier , Riccardo Torlone

Certainly, nowadays knowledge discovery or extracting knowledge from large amount of data is a desirable task in competitive businesses. Data mining is a main step in knowledge discovery process. Meanwhile frequent patterns play central…

数据库 · 计算机科学 2010-01-14 Mohammad Nadimi Shahraki , Norwati Mustapha , Md Nasir B Sulaiman , Ali B Mamat

Organizations routinely accumulate semi-structured log datasets generated as the output of code; these datasets remain unused and uninterpreted, and occupy wasted space - this phenomenon has been colloquially referred to as "data lake"…

数据库 · 计算机科学 2018-03-01 Yihan Gao , Silu Huang , Aditya Parameswaran

Pattern extraction algorithms are enabling insights into the ever-growing amount of today's datasets by translating reoccurring data properties into compact representations. Yet, a practical problem arises: With increasing data volumes and…

信息检索 · 计算机科学 2018-07-05 Michael Behrisch , Robert Krueger , Fritz Lekschas , Tobias Schreck , Nils Gehlenborg , Hanspeter Pfister

In a data warehousing process, the data preparation phase is crucial. Mastering this phase allows substantial gains in terms of time and performance when performing a multidimensional analysis or using data mining algorithms. Furthermore, a…

数据库 · 计算机科学 2007-05-23 Sami Miniaoui , Jérôme Darmont , Omar Boussaïd

Modern information and communication systems have become increasingly challenging to manage. The ubiquitous system logs contain plentiful information and are thus widely exploited as an alternative source for system management. As log files…

信息检索 · 计算机科学 2024-02-15 Tianzhu Zhang , Han Qiu , Gabriele Castellano , Myriana Rifai , Chung Shue Chen , Fabio Pianese