English
Related papers

Related papers: Preprocessing Methods and Pipelines of Data Mining…

200 papers

The exploding growth of digital data in the information era and its immeasurable potential value has called for different types of data-driven techniques to exploit its value for further applications. Information visualization and data…

Graphics · Computer Science 2015-03-03 Keqian Li

The task of compression of data -- as stated by the source coding theorem -- is one of the cornerstones of information theory. Data compression usually exploits statistical redundancies in the data according to its prior distribution.…

Quantum Physics · Physics 2021-01-08 Matheus Capela , Fabio Costa

Large-scale datasets have played a crucial role in the advancement of computer vision. However, they often suffer from problems such as class imbalance, noisy labels, dataset bias, or high resource costs, which can inhibit model performance…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Zhijing Wan , Zhixiang Wang , CheukTing Chung , Zheng Wang

Data preprocessing is an important component of machine learning pipelines, which requires ample time and resources. An integral part of preprocessing is data transformation into the format required by a given learning algorithm. This paper…

Machine Learning · Computer Science 2020-10-30 Nada Lavrač , Blaž Škrlj , Marko Robnik-Šikonja

Process mining techniques help to improve processes using event data. Such data are widely available in information systems. However, they often contain highly sensitive information. For example, healthcare information systems record event…

Databases · Computer Science 2021-05-26 Majid Rafiei , Wil M. P. van der Aalst

Data Mining deals extracting hidden knowledge, unexpected pattern and new rules from large database. Various customized data mining tools have been developed for domain specific applications such as Biomedicine, DNA analysis and…

Databases · Computer Science 2010-03-11 Sabyasachi Pattanaik , Partha Pratim Ghosh

Data mining is the way toward mining fascinating patterns or information from an enormous level of the database. Data mining additionally opens another risk to privacy and data security.One of the maximum significant themes in the research…

Cryptography and Security · Computer Science 2023-05-01 Dhinakaran D , Joe Prathap P. M

Data engineering pipelines are a widespread way to provide high-quality data for all kinds of data science applications. However, numerous challenges still remain in the composition and operation of such pipelines. Data engineering…

Databases · Computer Science 2025-07-30 Kevin M. Kramer , Valerie Restat , Sebastian Strasser , Uta Störl , Meike Klettke

Process mining aims to diagnose and improve operational processes. Process mining techniques allow analyzing the event data generated and recorded during the execution of (business) processes to gain valuable insights. Process discovery is…

Databases · Computer Science 2021-08-03 Daniel Schuster , Sebastiaan J. van Zelst , Wil M. P. van der Aalst

Data preparation, i.e. the process of transforming raw data into a format that can be used for training effective machine learning models, is a tedious and time-consuming task. For image data, preprocessing typically involves a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Tran Ngoc Minh , Mathieu Sinn , Hoang Thanh Lam , Martin Wistuba

Data Cleaning refers to the process of detecting and fixing errors in the data. Human involvement is instrumental at several stages of this process, e.g., to identify and repair errors, to validate computed repairs, etc. There is currently…

Databases · Computer Science 2018-01-03 El Kindi Rezig , Mourad Ouzzani , Ahmed K. Elmagarmid , Walid G. Aref

As we know that the normalization is a pre-processing stage of any type problem statement. Especially normalization takes important role in the field of soft computing, cloud computing etc. for manipulation of data like scale down or scale…

Other Computer Science · Computer Science 2015-03-24 S. Gopal Krishna Patro , Kishore Kumar Sahu

Since many years, theoretical concepts of Data Mining have been developed and improved. Data Mining has become applied to many academic and industrial situations, and recently, soundings of public opinion about privacy have been carried…

Symbolic Computation · Computer Science 2008-09-17 Christoph Schommer

Process mining (PM) aims to construct, from event logs, process maps that can help discover, automate, improve, and monitor organizational processes. Robotic process automation (RPA) uses software robots to perform some tasks usually…

Software Engineering · Computer Science 2023-09-26 Najah Mary El-Gharib , Daniel Amyot

The aim of dataset distillation is to encode the rich features of an original dataset into a tiny dataset. It is a promising approach to accelerate neural network training and related studies. Different approaches have been proposed to…

Machine Learning · Computer Science 2023-05-30 Zongxiong Chen , Jiahui Geng , Derui Zhu , Herbert Woisetschlaeger , Qing Li , Sonja Schimmler , Ruben Mayer , Chunming Rong

Data distillation is the problem of reducing the volume oftraining data while keeping only the necessary information. With thispaper, we deeper explore the new data distillation algorithm, previouslydesigned for image data. Our experiments…

Machine Learning · Computer Science 2020-10-21 Dmitry Medvedev , Alexander D'yakonov

Data pruning is the problem of identifying a core subset that is most beneficial to training and discarding the remainder. While pruning strategies are well studied for discriminative models like those used in classification, little…

Machine Learning · Computer Science 2025-03-17 Rania Briq , Jiangtao Wang , Stefan Kesselheim

Data Pipeline plays an indispensable role in tasks such as modeling machine learning and developing data products. With the increasing diversification and complexity of Data sources, as well as the rapid growth of data volumes, building an…

Machine Learning · Computer Science 2024-02-21 Jiang Wu , Hongbo Wang , Chunhe Ni , Chenwei Zhang , Wenran Lu

World wide technological advancement has brought in a widespread change in adoption and utilization of open source tools. Since, most of the organizations across the globe deal with a large amount of data to be updated online and…

Databases · Computer Science 2012-10-04 Sharon Christa , K. Lakshmi Madhuri , V. Suma

The wide use of machine learning is fundamentally changing the software development paradigm (a.k.a. Software 2.0) where data becomes a first-class citizen, on par with code. As machine learning is used in sensitive applications, it becomes…

Databases · Computer Science 2019-04-25 Ki Hyun Tae , Yuji Roh , Young Hun Oh , Hyunsu Kim , Steven Euijong Whang