English
Related papers

Related papers: Preprocessing: A Prerequisite for Discovering Patt…

200 papers

Data preprocessing techniques are devoted to correct or alleviate errors in data. Discretization and feature selection are two of the most extended data preprocessing techniques. Although we can find many proposals for static Big Data…

Databases · Computer Science 2018-10-16 Alejandro Alcalde-Barros , Diego García-Gil , Salvador García , Francisco Herrera

Prefetching web pages is a well-studied solution to reduce network latency by predicting users' future actions based on their past behaviors. However, such techniques are largely unexplored on mobile platforms. Today's privacy regulations…

Software Engineering · Computer Science 2021-03-25 Yixue Zhao , Siwei Yin , Adriana Sejfia , Marcelo Schmitt Laser , Haoyu Wang , Nenad Medvidovic

Nowadays, the Web has become one of the most widespread platforms for information change and retrieval. As it becomes easier to publish documents, as the number of users, and thus publishers, increases and as the number of documents grows,…

Information Retrieval · Computer Science 2013-07-04 Abdelhakim Herrouz , Chabane Khentout , Mahieddine Djoudi

Predicting critical health outcomes such as patient mortality and hospital readmission is essential for improving survivability. However, healthcare datasets have many concurrences that create complexities, leading to poor predictions.…

Machine Learning · Computer Science 2024-07-04 Negin Ashrafi , Armin Abdollahi , Greg Placencia , Maryam Pishgar

This work focuses on leveraging and selecting from vast, unlabeled, open data to pre-fine-tune a pre-trained language model. The goal is to minimize the need for costly domain-specific data for subsequent fine-tuning while achieving desired…

Machine Learning · Computer Science 2024-05-07 Feiyang Kang , Hoang Anh Just , Yifan Sun , Himanshu Jahagirdar , Yuanzhi Zhang , Rongxing Du , Anit Kumar Sahu , Ruoxi Jia

Data quality has become a key factor in enhancing model performance with the rapid development of large language models (LLMs). Model-driven data filtering has increasingly become a primary approach for acquiring high-quality data. However,…

Computation and Language · Computer Science 2025-05-09 Yudong Wang , Zixuan Fu , Jie Cai , Peijun Tang , Hongya Lyu , Yewei Fang , Zhi Zheng , Jie Zhou , Guoyang Zeng , Chaojun Xiao , Xu Han , Zhiyuan Liu

Hosting database services on cloud systems has become a common practice. This has led to the increasing volume of database workloads, which provides the opportunity for pattern analysis. Discovering workload patterns from a business logic…

Databases · Computer Science 2023-07-07 Jiaqi Wang , Tianyi Li , Anni Wang , Xiaoze Liu , Lu Chen , Jie Chen , Jianye Liu , Junyang Wu , Feifei Li , Yunjun Gao

The web contains large-scale, diverse, and abundant information to satisfy the information-seeking needs of humans. Through meticulous data collection, preprocessing, and curation, webpages can be used as a fundamental data resource for…

Computation and Language · Computer Science 2024-06-18 Zhipeng Xu , Zhenghao Liu , Yukun Yan , Zhiyuan Liu , Ge Yu , Chenyan Xiong

The performance of large language models (LLMs) and large multimodal models (LMMs) depends heavily on the quality and scale of their pre-training datasets. Recent research shows that large multimodal models trained on natural documents…

Computation and Language · Computer Science 2025-11-11 Khalil Hennara , Ahmad Bastati , Muhammad Hreden , Mohamed Motasim Hamed , Zeina Aldallal , Sara Chrouf , Safwan AlModhayan

Data preprocessing is a fundamental part of any machine learning application and frequently the most time-consuming aspect when developing a machine learning solution. Preprocessing for deep learning is characterized by pipelines that…

Machine Learning · Computer Science 2018-01-11 S. Maetschke , R. Tennakoon , C. Vecchiola , R. Garnavi

Currently, the world is witnessing a mounting avalanche of data due to the increasing number of mobile network subscribers, Internet websites, and online services. This trend is continuing to develop in a quick and diverse manner in the…

Networking and Internet Architecture · Computer Science 2018-02-12 Mohammed S. Hadi , Ahmed Q. Lawey , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

World Wide Web is a huge data repository and is growing with the explosive rate of about 1 million pages a day. As the information available on World Wide Web is growing the usage of the web sites is also growing. Web log records each…

Information Retrieval · Computer Science 2009-08-03 Ratnesh Kumar Jain , Dr. R. S. Kasana , Dr. Suresh Jain

Modern developments in digital media technologies has made transmitting and storing large amounts of multi/rich media data (e.g. text, images, music, video and their combination) more feasible and affordable than ever before. However, the…

Multimedia · Computer Science 2011-09-07 Pravin M. Kamde , Dr. Siddu. P. Algur

Process mining provides techniques to improve the performance and compliance of operational processes. Although sometimes the term "workflow mining" is used, the application in the context of Workflow Management (WFM) and Business Process…

Software Engineering · Computer Science 2020-09-15 Alessandro Berti , Wil van der Aalst , David Zang , Magdalena Lang

In this paper, we consider the applications of process mining in intrusion detection. We propose a novel process mining inspired algorithm to be used to preprocess data in intrusion detection systems (IDS). The algorithm is designed to…

Cryptography and Security · Computer Science 2022-05-25 Yinzheng Zhong , John Y. Goulermas , Alexei Lisitsa

The ability of the foundation models heavily relies on large-scale, diverse, and high-quality pretraining data. In order to improve data quality, researchers and practitioners often have to manually curate datasets from difference sources…

Machine Learning · Computer Science 2024-04-24 Yiding Sun , Feng Wang , Yutao Zhu , Wayne Xin Zhao , Jiaxin Mao

Discovering patterns from data is an important task in data mining. There exist techniques to find large collections of many kinds of patterns from data very efficiently. A collection of patterns can be regarded as a summary of the data. A…

Databases · Computer Science 2007-05-23 Taneli Mielikäinen

One of the most valuable assets of an organization is its organizational data. The analysis and mining of this potential hidden treasure can lead to much added-value for the organization. Process mining is an emerging area that can be…

Software Engineering · Computer Science 2016-07-05 Asef Pourmasoumi , Ebrahim Bagheri

Sensor monitoring networks and advances in big data analytics have guided the reliability engineering landscape to a new era of big machinery data. Low-cost sensors, along with the evolution of the internet of things and industry 4.0, have…

Machine Learning · Statistics 2021-10-11 Sergio Cofre-Martel , Enrique Lopez Droguett , Mohammad Modarres

Data preprocessing is an important component of machine learning pipelines, which requires ample time and resources. An integral part of preprocessing is data transformation into the format required by a given learning algorithm. This paper…

Machine Learning · Computer Science 2020-10-30 Nada Lavrač , Blaž Škrlj , Marko Robnik-Šikonja