English
Related papers

Related papers: Algorithm and approaches to handle large Data- A S…

200 papers

The digital revolution has led to the digitization of human behavior, creating unprecedented opportunities to understand observable actions on an unmatched scale. Emerging phenomena such as crowdfunding and crowdsourcing have further…

Machine Learning · Computer Science 2023-06-27 Hannah H. Chang , Anirban Mukherjee

Process mining, as a high-level field in data mining, plays a crucial role in enhancing operational efficiency and decision-making across organizations. In this survey paper, we delve into the growing significance and ongoing trends in the…

Artificial Intelligence · Computer Science 2024-07-17 Yiyuan Yang , Zheshun Wu , Yong Chu , Zhenghua Chen , Zenglin Xu , Qingsong Wen

Recent advances in data science, machine learning, and artificial intelligence, such as the emergence of large language models, are leading to an increasing demand for data that can be processed by such models. While data sources are…

Machine Learning · Computer Science 2023-09-13 Paul Bilokon , Oleksandr Bilokon , Saeed Amen

The process of data mining produces various patterns from a given data source. The most recognized data mining tasks are the process of discovering frequent itemsets, frequent sequential patterns, frequent sequential rules and frequent…

Databases · Computer Science 2014-02-13 Thabet Slimani , Amor Lazzez

Today, data guides the decision-making process of most companies. Effectively analyzing and manipulating data at scale to extract and exploit relevant knowledge is a challenging task, due to data characteristics such as its size, the rate…

Software Engineering · Computer Science 2025-03-24 Arianna Dragoni , Alessandro Margara

Workflow is a common term used to describe a systematic breakdown of tasks that need to be performed to solve a problem. This concept has found best use in scientific and business applications for streamlining and improving the performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-08 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

Our world produces massive data every day; they exist in diverse forms, from pairwise data and matrix to time series and trajectories. Meanwhile, we have access to the versatile toolkit of network analysis. Networks also have different…

Social and Information Networks · Computer Science 2017-12-29 Jian Xu

Network Traffic Monitoring and Analysis (NTMA) represents a key component for network management, especially to guarantee the correct operation of large-scale networks such as the Internet. As the complexity of Internet services and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-11 Alessandro D'Alconzo , Idilio Drago , Andrea Morichetta , Marco Mellia , Pedro Casas

Discovering patterns from data is an important task in data mining. There exist techniques to find large collections of many kinds of patterns from data very efficiently. A collection of patterns can be regarded as a summary of the data. A…

Databases · Computer Science 2007-05-23 Taneli Mielikäinen

Working with big data using data mining tools is rapidly becoming a trend in education industry. The combination of the current capacity to collect, store, manage and process data in a timely manner, and data from online educational…

Computation and Language · Computer Science 2022-07-22 Vahid Ashrafimoghari

High-throughput computational materials design promises to greatly accelerate the process of discovering new materials and compounds, and of optimizing their properties. The large databases of structures and properties that result from…

Chemical Physics · Physics 2016-11-22 Sandip De , Felix Musil , Teresa Ingram , Carsten Baldauf , Michele Ceriotti

The development of modern information technologies permits to collect and to analyze huge amounts of statistical data in different spheres of life. The main problem is not to only to collect but to process all relevant information. The…

Information Retrieval · Computer Science 2010-07-08 O. Mryglod , Yu. Holovatch

Big data are data on a massive scale in terms of volume, intensity, and complexity that exceed the capacity of standard software tools. They present opportunities as well as challenges to statisticians. The role of computational…

Computation · Statistics 2018-06-13 Chun Wang , Ming-Hui Chen , Elizabeth Schifano , Jing Wu , Jun Yan

In the context of big data analysis, the divide-and-conquer methodology refers to a multiple-step process: first splitting a data set into several smaller ones; then analyzing each set separately; finally combining results from each…

Machine Learning · Statistics 2021-02-23 Xueying Chen , Jerry Q. Cheng , Min-ge Xie

Algorithm design is crucial for effective problem-solving across various domains. The advent of Large Language Models (LLMs) has notably enhanced the automation and innovation within this field, offering new perspectives and promising…

Machine Learning · Computer Science 2026-01-06 Fei Liu , Yiming Yao , Ping Guo , Zhiyuan Yang , Zhe Zhao , Xi Lin , Xialiang Tong , Kun Mao , Zhichao Lu , Zhenkun Wang , Mingxuan Yuan , Qingfu Zhang

The data mining process consists of a series of steps ranging from data cleaning, data selection and transformation, to pattern evaluation and visualization. One of the central problems in data mining is to make the mined patterns or…

Databases · Computer Science 2007-05-23 Zengyou He , Xiaofei Xu , Shengchun Deng

Very large data sets are the common rule in automated mapping, GIS, remote sensing, and what we can name geo-information. Indeed, in 1983 Landsat was already delivering gigabytes of data, and other sensors were in orbit or ready for launch,…

Databases · Computer Science 2015-01-21 Robert Jeansoulin

Over the past two decades, we have witnessed an exponential increase of data production in the world. So-called big data generally come from transactional systems, and even more so from the Internet of Things and social media. They are…

Databases · Computer Science 2021-07-26 Pegdwendé Sawadogo , Jérôme Darmont

Data is crucial for machine learning (ML) applications, yet acquiring large datasets can be costly and time-consuming, especially in complex, resource-intensive fields like biopharmaceuticals. A key process in this industry is upstream…

Machine Learning · Computer Science 2025-06-23 Johnny Peng , Thanh Tung Khuat , Katarzyna Musial , Bogdan Gabrys

The process of preparing potentially large and complex data sets for further analysis or manual examination is often called data wrangling. In classical warehousing environments, the steps in such a process have been carried out using…