English
Related papers

Related papers: Algorithm and approaches to handle large Data- A S…

200 papers

Big data has been used widely in many areas including the transportation industry. Using various data sources, traffic states can be well estimated and further predicted for improving the overall operation efficiency. Combined with this…

Machine Learning · Computer Science 2022-02-21 Weiwei Jiang , Jiayun Luo

Since the mid 1990s, grid computing systems have emerged as an analogy for making computing power as pervasive an easily accessible as an electric power grid. Since then, grid computing systems have been shown to be able to provide very…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-29 Marco Guazzone

Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing…

Astrophysics · Physics 2007-05-23 Robert J. Brunner , S. George Djorgovski , Thomas A. Prince , Alex S. Szalay

This paper tries to throw light in the usage of data structures in the field of information retrieval. Information retrieval is an area of study which is gaining momentum as the need and urge for sharing and exploring information is growing…

Information Retrieval · Computer Science 2016-02-26 V. R. Kanagavalli , G. Maheeja

The advent of modern technology, permitting the measurement of thousands of characteristics simultaneously, has given rise to floods of data characterized by many large or even huge datasets. This new paradigm presents extraordinary…

Methodology · Statistics 2019-02-14 A. M. Pires , J. A. Branco

The Big Data management is a problem right now. The Big Data growth is very high. It is very difficult to manage due to various characteristics. This manuscript focuses on Big Data analytics in cloud environment using Hadoop. We have…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-17 Mansaf Alam , Kashish Ara Shakil

Traditional statistical and measurements are unable to solve all industrial data in the right way and appropriate time. Open markets mean the customers are increased, and production must increase to provide all customer requirements.…

General Economics · Economics 2020-11-26 Hamza Saad

The advent of the digital age has led to a rise in different types of data with every passing day. In fact, it is expected that half of the total data will be on the cloud by 2016. This data is complex and needs to be stored, processed and…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-20 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

The new age of digital growth has marked all fields. This technological evolution has impacted data flows which have witnessed a rapid expansion over the last decade that makes the data traditional processing unable to catch up with the…

Databases · Computer Science 2024-04-22 Rania Mkhinini Gahar , Olfa Arfaoui , Minyar Sassi Hidri

Many complex systems often contain interactions between more than two nodes, known as higher-order interactions, which can change the structure of these systems in significant ways. Researchers often assume that all interactions paint a…

Physics and Society · Physics 2024-02-16 Nicholas W. Landry , Ilya Amburg , Mirah Shi , Sinan G. Aksoy

The emergence of cloud computing has made dynamic provisioning of elastic capacity to applications on-demand. Cloud data centers contain thousands of physical servers hosting orders of magnitude more virtual machines that can be allocated…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Rajkumar Buyya , Kotagiri Ramamohanarao , Chris Leckie , Rodrigo N. Calheiros , Amir Vahid Dastjerdi , Steve Versteeg

The problem of frequent pattern mining has been studied quite extensively for various types of data, including sets, sequences, and graphs. Somewhat surprisingly, another important type of data, namely rank data, has received very little…

Machine Learning · Computer Science 2018-06-18 Sascha Henzgen , Eyke Hüllermeier

The need for new methods to deal with big data is a common theme in most scientific fields, although its definition tends to vary with the context. Statistical ideas are an essential part of this, and as a partial response, a thematic…

Advances in science are being sought in newly available opportunities to collect massive quantities of data about complex systems. While key advances are being made in detailed mapping of systems, how to relate this data to solving many of…

Physics and Society · Physics 2016-04-05 Yaneer Bar-Yam

People are facing a flood of data today. Data are being collected at unprecedented scale in many areas, such as networking, image processing, virtualization, scientific computation, and algorithms. The huge data nowadays are called Big…

Computers and Society · Computer Science 2015-05-05 Jianjun Yang , Ju Shen

Data-driven approaches, when tasked with situation awareness, are suitable for complex grids with massive datasets. It is a challenge, however, to efficiently turn these massive datasets into useful big data analytics. To address such a…

Methodology · Statistics 2018-01-18 Xing He , Lei Chu , Robert C. Qiu , Qian Ai , Zenan Ling

We have witnessed an exponential growth in commercial data services, which has lead to the 'big data era'. Machine learning, as one of the most promising artificial intelligence tools of analyzing the deluge of data, has been invoked in…

Networking and Internet Architecture · Computer Science 2019-12-16 Yuanwei Liu , Suzhi Bi , Zhiyuan Shi , Lajos Hanzo

A short overview of various algorithms and technologies that are helpful for big data storage and manipulation. Includes pointers to papers for further reading, and, where applicable, pointers to open source projects implementing a…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-04 Michael Bar-Sinai

This chapter addresses the forth paradigm of materials research -- big-data driven materials science. Its concepts and state-of-the-art are described, and its challenges and chances are discussed. For furthering the field, Open Data and an…

Materials Science · Physics 2019-04-12 Claudia Draxl , Matthias Scheffler

The great prosperity of big data systems such as Hadoop in recent years makes the benchmarking of these systems become crucial for both research and industry communities. The complexity, diversity, and rapid evolution of big data systems…

Performance · Computer Science 2015-06-05 Rui Han , Zhen Jia , Wanling Gao , Xinhui Tian , Lei Wang