English
Related papers

Related papers: Geospatial Big Data Handling with High Performance…

200 papers

High Performance Computing is an internet based computing which makes computer infrastructure and services available to the user for research purpose. However, an important issue which needs to be resolved before High Performance Computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-13 Vivek Chalotra , Anju Bhasin , Anik Gupta , Sanjeev Singh Sambyal , Sanjay Mahajan

With continued advances in Geographic Information Systems and related computational technologies, statisticians are often required to analyze very large spatial datasets. This has generated substantial interest over the last decade, already…

Methodology · Statistics 2019-05-14 Lu Zhang , Abhirup Datta , Sudipto Banerjee

Neuroscience models commonly have a high number of degrees of freedom and only specific regions within the parameter space are able to produce dynamics of interest. This makes the development of tools and strategies to efficiently find…

Human beings keep exploring the physical space using information means. Only recently, with the rapid development of information technologies and the increasing accumulation of data, human beings can learn more about the unknown world with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-24 Tongya Zheng , Gang Chen , Xinyu Wang , Chun Chen , Xingen Wang , Sihui Luo

This paper argues that there has not been enough discussion in the field of applications of Gaussian Process for the fast moving consumer goods industry. Yet, this technique can be important as it e.g., can provide automatic feature…

Applications · Statistics 2017-09-19 Rodrigo Rivera , Evgeny Burnaev

This study reviews the topic of big data management in the 21st-century. There are various developments that have facilitated the extensive use of that form of data in different organizations. The most prominent beneficiaries are internet…

Computers and Society · Computer Science 2015-09-08 Okal Christopher Otieno

Data is arguably the most valuable asset of the modern world. In this era, the success of any data-intensive solution relies on the quality of data that drives it. Among vast amount of data that are captured, managed, and analyzed everyday,…

Databases · Computer Science 2019-06-28 Nima Miryeganeh , Mehdi Amoui , Hadi Hemmati

Due to the development of internet technology and computer science, data is exploding at an exponential rate. Big data brings us new opportunities and challenges. On the one hand, we can analyze and mine big data to discover hidden…

Databases · Computer Science 2020-05-12 Zhicheng Liu , Aoqian Zhang

As supercomputers grow in size and complexity, power efficiency has become a critical challenge, particularly in understanding GPU power consumption within modern HPC workloads. This work addresses this challenge by presenting a data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-22 Melanie Cornelius , Greg Cross , Shilpika Shilpika , Matthew T. Dearing , Zhiling Lan

This chapter details how Big Data can be used and implemented in networking and computing infrastructures. Specifically, it addresses three main aspects: the timely extraction of relevant knowledge from heterogeneous, and very often…

Networking and Internet Architecture · Computer Science 2016-01-26 Jose Moura , Fernando Batista , Elsa Cardoso , Luis Nunes

This paper describes an automated approach to handling Big Data workloads on HPC systems. We describe a solution that dynamically creates a unified cluster based on YARN in an HPC Environment, without the need to configure and allocate a…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-01 Sidharth N. Kashyap , Ade J. Fewings , Jay Davies , Ian Morris , Andrew Thomas Thomas Green , Martyn F. Guest

Due to the surge of spatio-temporal data volume, the popularity of location-based services and applications, and the importance of extracted knowledge from spatio-temporal data to solve a wide range of real-world problems, a plethora of…

Machine Learning · Computer Science 2021-03-19 Md Mahbub Alam , Luis Torgo , Albert Bifet

At large scales, quantum systems may become advantageous over their classical counterparts at performing certain tasks. Developing tools to analyse these systems at the relevant scales, in a manner consistent with quantum mechanics, is…

Quantum Physics · Physics 2024-11-12 Timon Schapeler , Robert Schade , Michael Lass , Christian Plessl , Tim J. Bartley

In recent past, big data opportunities have gained much momentum to enhance knowledge management in organizations. However, big data due to its various properties like high volume, variety, and velocity can no longer be effectively stored…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-16 Mohammad Shorfuzzaman

Astrophysics and cosmology are rich with data. The advent of wide-area digital cameras on large aperture telescopes has led to ever more ambitious surveys of the sky. Data volumes of entire surveys a decade ago can now be acquired in a…

Instrumentation and Methods for Astrophysics · Physics 2017-04-18 Jan Kremer , Kristoffer Stensbo-Smidt , Fabian Gieseke , Kim Steenstrup Pedersen , Christian Igel

The distributed computing is done on many systems to solve a large scale problem. The growing of high-speed broadband networks in developed and developing countries, the continual increase in computing power, and the rapid growth of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-14 Dr. Brijender Kahanwal , Dr. T. P. Singh

This paper describes and discusses our vision to develop and reason about best practices and novel ways of curating data-centric geosciences knowledge (data, experiments, models, methods, conclusions, and interpretations). This knowledge is…

The exponential growth of floating point power in graphics processing units (GPUs), together with their low cost, has given rise to an attractive platform upon which to deploy lattice QCD calculations. GPUs are essentially many (O(100))…

High Energy Physics - Lattice · Physics 2010-11-05 M. A. Clark

Parallel processing, the core of High Performance Computing (HPC), was and still the most effective way in improving the speed of computer systems. For the past few years, the substantial developments in the computing power of processors…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-15 Samouriq Difrawi

Big data are data on a massive scale in terms of volume, intensity, and complexity that exceed the capacity of standard software tools. They present opportunities as well as challenges to statisticians. The role of computational…

Computation · Statistics 2018-06-13 Chun Wang , Ming-Hui Chen , Elizabeth Schifano , Jing Wu , Jun Yan