English
Related papers

Related papers: Exploiting Data Reduction Principles in Cloud-Base…

200 papers

A common task in scientific computing is the derivation of data. This workflow extracts the most important information from large input data and stores it in smaller derived data objects. The derived data objects can then be used for…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-10 Tobias Wegner , Mario Lassnig , Peer Ueberholz , Christian Zeitnitz

We discuss the technical challenges we faced and the techniques we used to overcome them when reducing the PHAT photometric data set on the Amazon Elastic Compute Cloud (EC2). We first describe the architecture of our photometry pipeline,…

Instrumentation and Methods for Astrophysics · Physics 2018-05-23 Benjamin F. Williams , Knut Olsen , Rubab Khan , Daniel Pirone , Keith Rosema

Web browsers are increasingly used as middleware platforms offering a central access point for service provision. Using backend containerization, RESTful APIs, and distributed computing allows for complex systems to be realized that address…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-03 Rudolph Pienaar , Ata Turk , Jorge Bernal-Rusiel , Nicolas Rannou , Daniel Haehn , P. Ellen Grant , Orran Krieger

Data cubes are widely used as a powerful tool to provide multidimensional views in data warehousing and On-Line Analytical Processing (OLAP). However, with increasing data sizes, it is becoming computationally expensive to perform data cube…

Databases · Computer Science 2013-11-25 Zhengkui Wang , Yan Chu , Kian-Lee Tan , Divyakant Agrawal , Amr EI Abbadi , Xiaolong Xu

Cloud computing has radically changed the way organisations operate their software by allowing them to achieve high availability of services at affordable cost. Containerized microservices is an enabling technology for this change, and…

Recent efforts to design and develop Cloud technologies focus on defining novel methods, policies and mechanisms for efficiently managing Cloud infrastructures. One key challenge potential Cloud customers have before renting resources is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-11 Dr. Rahul Malhotra , Prince Jain

In recent past, big data opportunities have gained much momentum to enhance knowledge management in organizations. However, big data due to its various properties like high volume, variety, and velocity can no longer be effectively stored…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-16 Mohammad Shorfuzzaman

Energy consumption of Cloud data centers has been a major concern of many researchers, and one of the reasons for huge energy consumption of Clouds lies in the inefficient utilization of computing resources. Besides energy consumption,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-26 Minxian Xu , Adel Nadjaran Toosi , Rajkumar Buyya

Single-particle cryo-electron microscopy (cryo-EM) has become one of the mainstream structural biology techniques because of its ability to determine high-resolution structures of dynamic bio-molecules. However, cryo-EM data acquisition…

Machine Learning · Computer Science 2022-04-18 Quanfu Fan , Yilai Li , Yuguang Yao , John Cohn , Sijia Liu , Seychelle M. Vos , Michael A. Cianfrocco

Design and architecture of cloud storage system plays a vital role in cloud computing infrastructure in order to improve the storage capacity as well as cost effectiveness. Usually cloud storage system provides users to efficient storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-12-12 Tin Tin Yee , Thinn Thu Naing

Cloud computing is a powerful new technology that is widely used in the business world. Recently, we have been investigating the benefits it offers to scientific computing. We have used three workflow applications to compare the performance…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 G. Bruce Berriman , Ewa Deelman , Gideon Juve , Moira Regelson , Peter Plavchan

Cloud computing is an established technology allowing users to share resources on a large scale, never before seen in IT history. A cloud system connects multiple individual servers in order to process related tasks in several environments…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Leszek Sliwko

MapReduce has proven to be one of the most useful paradigms in the revolution of distributed computing, where cloud services and cluster computing become the standard venue for computing. The federation of cloud and big data activities is…

Databases · Computer Science 2016-07-29 Foto Afrati , Shlomi Dolev , Shantanu Sharma , Jeffrey D. Ullman

Cloud Computing researches involve a tremendous amount of entities such as users, applications, and virtual machines. Due to the limited access and often variable availability of such resources, researchers have their prototypes tested…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-18 Pradeeban Kathiravelu

As the data size in Machine Learning fields grows exponentially, it is inevitable to accelerate the computation by utilizing the ever-growing large number of available cores provided by high-performance computing hardware. However, existing…

Machine Learning · Computer Science 2021-04-23 Kun Li , Liang Yuan , Yunquan Zhang , Gongwei Chen

The emergence of cloud computing has made dynamic provisioning of elastic capacity to applications on-demand. Cloud data centers contain thousands of physical servers hosting orders of magnitude more virtual machines that can be allocated…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Rajkumar Buyya , Kotagiri Ramamohanarao , Chris Leckie , Rodrigo N. Calheiros , Amir Vahid Dastjerdi , Steve Versteeg

Today, huge amounts of data are being collected with spatial and temporal components from sources such as meteorological, satellite imagery etc. Efficient visualisation as well as discovery of useful knowledge from these datasets is…

Databases · Computer Science 2017-03-31 Nhien-An Le-Khac , Martin Bue , Michael Whelan , Tahar Kechadi

In single-particle cryo-electron microscopy (cryo-EM), K-means clustering algorithm is widely used in unsupervised 2D classification of projection images of biological macromolecules. 3D ab initio reconstruction requires accurate…

Quantitative Methods · Quantitative Biology 2017-01-03 Yaofang Xu , Jiayi Wu , Chang-Cheng Yin , Youdong Mao

Nowadays, the rapid increases of the scale and complexity of the controlled plants bring new challenges such as computing power and storage for conventional control systems. Cloud computing is concerned as a powerful solution to handle the…

Systems and Control · Electrical Eng. & Systems 2023-03-06 Runze Gao , Yuanqing Xia , Li Dai , Zhongqi Sun

Leveraging their eBird crowdsourcing project, the Cornell Lab of Ornithology generates sophisticated Spatio-Temporal Exploratory Model (STEM) maps of bird migrations. Such maps are highly relevant for both scientific and educational…

Computers and Society · Computer Science 2017-10-25 N. Cherel , J. Reesman , A. Sahuguet , T. Auer , D. Fink