English
Related papers

Related papers: Optimizing the MapReduce Framework on Intel Xeon P…

200 papers

In this paper we explore the performance of Intel Xeon MAX CPU Series, representing the most significant new variation upon the classical CPU architecture since the Intel Xeon Phi Processor. Given the availability of a large on-package…

Performance · Computer Science 2023-09-19 Istvan Z Reguly

Exploration tasks are essential to many emerging robotics applications, ranging from search and rescue to space exploration. The planning problem for exploration requires determining the best locations for future measurements that will…

Hardware Architecture · Computer Science 2022-10-10 Keshav Gupta , Peter Zhi Xuan Li , Sertac Karaman , Vivienne Sze

Image convolution is widely used for sharpening, blurring and edge detection. In this paper, we review two common algorithms for convolving a 2D image by a separable kernel (filter). After optimising the naive codes using loop unrolling and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-28 Ashkan Tousimojarad , Wim Vanderbauwhede , W Paul Cockshott

In this paper, we study the MapReduce framework from an algorithmic standpoint and demonstrate the usefulness of our approach by designing and analyzing efficient MapReduce algorithms for fundamental sorting, searching, and simulation…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-01-11 Michael T. Goodrich , Nodari Sitchinava , Qin Zhang

Applications of Fully Convolutional Networks (FCN) in iris segmentation have shown promising advances. For mobile and embedded systems, a significant challenge is that the proposed FCN architectures are extremely computationally demanding.…

Neural and Evolutionary Computing · Computer Science 2019-09-10 Hokchhay Tann , Heng Zhao , Sherief Reda

We evolve PyDTNN, a framework for distributed parallel training of Deep Neural Networks (DNNs), into an efficient inference tool for convolutional neural networks. Our optimization process on multicore ARM processors involves several…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-20 Adrián Castelló , Sergio Barrachina , Manuel F. Dolz , Enrique S. Quintana-Ortí , Pau San Juan

Using \textit{multiple streams} can improve the overall system performance by mitigating the data transfer overhead on heterogeneous systems. Prior work focuses a lot on GPUs but little is known about the performance impact on (Intel Xeon)…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-30 Zhaokui Li , Jianbin Fang , Tao Tang , Xuhao Chen , Cheng Chen , Canqun Yang

Today, one of the main challenges for high-performance computing systems is to improve their performance by keeping energy consumption at acceptable levels. In this context, a consolidated strategy consists of using accelerators such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-18 Manuel Costanzo , Enzo Rucci , Ulises Costi , Franco Chichizola , Marcelo Naiouf

To study the performance of multi-threaded Geant4 for high-energy physics experiments, an application has been developed which generalizes and extends previous work. A highly-complex detector geometry is used for benchmarking on an Intel…

Computational Physics · Physics 2016-05-27 Steven Farrell , Andrea Dotti , Makoto Asai , Paolo Calafiura , Romain Monnard

For computational fluid dynamics (CFD) applications with a large number of grid points/cells, parallel computing is a common efficient strategy to reduce the computational time. How to achieve the best performance in the modern…

Performance · Computer Science 2018-03-12 Yong-Xian Wang , Li-Lun Zhang , Wei Liu , Xing-Hua Cheng , Yu Zhuang , Anthony T. Chronopoulos

Sparse matrix vector multiplication (SpMV) is one of the most common operations in scientific and high-performance applications, and is often responsible for the application performance bottleneck. While the sparse matrix representation has…

Mathematical Software · Computer Science 2018-05-31 Shizhao Chen , Jianbin Fang , Donglin Chen , Chuanfu Xu , Zheng Wang

Embedded system performances are bounded by power consumption. The trend is to offload greedy computations on hardware accelerators as GPU, Xeon Phi or FPGA. FPGA chips combine both flexibility of programmable chips and energy-efficiency of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Christophe Alias

We implement the Lanczos algorithm on an Intel Xeon Phi coprocessor and compare its performance to a multi-core Intel Xeon CPU and an NVIDIA graphics processor. The Xeon and the Xeon Phi are parallelized with OpenMP and the graphics…

Strongly Correlated Electrons · Physics 2016-09-21 Topi Siro , Ari Harju

B-spline based orbital representations are widely used in Quantum Monte Carlo (QMC) simulations of solids, historically taking as much as 50% of the total run time. Random accesses to a large four-dimensional array make it challenging to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-10 Amrita Mathuriya , Ye Luo , Anouar Benali , Luke Shulenburger , Jeongnim Kim

The map-reduce parallel programming model has become extremely popular in the big data community. Many big data workloads can benefit from the enhanced performance offered by supercomputers. LLMapReduce provides the familiar map-reduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-13 Chansup Byun , Jeremy Kepner , William Arcand , David Bestor , Bill Bergeron , Vijay Gadepally , Matthew Hubbell , Peter Michaleas , Julie Mullen , Andrew Prout , Antonio Rosa , Charles Yee , Albert Reuther

In this article we discuss our implementation of a polyphase filter for real-time data processing in radio astronomy. We describe in detail our implementation of the polyphase filter algorithm and its behaviour on three generations of…

Instrumentation and Methods for Astrophysics · Physics 2016-04-22 Karel Adámek , Jan Novotný , Wes Armour

Many complex problems, such as natural language processing or visual object detection, are solved using deep learning. However, efficient training of complex deep convolutional neural networks for large data sets is computationally…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-06 Andre Viebke , Sabri Pllana , Suejb Memeti , Joanna Kolodziej

End-to-end (E2E) artificial intelligence (AI) pipelines are composed of several stages including data preprocessing, data ingestion, defining and training the model, hyperparameter optimization, deployment, inference, postprocessing,…

MapReduce is a popular programming paradigm for developing large-scale, data-intensive computation. Many frameworks that implement this paradigm have recently been developed. To leverage these frameworks, however, developers must become…

Databases · Computer Science 2018-06-20 Maaz Bin Safeer Ahmad , Alvin Cheung

This document is the final project report for our advanced operating system class. During this project, we mainly focused on applying multiprocessing and multi-threading technology to our whole project and utilized the map-reduce algorithm…

Numerical Analysis · Mathematics 2023-12-27 Zefeng Qiu , Prashanth Umapathy , Qingquan Zhang , Guanqun Song , Ting Zhu