中文
相关论文

相关论文: Hadoop Mapreduce Performance Enhancement Using In-…

200 篇论文

Applications like Yahoo, Facebook, Twitter have huge data which has to be stored and retrieved as per client access. This huge data storage requires huge database leading to increase in physical storage and becomes complex for analysis…

分布式、并行与集群计算 · 计算机科学 2013-07-08 Nandan Mirajkar , Sandeep Bhujbal , Aaradhana Deshmukh

This research introduces a revolutionary paradigm for HetNet management, presenting an innovative algorithmic framework that transcends traditional notions of network capacity enhancement. Our exploration delves into the intricate interplay…

网络与互联网体系结构 · 计算机科学 2023-12-22 Saimin Chen Zhang

System performance for networks composed of interconnected subsystems can be increased if the traditionally separated subsystems are jointly optimized. Recently, parallel and distributed optimization methods have emerged as a powerful tool…

最优化与控制 · 数学 2013-02-14 Ion Necoara , Valentin Nedelcu , Ioan Dumitrache

The Hadoop scheduler is a centerpiece of Hadoop, the leading processing framework for data-intensive applications in the cloud. Given the impact of failures on the performance of applications running on Hadoop, testing and verifying the…

软件工程 · 计算机科学 2021-09-10 Mbarka Soualhia , Foutse Khomh , Sofiene Tahar

With the advent of multi-core processors, network-on-chip design has been key in addressing network performances, such as bandwidth, power consumption, and communication delays when dealing with on-chip communication between the increasing…

新兴技术 · 计算机科学 2018-08-01 Tzyy-Juin Kao , Wolfgang Fink

With growing deployment of Internet of Things (IoT) and machine learning (ML) applications, which need to leverage computation on edge and cloud resources, it is important to develop algorithms and tools to place these distributed…

分布式、并行与集群计算 · 计算机科学 2021-12-30 Xiangchen Zhao , Diyi Hu , Bhaskar Krishnamachari

In this work, we consider the integration of MPI one-sided communication and non-blocking I/O in HPC-centric MapReduce frameworks. Using a decoupled strategy, we aim to overlap the Map and Reduce phases of the algorithm by allowing…

分布式、并行与集群计算 · 计算机科学 2018-10-10 Sergio Rivas-Gomez , Sai Narasimhamurthy , Keeran Brabazon , Oliver Perks , Erwin Laure , Stefano Markidis

The MultiNoC system implements a programmable on-chip multiprocessing platform built on top of an efficient, low area overhead intra-chip interconnection scheme. The employed interconnection structure is a Network on Chip, or NoC. NoCs are…

硬件体系结构 · 计算机科学 2011-11-09 Aline Mello , Leandro Moller , Ney Calazans , Fernando Moraes

High Performance and Energy Efficiency are critical requirements for Internet of Things (IoT) end-nodes. Exploiting tightly-coupled clusters of programmable processors (CMPs) has recently emerged as a suitable solution to address this…

硬件体系结构 · 计算机科学 2023-09-06 Jie Chen , Igor Loi , Eric Flamand , Giuseppe Tagliavini , Luca Benini , Davide Rossi

Optimizing data transfers is critical for improving job performance in data-parallel frameworks. In the hybrid data center with both wired and wireless links, reconfigurable wireless links can provide additional bandwidth to speed up job…

分布式、并行与集群计算 · 计算机科学 2022-09-26 Binquan Guo , Zhou Zhang , Ye Yan , Hongyan Li

MPI applications matter. However, with the advent of many-core processors, traditional MPI applications are challenged to achieve satisfactory performance. This is due to the inability of these applications to respond to load imbalances, to…

分布式、并行与集群计算 · 计算机科学 2019-12-20 Jan Ciesko , Pedro J. Martínez-Ferrer , Raúl Peñacoba Veigas , Xavier Teruel , Vicenç Beltran

MapReduce is a commonly used framework for executing data-intensive jobs on distributed server clusters. We introduce a variant implementation of MapReduce, namely "Coded MapReduce", to substantially reduce the inter-server communication…

分布式、并行与集群计算 · 计算机科学 2015-12-08 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Hardware heterogeneity is here to stay for high-performance computing. Large-scale systems are currently equipped with multiple GPU accelerators per compute node and are expected to incorporate more specialized hardware in the future. This…

分布式、并行与集群计算 · 计算机科学 2022-10-05 Polykarpos Thomadakis , Nikos Chrisochoides

The evolution of 5G and Beyond networks has enabled new applications with stringent end-to-end latency requirements, but providing reliable low-latency service with high throughput over public wireless networks is still a significant…

网络与互联网体系结构 · 计算机科学 2022-10-19 Andrea Bedin , Federico Chiariotti , Stepan Kucera , Andrea Zanella

Distributed approaches based on the map-reduce programming paradigm have started to be proposed in the bioinformatics domain, due to the large amount of data produced by the next-generation sequencing techniques. However, the use of…

分布式、并行与集群计算 · 计算机科学 2018-07-05 Umberto Ferraro Petrillo , Mara Sorella , Giuseppe Cattaneo , Raffaele Giancarlo , Simona Rombo

Mixture-of-Experts (MoE) models, though highly effective for various machine learning tasks, face significant deployment challenges on memory-constrained devices. While GPUs offer fast inference, their limited memory compared to CPUs means…

分布式、并行与集群计算 · 计算机科学 2025-05-06 Yujie Zhang , Shivam Aggarwal , Tulika Mitra

Coded distributed computing introduced by Li et al. in 2015 is an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce. In particular, Li et al. show that…

分布式、并行与集群计算 · 计算机科学 2018-02-13 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

We introduce a mapping framework for deep learning inference that takes advantage of predictable neural network behavior to plan both computation and communication ahead of time. The framework generates a unified stream of instructions and…

硬件体系结构 · 计算机科学 2025-09-05 Md Rownak Hossain Chowdhury , Mostafizur Rahman

Hybrid networks consisting of MANET nodes and cellular infrastructure have been recently proposed to improve the performance of military networks. Prior work has demonstrated the benefits of in-network content caching in a wired, Internet…

网络与互联网体系结构 · 计算机科学 2014-07-08 Mostafa Dehghan , Anand Seetharam , Ting He , Theodoros Salonidis , Jim Kurose , Don Towsley

The aim of parallel computing is to increase an application performance by executing the application on multiple processors. OpenMP is an API that supports multi platform shared memory programming model and shared-memory programs are…

分布式、并行与集群计算 · 计算机科学 2013-11-12 Vibha Rajput , Alok Katiyar