中文
相关论文

相关论文: Network Load Analysis and Provisioning of MapReduc…

200 篇论文

Mapping applications onto heterogeneous platforms is a difficult challenge, even for simple application patterns such as pipeline graphs. The problem is even more complex when processors are subject to failure during the execution of the…

分布式、并行与集群计算 · 计算机科学 2008-03-26 Anne Benoit , Veronika Rehn-Sonigo , Yves Robert

Recent studies increasingly adopt simulation-based machine learning (ML) models to analyze critical infrastructure system resilience. For realistic applications, these ML models consider the component-level characteristics that influence…

机器学习 · 计算机科学 2022-05-09 Srijith Balakrishnan , Beatrice Cassottana , Arun Verma

Hybrid parallelism techniques are essential for efficiently training large language models (LLMs). Nevertheless, current automatic parallel planning frameworks often overlook the simultaneous consideration of node heterogeneity and dynamic…

分布式、并行与集群计算 · 计算机科学 2025-06-04 Ruilong Wu , Xinjiao Li , Yisu Wang , Xinyu Chen , Dirk Kutscher

The use of machine learning algorithms to investigate phase transitions in physical systems is a valuable way to better understand the characteristics of these systems. Neural networks have been used to extract information of phases and…

神经与进化计算 · 计算机科学 2025-10-21 Rodrigo Carmo Terin , Zochil González Arenas , Roberto Santana

We study probabilistic protocols for concurrent threshold-based load balancing in networks. There are n resources or machines represented by nodes in an undirected graph and m >> n users that try to find an acceptable resource by moving…

数据结构与算法 · 计算机科学 2013-06-07 Martin Hoefer , Thomas Sauerwald

MapReduce has proven to be one of the most useful paradigms in the revolution of distributed computing, where cloud services and cluster computing become the standard venue for computing. The federation of cloud and big data activities is…

数据库 · 计算机科学 2016-07-29 Foto Afrati , Shlomi Dolev , Shantanu Sharma , Jeffrey D. Ullman

This paper investigates mobility management strategies from the point of view of their need of signalling and processing resources on the backbone network and load on the air interface. A method is proposed to model the serving network and…

性能 · 计算机科学 2008-10-03 Peter Fulop , Benedek Kovacs , Sandor Imre

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

多智能体系统 · 计算机科学 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

We consider non-preemptive scheduling of MapReduce jobs with multiple tasks in the practical scenario where each job requires several map-reduce rounds. We seek to minimize the average weighted completion time and consider scheduling on…

数据结构与算法 · 计算机科学 2016-02-18 Dimitris Fotakis , Ioannis Milis , Orestis Papadigenopoulos , Vasilis Vassalos , Georgios Zois

In the context of decision making under explorable uncertainty, scheduling with testing is a powerful technique used in the management of computer systems to improve performance via better job-dispatching decisions. Upon job arrival, a…

性能 · 计算机科学 2025-02-13 Jonatha Anselmi , Josu Doncel

The most important stages in designing a computer network in a wider geographical area include: definition of requirements, topological description, identification and calculation of relevant parameters (i.e. traffic matrix), determining…

网络与互联网体系结构 · 计算机科学 2014-06-12 Basri Ahmedi , Pece Mitrevski

We present in this paper a model for forecasting short-term power loads based on deep residual networks. The proposed model is able to integrate domain knowledge and researchers' understanding of the task by virtue of different neural…

机器学习 · 统计学 2018-05-31 Kunjin Chen , Kunlong Chen , Qin Wang , Ziyu He , Jun Hu , Jinliang He

We introduced the load-balanced routing algorithms, for interconnection networks resulting from nesting, by considering the pressure of the data forwarding in each node. Benchmarks on a small cluster with various network topologies, and…

网络与互联网体系结构 · 计算机科学 2019-12-30 Zhipeng Xu , Xiaolong Huang , Yuefan Deng

Short Term Load forecasting in this paper uses input data dependent on parameters such as load for current hour and previous two hours, temperature for current hour and previous two hours, wind for current hour and previous two hours, cloud…

神经与进化计算 · 计算机科学 2009-12-08 Mrs. J. P. Rothe , Dr. A. K. Wadhwani , Dr. Mrs. S. Wadhwani

We introduce four algorithms for packet transport in complex networks. These algorithms use deterministic rules which depend, in different ways, on the degree of the node, the number of packets posted down each edge, the mean delivery time…

网络与互联网体系结构 · 计算机科学 2008-02-26 B. Kujawski , G. J. Rodgers , Bosiljka Tadić

Traffic is a challenge in rural and urban areas alike with negative effects ranging from congestion to air pollution. Ride-sharing poses an appealing alternative to personal cars, combining the traffic-reducing ride bundling of public…

物理与社会 · 物理学 2021-02-24 Debsankha Manik , Nora Molkenthin

Nowadays many companies have available large amounts of raw, unstructured data. Among Big Data enabling technologies, a central place is held by the MapReduce framework and, in particular, by its open source implementation, Apache Hadoop.…

分布式、并行与集群计算 · 计算机科学 2017-01-18 Eugenio Gianniti , Danilo Ardagna , Michele Ciavotta , Mauro Passacantando

Distributed computing frameworks such as MapReduce are often used to process large computational jobs. They operate by partitioning each job into smaller tasks executed on different servers. The servers also need to exchange intermediate…

分布式、并行与集群计算 · 计算机科学 2020-04-20 Konstantinos Konstantinidis , Aditya Ramamoorthy

Many Hadoop configuration parameters have significant influence in the performance of running MapReduce jobs on Hadoop. It is time-consuming and tedious for general users to manually tune the parameters for optimal MapReduce performance.…

分布式、并行与集群计算 · 计算机科学 2020-01-01 Donghua Chen

In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and…

数值分析 · 数学 2020-09-25 Eric Chung , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang