中文
相关论文

相关论文: OS-Assisted Task Preemption for Hadoop

200 篇论文

Low latency is critical for interactive networked applications. But while we know how to scale systems to increase capacity, reducing latency --- especially the tail of the latency distribution --- can be much more difficult. In this paper,…

网络与互联网体系结构 · 计算机科学 2013-06-18 Ashish Vulimiri , P. Brighten Godfrey , Radhika Mittal , Justine Sherry , Sylvia Ratnasamy , Scott Shenker

We are given a set of jobs, each one specified by its release date, its deadline and its processing volume (work), and a single (or a set of) speed-scalable processor(s). We adopt the standard model in speed-scaling in which if a processor…

数据结构与算法 · 计算机科学 2012-11-26 Evripidis Bampis , Giorgio Lucarelli , Ioannis Nemparis

Rapid launch of thousands of jobs is essential for effective interactive supercomputing, big data analysis, and AI algorithm development. Achieving thousands of launches per second has required hardware to be available to receive these…

Protected user-level libraries have been proposed as a way to allow mutually distrusting applications to safely share kernel-bypass services. In this paper, we identify and solve several previously unaddressed obstacles to realizing this…

操作系统 · 计算机科学 2025-09-04 Alan Beadle , Michael L. Scott , John Criswell

We study single-machine scheduling of jobs, each belonging to a job type that determines its duration distribution. We start by analyzing the scenario where the type characteristics are known and then move to two learning scenarios where…

机器学习 · 计算机科学 2023-06-02 Nadav Merlis , Hugo Richard , Flore Sentenac , Corentin Odic , Mathieu Molina , Vianney Perchet

Increasing data center network speed coupled with application requirements for high throughput and low latencies have raised the efficiency bar for network stacks. To reduce substantial kernel overhead in network processing, recent…

操作系统 · 计算机科学 2023-03-02 Yihan Yang , Zhuobin Huang , Antoine Kaufmann , Jialin Li

Algorithms based on semi-partitioned scheduling have been proposed as a viable alternative between the two extreme ones based on global and partitioned scheduling. In particular, allowing migration to occur only for few tasks which cannot…

操作系统 · 计算机科学 2010-06-15 François Dorin , Patrick Meumeu Yomsi , Joël Goossens , Pascal Richard

One significant challenge in the job scheduling of computing clusters for the development of deep learning algorithms is the efficient scheduling of trial-and-error (TE) job, the type of job in which the users seek to conduct small-scale…

分布式、并行与集群计算 · 计算机科学 2019-02-06 Hidehito Yabuuchi , Daisuke Taniwaki , Shingo Omura

Real-time systems increasingly use multicore processors in order to satisfy thermal, power, and computational requirements. To exploit the architectural parallelism offered by the multicore processors, parallel task models, scheduling…

分布式、并行与集群计算 · 计算机科学 2021-01-28 Niklas Ueter , Mario Günzel , Jian-Jia Chen

High Throughput Computing (HTC) provides a convenient mechanism for running thousands of tasks. Many HTC systems exploit computers which are provisioned for other purposes by utilising their idle time - volunteer computing. This has great…

分布式、并行与集群计算 · 计算机科学 2018-10-23 A. Stephen McGough , Matthew Forshaw , John Brennan , Noura Al Moubayed , Stephen Bonner

We consider fundamental scheduling problems motivated by energy issues. In this framework, we are given a set of jobs, each with a release time, deadline and required processing length. The jobs need to be scheduled on a machine so that at…

数据结构与算法 · 计算机科学 2016-10-27 Jessica Chang , Samir Khuller , Koyel Mukherjee

Hadoop is an open source implementation of the MapReduce Framework in the realm of distributed processing. A Hadoop cluster is a unique type of computational cluster designed for storing and analyzing large data sets across cluster of…

分布式、并行与集群计算 · 计算机科学 2014-11-10 Muralikrishnan Ramane , Sharmila Krishnamoorthy , Sasikala Gowtham

Hadoop MapReduce is now a popular choice for performing large-scale data analytics. This technical report describes a detailed set of mathematical performance models for describing the execution of a MapReduce job on Hadoop. The models…

分布式、并行与集群计算 · 计算机科学 2011-06-07 Herodotos Herodotou

This paper discussed some job scheduling algorithms for Hadoop platform, and proposed a jobs scheduling optimization algorithm based on Bayes Classification viewing the shortcoming of those algorithms which are used. The proposed algorithm…

分布式、并行与集群计算 · 计算机科学 2015-06-10 Yingjie Guo , Linzhi Wu , Wei Yu , Bin Wu , Xiaotian Wang

FPGAs are an attractive type of accelerator for all-purpose HPC computing systems due to the possibility of deploying tailored hardware on demand. However, the common tools for programming and operating FPGAs are still complex to use,…

分布式、并行与集群计算 · 计算机科学 2023-01-19 Gabriel Rodriguez-Canal , Nick Brown , Yuri Torres , Arturo Gonzalez-Escribano

Increasing data volumes in scientific experiments necessitate the use of high-performance computing (HPC) resources for data analysis. In many scientific fields, the data generated from scientific instruments and supercomputer simulations…

分布式、并行与集群计算 · 计算机科学 2021-03-25 Sam Nickolay , Eun-Sung Jung , Rajkumar Kettimuthu , Ian Foster

In practice, standard scheduling of parallel computing jobs almost always leaves significant portions of the available hardware unused, even with many jobs still waiting in the queue. The simple reason is that the resource requests of these…

分布式、并行与集群计算 · 计算机科学 2019-02-04 Florian Spenke , Karsten Balzer , Sascha Frick , Bernd Hartke , Johannes M. Dieterich

Haptic feedback can improve safety of teleoperated robots when situational awareness is limited or operators are inattentive. Standard potential field approaches increase haptic resistance as an obstacle is approached, which is desirable…

机器人学 · 计算机科学 2024-01-09 Ninghan Zhong , Kris Hauser

This paper focuses on the analysis of real-time non preemptive multiprocessor scheduling with precedence and several latency constraints. It aims to specify a schedulability condition which enables a designer to check a priori -without…

操作系统 · 计算机科学 2013-01-22 Omar Kermia

This paper addresses human-robot collaboration (HRC) challenges of integrating predictions of human activity to provide a proactive-n-reactive response capability for the robot. Prior works that consider current or predicted human poses as…

机器人学 · 计算机科学 2023-07-11 Jared Flowers , Marco Faroni , Gloria Wiens , Nicola Pedrocchi