English
Related papers

Related papers: OS-Assisted Task Preemption for Hadoop

200 papers

Processing computation-intensive jobs at multiple processing cores in parallel is essential in many real-world applications. In this paper, we consider an idealised model for job parallelism in which a job can be served simultaneously by…

Probability · Mathematics 2022-07-22 Ayalvadi Ganesh , Arpan Mukhopadhyay

We investigate the global scheduling of sporadic, implicit deadline, real-time task systems on multiprocessor platforms. We provide a task model which integrates job parallelism. We prove that the time-complexity of the feasibility problem…

Operating Systems · Computer Science 2008-05-22 S. Collette , L. Cucu , J. Goossens

In High Performance Computing (HPC) infrastructures, the control of resources by batch systems can lead to prolonged queue waiting times and adverse effects on the overall execution times of applications, particularly in data-intensive and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-19 Abel Souza , Kristiaan Pelckmans , Devarshi Ghoshal , Lavanya Ramakrishnan , Johan Tordsson

The rigid gang task model is based on the idea of executing multiple threads simultaneously on a fixed number of processors to increase efficiency and performance. Although there is extensive literature on global rigid gang scheduling,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Binqi Sun , Tomasz Kloda , Marco Caccamo

The HYDRO mini-application has been successfully used as a research vehicle in previous PRACE projects [6]. In this paper, we evaluate the benefits of the tasking model introduced in recent OpenMP standards [9]. We have developed a new…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-28 Jérémie Gaidamour , Dimitri Lecas , Pierre-François Lavallée

In warehousing systems, to enhance logistical efficiency amid surging demand volumes, much focus is placed on how to reasonably allocate tasks to robots. However, the robots labor is still inevitably wasted to some extent. In response to…

Robotics · Computer Science 2024-12-10 B. Cao , Z. Liu , X. Han , S. Zhou , H. Zhang , H. Wang

Previous work on ad hoc network capacity has focused primarily on source-destination throughput requirements for different models and transmission scenarios, with an emphasis on delay tolerant applications. In such problems, network…

Information Theory · Computer Science 2007-07-13 Cristina Comaniciu , H. Vincent Poor

Different scheduling algorithms for mixed criticality systems have been recently proposed. The common denominator of these algorithms is to discard low critical tasks whenever high critical tasks are in lack of computation resources. This…

Operating Systems · Computer Science 2020-03-13 Jalil Boudjadar , Saravanan Ramanathan , Arvind Easwaran , Ulrik Nyman

In this overview article we will consider the deliberate restarting of algorithms, a meta technique, in order to improve the algorithm's performance, e.g., convergence rates or approximation guarantees. One of the major advantages is that…

Optimization and Control · Mathematics 2020-06-29 Sebastian Pokutta

We investigate the scheduling of $n$ jobs divided into $c$ classes on $m$ identical parallel machines. For every class there is a setup time which is required whenever a machine switches from the processing of one class to another class.…

Data Structures and Algorithms · Computer Science 2019-05-02 Max A. Deppert , Klaus Jansen

Nowadays many companies have available large amounts of raw, unstructured data. Among Big Data enabling technologies, a central place is held by the MapReduce framework and, in particular, by its open source implementation, Apache Hadoop.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-18 Eugenio Gianniti , Danilo Ardagna , Michele Ciavotta , Mauro Passacantando

In shared autonomy, a user and autonomous system work together to achieve shared goals. To collaborate effectively, the autonomous system must know the user's goal. As such, most prior works follow a predict-then-act model, first predicting…

With the rapid advancement of artificial intelligence, there is an increasing demand for intelligent robots capable of assisting humans in daily tasks and performing complex operations. Such robots not only require task planning…

Robotics · Computer Science 2025-05-01 Huihui Guo , Huilong Pi , Yunchuan Qin , Zhuo Tang , Kenli Li

Modern applications can generate a large amount of data from different sources with high velocity, a combination that is difficult to store and process via traditional tools. Hadoop is one framework that is used for the parallel processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 Rana Ghazali , Sahar Adabi , Ali Rezaee , Douglas G. Down , Ali Movaghar

We investigate the problem of scheduling the maintenance of edges in a network, motivated by the goal of minimizing outages in transportation or telecommunication networks. We focus on maintaining connectivity between two nodes over time;…

Data Structures and Algorithms · Computer Science 2017-02-01 Fidaa Abed , Lin Chen , Yann Disser , Martin Groß , Nicole Megow , Julie Meißner , Alexander T. Richter , Roman Rischke

Multi-tier computing can enhance the task computation by multi-tier computing nodes. In this paper, we propose a cell-free massive multiple-input multiple-output (MIMO) aided computing system by deploying multi-tier computing nodes to…

Networking and Internet Architecture · Computer Science 2023-04-17 Kunlun Wang , Dusit Niyato , Wen Chen , Arumugam Nallanathan

While advanced analysis of large dataset is in high demand, data sizes have surpassed capabilities of conventional software and hardware. Hadoop framework distributes large datasets over multiple commodity servers and performs parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-17 Woo-Hyun Lee , Hee-Gook Jun , Hyoung-Joo Kim

Neural networks offer high-accuracy solutions to a range of problems, but are costly to run in production systems because of computational and memory requirements during a forward pass. Given a trained network, we propose a techique called…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Michele Pratusevich

Duplication can be a powerful strategy for overcoming stragglers in cloud services, but is often used conservatively because of the risk of overloading the system. We present duplicate-aware scheduling or DAS, which makes duplication safe…

Networking and Internet Architecture · Computer Science 2019-06-03 Hafiz Mohsin Bashir , Abdullah Bin Faisal , Muhammad Asim Jamshed , Peter Vondras , Ali Musa Iftikhar , Ihsan Ayyub Qazi , Fahad R. Dogar

Failure injection in distributed systems has been an important issue to experiment with robust, resilient distributed systems. In order to reproduce real-life conditions, parts of the application must be killed without letting the operating…

Operating Systems · Computer Science 2015-02-06 Camille Coti , Nicolas Greneche